cs.CVOct 6, 2026

LiDAR Resolution Recovery via Foundation-Model-Guided Diffusion

Authors: Samed Doğan, Nico Leuze, Alfred Schöttl

Organizations: Dept. of Electrical Engineering and Information Technology Munich University of Applied Sciences, 80335 Munich, Germany

Abstract

High-beam-count LiDAR sensors are costly, yet many perception pipelines require dense angular sampling. Using a pretrained Stable Diffusion model as the backbone, we fine-tune a LiDAR-conditioned depth model with pseudo-depth targets from a 2D foundation model. During training, the LiDAR conditioning is randomly decimated at different beam budgets. We then investigate how much of a LiDAR scan can be recovered from heavily decimated input and characterize performance across the input beam budget. We evaluate against physically held-out real beams on nuScenes and report recovery separately from fit accuracy. Our model yields its largest advantage in very sparse regimes, achieving a δ1.25δ_{1.25} accuracy of 66.866.8% from 44-beam input where scattered interpolation reaches only 45.145.1%. A class-stratified error breakdown further reveals that planar surfaces recover first while objects introducing depth discontinuities degrade earliest. Together, these results quantify the recovery/resolution trade-off for foundation-model-guided LiDAR enhancement.

Figures & tables

Explore similar work

CardsList
  1. Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge

    Sep 9, 2026Samed Doğan, Nico Leuze, Alfred Schöttl3D Representation3D Generation

  2. Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo

    Jul 26, 2025Jinsu Yoo, Sooyoung Jeon, Zanming Huang +2Stereo MatchingLidar