LiDAR Resolution Recovery via Foundation-Model-Guided Diffusion
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
High-beam-count LiDAR sensors are costly, yet many perception pipelines require dense angular sampling. Using a pretrained Stable Diffusion model as the backbone, we fine-tune a LiDAR-conditioned depth model with pseudo-depth targets from a 2D foundation model. During training, the LiDAR conditioning is randomly decimated at different beam budgets. We then investigate how much of a LiDAR scan can be recovered from heavily decimated input and characterize performance across the input beam budget. We evaluate against physically held-out real beams on nuScenes and report recovery separately from fit accuracy. Our model yields its largest advantage in very sparse regimes, achieving a δ1.25 accuracy of 66.8% from 4-beam input where scattered interpolation reaches only 45.1%. A class-stratified error breakdown further reveals that planar surfaces recover first while objects introducing depth discontinuities degrade earliest. Together, these results quantify the recovery/resolution trade-off for foundation-model-guided LiDAR enhancement.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Physics-Aware Diffusion for LiDAR Point Cloud Densification
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models
- 2024Iterative Camera-LiDAR Extrinsic Optimization via Surrogate Diffusion
- 2024Fast LiDAR Upsampling using Conditional Diffusion Models
- 2025Iterative Camera-LiDAR Extrinsic Optimization via Surrogate Diffusion
- 2025Unsupervised Radar Point Cloud Enhancement via Arbitrary LiDAR Guided Diffusion Prior
- 2026Iterate or Widen? When Test-Time Refinement Helps LiDAR Scene Completion: A Controlled Study of Evidence Geometry, Training Coverage, and Compute
- 2024Scaling Diffusion Models to Real-World 3D LiDAR Scene Completion