Perfecting Depth: Uncertainty-Aware Enhancement of Metric Depth
Not on the map. Why?
Abstract (arXiv)
We propose a novel two-stage framework for sensor depth enhancement, called Perfecting Depth. This framework leverages the stochastic nature of diffusion models to automatically detect unreliable depth regions while preserving geometric cues. In the first stage (stochastic estimation), the method identifies unreliable measurements and infers geometric structure by leveraging a training-inference domain gap. In the second stage (deterministic refinement), it enforces structural consistency and pixel-level accuracy using the uncertainty map derived from the first stage. By combining stochastic uncertainty modeling with deterministic refinement, our method yields dense, artifact-free depth maps with improved reliability. Experimental results demonstrate its effectiveness across diverse real-world scenarios. Furthermore, theoretical analysis, various experiments, and qualitative visualizations validate its robustness and scalability. Our framework sets a new baseline for sensor depth enhancement, with potential applications in autonomous driving, robotics, and immersive technologies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 60 of its 72 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
60 of 72 references.
References · 60
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
38 more
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2017Deep Bayesian Active Learning with Image Datacited by 819
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2022MaxViT: Multi-Axis Vision Transformercited by 476
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2020Non-Local Spatial Propagation Network for Depth Completioncited by 195
- 2017Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Imagecited by 161
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2018Learning Depth with Convolutional Spatial Propagation Networkcited by 136
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2018Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Networkcited by 110
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
- 2016IM2CADcited by 78
- 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 73
- 2021Discrete Cosine Transform Network for Guided Depth Map Super-Resolutioncited by 71
- 2021Towards Fast and Accurate Real-World Depth Super-Resolution: Benchmark Dataset and Baselinecited by 61
- 2023LRRU: Long-short Range Recurrent Updating Networks for Depth Completioncited by 49
- 2022Guided Depth Super-Resolution by Deep Anisotropic Diffusioncited by 46
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026DC-LA: Difference-of-Convex Langevin Algorithmcited by 2
- 2026DC-LA: Difference-of-Convex Langevin Algorithm30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
- 2024SteeredMarigold: Steering Diffusion Towards Depth Completion of Largely Incomplete Depth Maps
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformers
- 2026Reliable iToF Depth Sensing via Sensor-Intrinsic Uncertainty Modeling and State-Space Restoration
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling
- 2023Monocular Depth Estimation using Diffusion Models
- 2023MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Prior