Dense Depth Posterior (DDP) from Single Image and Sparse Range
Not on the map. Why?
Abstract (arXiv)
We present a deep learning system to infer the posterior distribution of a dense depth map associated with an image, by exploiting sparse range measurements, for instance from a lidar. While the lidar may provide a depth value for a small percentage of the pixels, we exploit regularities reflected in the training set to complete the map so as to have a probability over depth for each pixel in the image. We exploit a Conditional Prior Network, that allows associating a probability to each depth value given an image, and combine it with a likelihood term that uses the sparse measurements. Optionally we can also exploit the availability of stereo during training, but in any case only require a single image and a sparse point cloud at run-time. We test our approach on both unsupervised and supervised depth completion using the KITTI benchmark, and improve the state-of-the-art in both.
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 16; 2023: 8; 2024: 13; 2025: 8; 2026: 1.
57 papers.
Sort:
By area:
- 2021RigNet: Repetitive Image Guided Network for Depth Completioncited by 80
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2024Bilateral Propagation Network for Depth Completioncited by 59
- 2021Depth Completion with Twin Surface Extrapolation at Occlusion Boundariescited by 41
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completioncited by 38
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2022DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completioncited by 27
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2022Monitored Distillation for Positive Congruent Depth Completioncited by 24
38 more
- 2021Bayesian Deep Basis Fitting for Depth Completion with Uncertaintycited by 23
- 2022ALTO: Alternating Latent Topologies for Implicit 3D Reconstructioncited by 21
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scalecited by 20
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2021A Surface Geometry Model for LiDAR Depth Completioncited by 18
- 2021Stereoscopic Universal Perturbations across Different Architectures and Datasetscited by 17
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimationcited by 15
- 2021Advancing Self-supervised Monocular Depth Learning with Sparse LiDARcited by 13
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completioncited by 12
- 2022Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depthcited by 11
- 2023RigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completioncited by 11
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypescited by 11
- 2023Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedbackcited by 10
- 2024Distilling Diffusion Models to Efficient 3D LiDAR Scene Completioncited by 10
- 2022Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensorcited by 9
- 2023Clutter Detection and Removal in 3D Scenes with View-Consistent Inpaintingcited by 9
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2024RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methodscited by 8
- 2024All-day Depth Completioncited by 8
- 2024GET-UP: GEomeTric-aware Depth Estimation with Radar Points UPsamplingcited by 7
- 2022A Low Memory Footprint Quantized Neural Network for Depth Completion of Very Sparse Time-of-Flight Depth Mapscited by 6
- 2022Towards Domain-agnostic Depth Completioncited by 6
- 2022Learning an Efficient Multimodal Depth Completion Modelcited by 6
- 2021DnD: Dense Depth Estimation in Crowded Dynamic Indoor Scenescited by 5
- 2022SemSegDepth: A Combined Model for Semantic Segmentation and Depth Completioncited by 5
- 2024UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completioncited by 5
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimationcited by 5
- 2025Diffusion Distillation With Direct Preference Optimization For Efficient 3D LiDAR Scene Completioncited by 4
- 2025ETA: Energy-based Test-time Adaptation for Depth Completioncited by 4
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2022Segmentation-guided Domain Adaptation for Efficient Depth Completioncited by 2
- 2022PanDepth: Joint Panoptic Segmentation and Depth Completioncited by 2
- 2022Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matchingcited by 1
- 2023Lidar Line Selection with Spatially-Aware Shapley Value for Cost-Efficient Depth Completioncited by 1
- 2025DenseFormer: Learning Dense Depth Map from Sparse Depth and Image via Conditional Diffusion Modelcited by 1
- 2025StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completioncited by 1
- 2022On the Viability of Monocular Depth Pre-training for Semantic Segmentationcited by 0
- 2022MetaComp: Learning to Adapt for Online Depth Completioncited by 0
50 most cited of 57 All 57 (JSON)
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation28 Aug 2026
- 2025StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completion15 Dec 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Training Self-Supervised Depth Completion Using Sparse Measurements and a Single Image20 Jul 2025
- 2025Diffusion Distillation With Direct Preference Optimization For Efficient 3D LiDAR Scene Completion15 Apr 2025
- 2025DenseFormer: Learning Dense Depth Map from Sparse Depth and Image via Conditional Diffusion Model31 Mar 2025
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimation21 Mar 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completion26 Dec 2024
- 2024Distilling Diffusion Models to Efficient 3D LiDAR Scene Completion4 Dec 2024
- 2024UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completion23 Oct 2024
38 more
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024Deep Cost Ray Fusion for Sparse Depth Video Completion23 Sep 2024
- 2024SDformer: Efficient End-to-End Transformer for Depth Completion12 Sep 2024
- 2024GET-UP: GEomeTric-aware Depth Estimation with Radar Points UPsampling2 Sep 2024
- 2024All-day Depth Completion27 May 2024
- 2024RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods16 May 2024
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimation4 Apr 2024
- 2024Bilateral Propagation Network for Depth Completion17 Mar 2024
- 2024Test-Time Adaptation for Depth Completion5 Feb 2024
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale9 Jan 2024
- 2023Self-Supervised Depth Completion Guided by 3D Perception and Geometry Consistency23 Dec 2023
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimation15 Oct 2023
- 2023Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedback27 Sep 2023
- 2023DEUX: Active Exploration for Learning Unsupervised Depth Perception16 Sep 2023
- 2023RigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completion1 Sep 2023
- 2023Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting7 Apr 2023
- 2023Sparse Depth-Guided Attention for Accurate Depth Completion: A Stereo-Assisted Monitored Distillation Approach28 Mar 2023
- 2023Lidar Line Selection with Spatially-Aware Shapley Value for Cost-Efficient Depth Completion21 Mar 2023
- 2022PanDepth: Joint Panoptic Segmentation and Depth Completion29 Dec 2022
- 2022ALTO: Alternating Latent Topologies for Implicit 3D Reconstruction8 Dec 2022
- 2022DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion20 Nov 2022
- 2022Segmentation-guided Domain Adaptation for Efficient Depth Completion14 Oct 2022
- 2022Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matching4 Oct 2022
- 2022Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor27 Sep 2022
- 2022SemSegDepth: A Combined Model for Semantic Segmentation and Depth Completion1 Sep 2022
- 2022Learning an Efficient Multimodal Depth Completion Model23 Aug 2022
- 2022Towards Domain-agnostic Depth Completion29 Jul 2022
- 2022MetaComp: Learning to Adapt for Online Depth Completion21 Jul 2022
- 2022Not Just Streaks: Towards Ground Truth for Single Image Deraining22 Jun 2022
- 2022A Low Memory Footprint Quantized Neural Network for Depth Completion of Very Sparse Time-of-Flight Depth Maps25 May 2022
- 2022Deep Depth Completion from Extremely Sparse Data: A Survey11 May 2022
- 2022Monitored Distillation for Positive Congruent Depth Completion30 Mar 2022
- 2022On the Viability of Monocular Depth Pre-training for Semantic Segmentation26 Mar 2022
- 2022Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depth3 Feb 2022
- 2021Stereoscopic Universal Perturbations across Different Architectures and Datasets12 Dec 2021
- 2021Advancing Self-supervised Monocular Depth Learning with Sparse LiDAR20 Sep 2021
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layers24 Aug 2021
- 2021DnD: Dense Depth Estimation in Crowded Dynamic Indoor Scenes12 Aug 2021
50 newest of 57 All 57 (JSON)
- 2021RigNet: Repetitive Image Guided Network for Depth Completioncited by 80
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2024Bilateral Propagation Network for Depth Completioncited by 59
- 2021Depth Completion with Twin Surface Extrapolation at Occlusion Boundariescited by 41
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completioncited by 38
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2022DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completioncited by 27
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2022Monitored Distillation for Positive Congruent Depth Completioncited by 24
12 most cited of 54 All 54 (JSON)
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation28 Aug 2026
- 2025StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completion15 Dec 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Training Self-Supervised Depth Completion Using Sparse Measurements and a Single Image20 Jul 2025
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimation21 Mar 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completion26 Dec 2024
- 2024UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completion23 Oct 2024
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024Deep Cost Ray Fusion for Sparse Depth Video Completion23 Sep 2024
- 2024SDformer: Efficient End-to-End Transformer for Depth Completion12 Sep 2024
12 newest of 54 All 54 (JSON)