Unsupervised confidence for LiDAR depth maps and applications
Not on the map. Why?
Abstract (arXiv)
Depth perception is pivotal in many fields, such as robotics and autonomous driving, to name a few. Consequently, depth sensors such as LiDARs rapidly spread in many applications. The 3D point clouds generated by these sensors must often be coupled with an RGB camera to understand the framed scene semantically. Usually, the former is projected over the camera image plane, leading to a sparse depth map. Unfortunately, this process, coupled with the intrinsic issues affecting all the depth sensors, yields noise and gross outliers in the final output. Purposely, in this paper, we propose an effective unsupervised framework aimed at explicitly addressing this issue by learning to estimate the confidence of the LiDAR sparse depth map and thus allowing for filtering out the outliers. Experimental results on the KITTI dataset highlight that our framework excels for this purpose. Moreover, we demonstrate how this achievement can improve a wide range of tasks.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 34 of its 54 references that are in the map. First posted on arXiv 6 Oct 2022.
Builds on
34 of 54 references.
References · 34
- 2017Mask R-CNNcited by 7,277
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 410
- 2017Sparsity Invariant CNNscited by 326
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
- 2020SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Drivingcited by 226
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 190
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2017Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Imagecited by 161
22 more
- 2021PENet: Towards Precise and Efficient Image Guided Depth Completioncited by 146
- 2018Self-supervised Sparse-to-Dense: Self-supervised Depth Completion from LiDAR and Monocular Cameracited by 140
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
- 2021SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloudcited by 119
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2019Sampling-free Epistemic Uncertainty Estimation Using Approximated Variance Propagationcited by 74
- 2021Weakly Supervised Learning of Rigid 3D Scene Flowcited by 60
- 2020Uncertainty-Aware CNNs for Depth Completion: Uncertainty from Beginning to Endcited by 55
- 2018Confidence Propagation through CNNs for Guided Sparse Depth Regressioncited by 52
- 2020Intensity Scan Context: Coding Intensity and Geometry Relations for Loop Closure Detectioncited by 37
- 2020Reversing the cycle: self-supervised deep stereo through enhanced monocular distillationcited by 34
- 2019Noise-Aware Unsupervised Deep Lidar-Stereo Fusioncited by 31
- 2021MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Squarecited by 27
- 2017ProbFlow: Joint Optical Flow and Uncertainty Estimationcited by 24
- 2019Guided Stereo Matchingcited by 24
- 2020DeepLiDARFlow: A Deep Learning Architecture For Scene Flow Estimation Using Monocular Camera and Sparse LiDARcited by 24
- 2020Continual Adaptation for Deep Stereocited by 23
- 2021On the confidence of stereo matching in a deep-learning era: a quantitative evaluationcited by 23
- 2021A Surface Geometry Model for LiDAR Depth Completioncited by 18
- 20193D LiDAR and Stereo Fusion using Stereo Matching Network with Conditional Cost Volume Normalizationcited by 17
- 2021S3Net: 3D LiDAR Sparse Semantic Segmentation Networkcited by 9
- 2021Sensor-Guided Optical Flowcited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 1; 2026: 1.
10 papers.
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
- 2024OMNI-DC: Highly Robust Depth Completion with Multiresolution Depth Integrationcited by 30
- 2023RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimationcited by 26
- 2024OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterationscited by 24
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalizationcited by 18
- 2023Active Stereo Without Pattern Projectorcited by 8
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Priorcited by 6
- 2024Depth on Demand: Streaming Dense Depth from a Low Frame Rate Active Sensorcited by 2
- 2024Active Stereo in the Wild through Virtual Pattern Projectioncited by 0
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusioncited by 0
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion11 Mar 2026
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Prior10 Feb 2025
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion18 Dec 2024
- 2024OMNI-DC: Highly Robust Depth Completion with Multiresolution Depth Integration28 Nov 2024
- 2024Depth on Demand: Streaming Dense Depth from a Low Frame Rate Active Sensor12 Sep 2024
- 2024OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterations17 Jun 2024
- 2024Active Stereo in the Wild through Virtual Pattern Projection6 Jun 2024
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalization14 Dec 2023
- 2023RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation26 Sep 2023
- 2023Active Stereo Without Pattern Projector21 Sep 2023