Uncertainty Estimation for 3D Object Detection via Evidential Learning
Not on the map. Why?
Abstract (arXiv)
3D object detection is an essential task for computer vision applications in autonomous vehicles and robotics. However, models often struggle to quantify detection reliability, leading to poor performance on unfamiliar scenes. We introduce a framework for quantifying uncertainty in 3D object detection by leveraging an evidential learning loss on Bird's Eye View representations in the 3D detector. These uncertainty estimates require minimal computational overhead and are generalizable across different architectures. We demonstrate both the efficacy and importance of these uncertainty estimates on identifying out-of-distribution scenes, poorly localized objects, and missing (false negative) detections; our framework consistently improves over baselines by 10-20% on average. Finally, we integrate this suite of tasks into a system where a 3D object detector auto-labels driving scenes and our uncertainty estimates verify label correctness before the labels are used to train a second model. Here, our uncertainty-driven verification results in a 1% improvement in mAP and a 1-2% improvement in NDS.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 48 of its 57 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
48 of 57 references.
References · 48
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2019Objects as Pointscited by 1,172
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
36 more
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2015Variational Dropout and the Local Reparameterization Trickcited by 489
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
- 2019Deep Evidential Regressioncited by 354
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2015Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networkscited by 295
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
- 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
- 2021Evidential Deep Learning for Open Set Action Recognitioncited by 96
- 2020Masksembles for Uncertainty Estimationcited by 88
- 2020Bayesian Deep Learning via Subnetwork Inferencecited by 85
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2019Sampling-free Epistemic Uncertainty Estimation Using Approximated Variance Propagationcited by 74
- 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimationcited by 71
- 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
- 2023FocalFormer3D : Focusing on Hard Instance for 3D Object Detectioncited by 58
- 2020Depth Uncertainty in Neural Networkscited by 56
- 2022Packed-Ensembles for Efficient Uncertainty Estimationcited by 49
- 2020BEV-Seg: Bird's Eye View Semantic Segmentation Using Geometry and Semantic Point Cloudcited by 38
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2021Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detectioncited by 27
- 2023Open Set Action Recognition via Multi-Label Evidential Learningcited by 26
- 2021Deep Deterministic Uncertainty for Semantic Segmentationcited by 24
- 2022ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inferencecited by 15
- 2021DEBOSH: Deep Bayesian Shape Optimizationcited by 14
- 2023Continual Evidential Deep Learning for Out-of-Distribution Detectioncited by 11
- 2024Enabling Uncertainty Estimation in Iterative Neural Networkscited by 11
- 2023Beyond Active Learning: Leveraging the Full Potential of Human Interaction via Auto-Labeling, Human Correction, and Human Verificationcited by 4
- 2022PartAL: Efficient Partial Active Learning in Multi-Task Visual Settingscited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025NRSeg: Noise-Resilient Learning for BEV Semantic Segmentation via Driving World Modelscited by 2
- 2026Uncertainty-Aware Pedestrian Attribute Recognition via Evidential Deep Learningcited by 1
- 2025Minority Reports: Balancing Cost and Quality in Ground Truth Data Annotationcited by 0
- 2026UECP: Uncertainty-Enhanced Collaborative Perceptioncited by 0
- 2026Evidential Deep Learning for Multi-Modal Anti-UAV Detectioncited by 0
- 2026Evidential Deep Learning for Multi-Modal Anti-UAV Detection1 Sep 2026
- 2026UECP: Uncertainty-Enhanced Collaborative Perception22 Jun 2026
- 2026Uncertainty-Aware Pedestrian Attribute Recognition via Evidential Deep Learning29 Apr 2026
- 2025NRSeg: Noise-Resilient Learning for BEV Semantic Segmentation via Driving World Models5 Jul 2025
- 2025Minority Reports: Balancing Cost and Quality in Ground Truth Data Annotation12 Apr 2025