mlsanityData to 7 Oct 2026

Uncertainty Estimation for 3D Object Detection via Evidential Learning

arXiv 2410.23910 ↗First posted 31 Oct 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

3D object detection is an essential task for computer vision applications in autonomous vehicles and robotics. However, models often struggle to quantify detection reliability, leading to poor performance on unfamiliar scenes. We introduce a framework for quantifying uncertainty in 3D object detection by leveraging an evidential learning loss on Bird's Eye View representations in the 3D detector. These uncertainty estimates require minimal computational overhead and are generalizable across different architectures. We demonstrate both the efficacy and importance of these uncertainty estimates on identifying out-of-distribution scenes, poorly localized objects, and missing (false negative) detections; our framework consistently improves over baselines by 10-20% on average. Finally, we integrate this suite of tasks into a system where a 3D object detector auto-labels driving scenes and our uncertainty estimates verify label correctness before the labels are used to train a second model. Here, our uncertainty-driven verification results in a 1% improvement in mAP and a 1-2% improvement in NDS.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 48 of its 57 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

48 of 57 references.

References · 48

  1. 2020End-to-End Object Detection with Transformerscited by 7,384
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  8. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  9. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  10. 2019Objects as Pointscited by 1,172
  11. 2020Center-based 3D Object Detection and Trackingcited by 1,143
  12. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
36 more
  1. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  2. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
  3. 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
  4. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  5. 2015Variational Dropout and the Local Reparameterization Trickcited by 489
  6. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
  7. 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
  8. 2019Deep Evidential Regressioncited by 354
  9. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
  10. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  11. 2015Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networkscited by 295
  12. 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
  13. 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
  14. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
  15. 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
  16. 2021Evidential Deep Learning for Open Set Action Recognitioncited by 96
  17. 2020Masksembles for Uncertainty Estimationcited by 88
  18. 2020Bayesian Deep Learning via Subnetwork Inferencecited by 85
  19. 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
  20. 2019Sampling-free Epistemic Uncertainty Estimation Using Approximated Variance Propagationcited by 74
  21. 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimationcited by 71
  22. 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
  23. 2023FocalFormer3D : Focusing on Hard Instance for 3D Object Detectioncited by 58
  24. 2020Depth Uncertainty in Neural Networkscited by 56
  25. 2022Packed-Ensembles for Efficient Uncertainty Estimationcited by 49
  26. 2020BEV-Seg: Bird's Eye View Semantic Segmentation Using Geometry and Semantic Point Cloudcited by 38
  27. 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
  28. 2021Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detectioncited by 27
  29. 2023Open Set Action Recognition via Multi-Label Evidential Learningcited by 26
  30. 2021Deep Deterministic Uncertainty for Semantic Segmentationcited by 24
  31. 2022ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inferencecited by 15
  32. 2021DEBOSH: Deep Bayesian Shape Optimizationcited by 14
  33. 2023Continual Evidential Deep Learning for Out-of-Distribution Detectioncited by 11
  34. 2024Enabling Uncertainty Estimation in Iterative Neural Networkscited by 11
  35. 2023Beyond Active Learning: Leveraging the Full Potential of Human Interaction via Auto-Labeling, Human Correction, and Human Verificationcited by 4
  36. 2022PartAL: Efficient Partial Active Learning in Multi-Task Visual Settingscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.