Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detection
Not on the map. Why?
Abstract (arXiv)
To assure that an autonomous car is driving safely on public roads, its object detection module should not only work correctly, but show its prediction confidence as well. Previous object detectors driven by deep learning do not explicitly model uncertainties in the neural network. We tackle with this problem by presenting practical methods to capture uncertainties in a 3D vehicle detector for Lidar point clouds. The proposed probabilistic detector represents reliable epistemic uncertainty and aleatoric uncertainty in classification and localization tasks. Experimental results show that the epistemic uncertainty is related to the detection accuracy, whereas the aleatoric uncertainty is influenced by vehicle distance and occlusion. The results also show that we can improve the detection performance by 1%-5% by modeling the aleatoric uncertainty.
Key facts. Cited by 82 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 18; 2022: 17; 2023: 16; 2024: 14; 2025: 6; 2026: 9.
82 papers.
Sort:
By area:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2023Uncertainty Estimation by Fisher Information-based Evidential Deep Learningcited by 58
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2024DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Drivingcited by 41
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2021CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Imagescited by 29
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detectioncited by 26
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
- 2022Out-of-Distribution Detection for LiDAR-based 3D Object Detectioncited by 17
38 more
- 2025Evaluating Uncertainty and Quality of Vision-Language-Action-enabled Robotscited by 17
- 2021CertainNet: Sampling-free Uncertainty Estimation for Object Detectioncited by 15
- 2022STUN: Self-Teaching Uncertainty Estimation for Place Recognitioncited by 13
- 2022Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecastingcited by 13
- 2019Gaze Training by Modulated Dropout Improves Imitation Learningcited by 10
- 2021Prediction Surface Uncertainty Quantification in Object Detection Models for Autonomous Drivingcited by 10
- 2022Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picturecited by 10
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2022GaIA: Graphical Information Gain based Attention Network for Weakly Supervised Point Cloud Semantic Segmentationcited by 9
- 2024Posterior Uncertainty Quantification in Neural Networks using Data Augmentationcited by 9
- 2020Driving Through Ghosts: Behavioral Cloning with False Positivescited by 8
- 2022Evaluating Object (mis)Detection from a Safety and Reliability Perspective: Discussion and Measurescited by 8
- 2024SURE: SUrvey REcipes for building reliable and robust deep networkscited by 8
- 2022Reducing Overconfidence Predictions for Autonomous Driving Perceptioncited by 7
- 2023LS-VOS: Identifying Outliers in 3D Object Detections Using Latent Space Virtual Outlier Synthesiscited by 7
- 2024Training Bayesian Neural Networks with Sparse Subspace Variational Inferencecited by 7
- 2024Uncertainty-boosted Robust Video Activity Anticipationcited by 7
- 2021Giving Commands to a Self-Driving Car: How to Deal with Uncertain Situations?cited by 6
- 2023Deep Anti-Regularized Ensembles provide reliable out-of-distribution uncertainty quantificationcited by 6
- 2023Uncertainty-Encoded Multi-Modal Fusion for Robust Object Detection in Autonomous Drivingcited by 6
- 2025Uncertainty-Aware Online Extrinsic Calibration: A Conformal Prediction Approachcited by 6
- 2022LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detectioncited by 5
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
- 2022On Attacking Out-Domain Uncertainty Estimation in Deep Neural Networkscited by 4
- 2021Probabilistic Approach for Road-Users Detectioncited by 3
- 2022An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertaintycited by 3
- 2022Key Feature Replacement of In-Distribution Samples for Out-of-Distribution Detectioncited by 3
- 2023Uncertainty-Aware AB3DMOT by Variational 3D Object Detectioncited by 3
- 2023Pedestrian Trajectory Forecasting Using Deep Ensembles Under Sensing Uncertaintycited by 3
- 2023LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Cloudscited by 3
- 2024Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patternscited by 3
- 2021AI perspectives in Smart Cities and Communities to enable road vehicle automation and smart traffic controlcited by 2
- 2021False Positive Detection and Prediction Quality Estimation for LiDAR Point Cloud Segmentationcited by 2
- 2022Uncertainty-Aware Lidar Place Recognition in Novel Environmentscited by 2
- 2022Augmentation by Counterfactual Explanation -- Fixing an Overconfident Classifiercited by 2
- 2023Informative Data Selection with Uncertainty for Multi-modal Object Detectioncited by 2
- 2023Training of Neural Networks with Uncertain Data: A Mixture of Experts Approachcited by 2
- 2021From a Point Cloud to a Simulation Model: Bayesian Segmentation and Entropy based Uncertainty Estimation for 3D Modellingcited by 1
50 most cited of 82 All 82 (JSON)
- 2026UECP: Uncertainty-Enhanced Collaborative Perception22 Jun 2026
- 2026Visualizing Uncertainty: Spatial Maps of Missing and Conflicting Evidence in Deep Learning14 Jun 2026
- 2026SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale11 Jun 2026
- 2026Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification8 Jun 2026
- 2026Variational Inference for Evidential Deep Learning26 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026GroupEnsemble: Efficient Uncertainty Estimation for DETR-based Object Detection2 Mar 2026
- 2026Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification12 Jan 2026
- 2025Walking on the Fiber: A Simple Geometric Approximation for Bayesian Neural Networks1 Dec 2025
- 2025Dynamic Model Selection for Trajectory Prediction via Pairwise Ranking and Meta-Features31 Oct 2025
- 2025Evaluating Uncertainty and Quality of Vision-Language-Action-enabled Robots22 Jul 2025
38 more
- 2025Enhancing Human-Robot Collaboration: A Sim2Real Domain Adaptation Algorithm for Point Cloud Segmentation in Industrial Environments11 Jun 2025
- 2025Bayesian Approximation-Based Trajectory Prediction and Tracking with 4D Radar3 Feb 2025
- 2025Uncertainty-Aware Online Extrinsic Calibration: A Conformal Prediction Approach12 Jan 2025
- 2024Multi-QuAD: Multi-Level Quality-Adaptive Dynamic Network for Reliable Multimodal Classification19 Dec 2024
- 2024U-FaceBP: Uncertainty-aware Bayesian Ensemble Deep Learning for Face Video-based Blood Pressure Estimation14 Dec 2024
- 2024Relationship between Uncertainty in DNNs and Adversarial Attacks20 Sep 2024
- 2024UTrack: Multi-Object Tracking with Uncertain Detections30 Aug 2024
- 2024Assessing the Uncertainty and Robustness of the Laptop Refurbishing Software22 Aug 2024
- 2024SelfReDepth: Self-Supervised Real-Time Depth Restoration for Consumer-Grade Sensors5 Jun 2024
- 2024Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering13 May 2024
- 2024Uncertainty-boosted Robust Video Activity Anticipation29 Apr 2024
- 2024Object criticality for safer navigation25 Apr 2024
- 2024Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patterns11 Apr 2024
- 2024Posterior Uncertainty Quantification in Neural Networks using Data Augmentation18 Mar 2024
- 2024SURE: SUrvey REcipes for building reliable and robust deep networks1 Mar 2024
- 2024Training Bayesian Neural Networks with Sparse Subspace Variational Inference16 Feb 2024
- 2024DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving8 Jan 2024
- 2023Training of Neural Networks with Uncertain Data: A Mixture of Experts Approach13 Dec 2023
- 2023Multimodal Indoor Localization Using Crowdsourced Radio Maps17 Nov 2023
- 2023Uncertainty Quantification using Generative Approach13 Oct 2023
- 2023LS-VOS: Identifying Outliers in 3D Object Detections Using Latent Space Virtual Outlier Synthesis2 Oct 2023
- 2023Single-shot Bayesian approximation for neural networks24 Aug 2023
- 2023Uncertainty-Encoded Multi-Modal Fusion for Robust Object Detection in Autonomous Driving30 Jul 2023
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibration15 Jun 2023
- 2023LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Clouds13 Jun 2023
- 2023Pedestrian Trajectory Forecasting Using Deep Ensembles Under Sensing Uncertainty26 May 2023
- 2023Informative Data Selection with Uncertainty for Multi-modal Object Detection23 Apr 2023
- 2023Deep Anti-Regularized Ensembles provide reliable out-of-distribution uncertainty quantification8 Apr 2023
- 2023ALUM: Adversarial Data Uncertainty Modeling from Latent Model Uncertainty Compensation29 Mar 2023
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embedding17 Mar 2023
- 2023Uncertainty Estimation by Fisher Information-based Evidential Deep Learning3 Mar 2023
- 2023Uncertainty-Aware AB3DMOT by Variational 3D Object Detection12 Feb 2023
- 2023Variational Voxel Pseudo Image Tracking12 Feb 2023
- 2022Key Feature Replacement of In-Distribution Samples for Out-of-Distribution Detection26 Dec 2022
- 2022An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty13 Dec 2022
- 2022Can Transformer Attention Spread Give Insights Into Uncertainty of Detected and Tracked Objects?26 Oct 2022
- 2022Augmentation by Counterfactual Explanation -- Fixing an Overconfident Classifier21 Oct 2022
- 2022Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picture6 Oct 2022
50 newest of 82 All 82 (JSON)
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2023Uncertainty Estimation by Fisher Information-based Evidential Deep Learningcited by 58
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2021CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Imagescited by 29
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detectioncited by 26
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
- 2022Out-of-Distribution Detection for LiDAR-based 3D Object Detectioncited by 17
- 2021CertainNet: Sampling-free Uncertainty Estimation for Object Detectioncited by 15
12 most cited of 77 All 77 (JSON)
- 2026UECP: Uncertainty-Enhanced Collaborative Perception22 Jun 2026
- 2026Visualizing Uncertainty: Spatial Maps of Missing and Conflicting Evidence in Deep Learning14 Jun 2026
- 2026SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale11 Jun 2026
- 2026Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification8 Jun 2026
- 2026Variational Inference for Evidential Deep Learning26 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026GroupEnsemble: Efficient Uncertainty Estimation for DETR-based Object Detection2 Mar 2026
- 2026Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification12 Jan 2026
- 2025Walking on the Fiber: A Simple Geometric Approximation for Bayesian Neural Networks1 Dec 2025
- 2025Dynamic Model Selection for Trajectory Prediction via Pairwise Ranking and Meta-Features31 Oct 2025
- 2025Enhancing Human-Robot Collaboration: A Sim2Real Domain Adaptation Algorithm for Point Cloud Segmentation in Industrial Environments11 Jun 2025
12 newest of 77 All 77 (JSON)