Leveraging Heteroscedastic Aleatoric Uncertainties for Robust Real-Time LiDAR 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
We present a robust real-time LiDAR 3D object detector that leverages heteroscedastic aleatoric uncertainties to significantly improve its detection performance. A multi-loss function is designed to incorporate uncertainty estimations predicted by auxiliary output layers. Using our proposed method, the network ignores to train from noisy samples, and focuses more on informative ones. We validate our method on the KITTI object detection benchmark. Our method surpasses the baseline method which does not explicitly estimate uncertainties by up to nearly 9% in terms of Average Precision (AP). It also produces state-of-the-art results compared to other methods while running with an inference time of only 72 ms. In addition, we conduct extensive experiments to understand how aleatoric uncertainties behave. Extracting aleatoric uncertainties brings almost no additional computation cost during the deployment, making our method highly desirable for autonomous driving applications.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 7; 2024: 1; 2025: 0; 2026: 2.
19 papers.
Sort:
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023Generating Evidential BEV Maps in Continuous Driving Spacecited by 10
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challengescited by 10
- 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertaintycited by 9
- 2023Mutual Information-calibrated Conformal Feature Fusion for Uncertainty-Aware Multimodal 3D Object Detection at the Edgecited by 9
- 2023Reviewing 3D Object Detectors in the Context of High-Resolution 3+1D Radarcited by 8
- 2022Reducing Overconfidence Predictions for Autonomous Driving Perceptioncited by 7
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
- 2021Probabilistic Approach for Road-Users Detectioncited by 3
- 2023LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Cloudscited by 3
7 more
- 2022Uncertainty-Aware Lidar Place Recognition in Novel Environmentscited by 2
- 2023Informative Data Selection with Uncertainty for Multi-modal Object Detectioncited by 2
- 2024CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detectioncited by 2
- 2021Neighborhood Spatial Aggregation MC Dropout for Efficient Uncertainty-aware Semantic Segmentation in Point Cloudscited by 1
- 2021Towards Robust Object Detection: Bayesian RetinaNet for Homoscedastic Aleatoric Uncertainty Modelingcited by 0
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deploymentcited by 0
- 2026Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classificationcited by 0
- 2026Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification8 Jun 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2024CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detection26 Jun 2024
- 2023Mutual Information-calibrated Conformal Feature Fusion for Uncertainty-Aware Multimodal 3D Object Detection at the Edge18 Sep 2023
- 2023Reviewing 3D Object Detectors in the Context of High-Resolution 3+1D Radar10 Aug 2023
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges15 Jun 2023
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibration15 Jun 2023
- 2023LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Clouds13 Jun 2023
- 2023Informative Data Selection with Uncertainty for Multi-modal Object Detection23 Apr 2023
- 2023Generating Evidential BEV Maps in Continuous Driving Space6 Feb 2023
- 2022Uncertainty-Aware Lidar Place Recognition in Novel Environments4 Oct 2022
- 2022Uncertainty Quantification of Collaborative Detection for Self-Driving16 Sep 2022
7 more
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimation6 Jul 2022
- 2022Reducing Overconfidence Predictions for Autonomous Driving Perception16 Feb 2022
- 2021Neighborhood Spatial Aggregation MC Dropout for Efficient Uncertainty-aware Semantic Segmentation in Point Clouds5 Dec 2021
- 2021Probabilistic Approach for Road-Users Detection2 Dec 2021
- 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertainty2 Nov 2021
- 2021Towards Robust Object Detection: Bayesian RetinaNet for Homoscedastic Aleatoric Uncertainty Modeling2 Aug 2021
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectors13 Jan 2021
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023Generating Evidential BEV Maps in Continuous Driving Spacecited by 10
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challengescited by 10
- 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertaintycited by 9
- 2023Mutual Information-calibrated Conformal Feature Fusion for Uncertainty-Aware Multimodal 3D Object Detection at the Edgecited by 9
- 2023Reviewing 3D Object Detectors in the Context of High-Resolution 3+1D Radarcited by 8
- 2022Reducing Overconfidence Predictions for Autonomous Driving Perceptioncited by 7
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
- 2021Probabilistic Approach for Road-Users Detectioncited by 3
- 2023LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Cloudscited by 3
12 most cited of 19 All 19 (JSON)
- 2026Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification8 Jun 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2024CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detection26 Jun 2024
- 2023Mutual Information-calibrated Conformal Feature Fusion for Uncertainty-Aware Multimodal 3D Object Detection at the Edge18 Sep 2023
- 2023Reviewing 3D Object Detectors in the Context of High-Resolution 3+1D Radar10 Aug 2023
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges15 Jun 2023
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibration15 Jun 2023
- 2023LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Clouds13 Jun 2023
- 2023Informative Data Selection with Uncertainty for Multi-modal Object Detection23 Apr 2023
- 2023Generating Evidential BEV Maps in Continuous Driving Space6 Feb 2023
- 2022Uncertainty-Aware Lidar Place Recognition in Novel Environments4 Oct 2022
- 2022Uncertainty Quantification of Collaborative Detection for Self-Driving16 Sep 2022
12 newest of 19 All 19 (JSON)