Can We Trust You? On Calibration of a Probabilistic Object Detector for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Reliable uncertainty estimation is crucial for perception systems in safe autonomous driving. Recently, many methods have been proposed to model uncertainties in deep learning based object detectors. However, the estimated probabilities are often uncalibrated, which may lead to severe problems in safety critical scenarios. In this work, we identify such uncertainty miscalibration problems in a probabilistic LiDAR 3D object detection network, and propose three practical methods to significantly reduce errors in uncertainty calibration. Extensive experiments on several datasets show that our methods produce well-calibrated uncertainties, and generalize well between different datasets.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 5; 2024: 5; 2025: 3; 2026: 7.
30 papers.
Sort:
By area:
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detectioncited by 26
- 2023A Benchmark Study on Calibrationcited by 10
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2021From Black-box to White-box: Examining Confidence Calibration under different Conditionscited by 8
- 2022Parametric and Multivariate Uncertainty Calibration for Regression and Object Detectioncited by 8
- 2024Feature Clipping for Uncertainty Calibrationcited by 8
- 2021Bayesian Confidence Calibration for Epistemic Uncertainty Modellingcited by 5
- 2022LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detectioncited by 5
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
- 2021f-Cal: Calibrated aleatoric uncertainty estimation from neural networks for robot perceptioncited by 3
18 more
- 2022Calibrating Perception Uncertainty for Autonomous Drivingcited by 3
- 2024Towards Calibrated Deep Clustering Networkcited by 3
- 2024Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patternscited by 3
- 2024Consistency Calibration: Improving Uncertainty Calibration via Consistency among Perturbed Neighborscited by 3
- 2025Sample Margin-Aware Recalibration of Temperature Scalingcited by 3
- 2026Scalable Variational Bayesian Fine-Tuning of LLMs via Orthogonalized Low-Rank Adapterscited by 2
- 2026Low-Rank Adaptation Redux for Large Modelscited by 2
- 2023Perception and Semantic Aware Regularization for Sequential Confidence Calibrationcited by 1
- 2023A Synthetic Benchmarking Pipeline to Compare Camera Calibration Algorithmscited by 1
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomycited by 1
- 2026Self-Aware Object Detection via Degradation Manifoldscited by 1
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shiftcited by 1
- 2023Probabilistic 3d regression with projected huber distributioncited by 0
- 2024Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filteringcited by 0
- 2025Calibrating the Full Predictive Class Distribution of 3D Object Detectors for Autonomous Drivingcited by 0
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deploymentcited by 0
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreementcited by 0
- 2026Instance-Level Post Hoc Uncertainty Quantification in Object Detectioncited by 0
- 2026Instance-Level Post Hoc Uncertainty Quantification in Object Detection3 Jun 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026Low-Rank Adaptation Redux for Large Models23 Apr 2026
- 2026Scalable Variational Bayesian Fine-Tuning of LLMs via Orthogonalized Low-Rank Adapters3 Apr 2026
- 2026Self-Aware Object Detection via Degradation Manifolds20 Feb 2026
- 2025Calibrating the Full Predictive Class Distribution of 3D Object Detectors for Autonomous Driving2 Oct 2025
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy12 Aug 2025
- 2025Sample Margin-Aware Recalibration of Temperature Scaling30 Jun 2025
- 2024Feature Clipping for Uncertainty Calibration16 Oct 2024
- 2024Consistency Calibration: Improving Uncertainty Calibration via Consistency among Perturbed Neighbors16 Oct 2024
18 more
- 2024Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering13 May 2024
- 2024Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patterns11 Apr 2024
- 2024Towards Calibrated Deep Clustering Network4 Mar 2024
- 2023A Benchmark Study on Calibration23 Aug 2023
- 2023A Synthetic Benchmarking Pipeline to Compare Camera Calibration Algorithms3 Jul 2023
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibration15 Jun 2023
- 2023Perception and Semantic Aware Regularization for Sequential Confidence Calibration31 May 2023
- 2023Probabilistic 3d regression with projected huber distribution9 Mar 2023
- 2022Calibrating Perception Uncertainty for Autonomous Driving8 Nov 2022
- 2022Parametric and Multivariate Uncertainty Calibration for Regression and Object Detection4 Jul 2022
- 2022LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection1 Jun 2022
- 2021f-Cal: Calibrated aleatoric uncertainty estimation from neural networks for robot perception28 Sep 2021
- 2021Bayesian Confidence Calibration for Epistemic Uncertainty Modelling21 Sep 2021
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review26 Jul 2021
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detection3 Apr 2021
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Driving16 Feb 2021
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectors13 Jan 2021
- 2021From Black-box to White-box: Examining Confidence Calibration under different Conditions8 Jan 2021
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021Uncertainty for Identifying Open-Set Errors in Visual Object Detectioncited by 26
- 2023A Benchmark Study on Calibrationcited by 10
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2021From Black-box to White-box: Examining Confidence Calibration under different Conditionscited by 8
- 2022Parametric and Multivariate Uncertainty Calibration for Regression and Object Detectioncited by 8
- 2024Feature Clipping for Uncertainty Calibrationcited by 8
- 2021Bayesian Confidence Calibration for Epistemic Uncertainty Modellingcited by 5
- 2022LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detectioncited by 5
- 2023Overcoming the Limitations of Localization Uncertainty: Efficient & Exact Non-Linear Post-Processing and Calibrationcited by 5
- 2021f-Cal: Calibrated aleatoric uncertainty estimation from neural networks for robot perceptioncited by 3
12 most cited of 28 All 28 (JSON)
- 2026Instance-Level Post Hoc Uncertainty Quantification in Object Detection3 Jun 2026
- 2026Calibrating Probabilistic Object Detectors with Annotator Disagreement23 May 2026
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2026Query2Uncertainty: Robust Uncertainty Quantification and Calibration for 3D Object Detection under Distribution Shift6 May 2026
- 2026Low-Rank Adaptation Redux for Large Models23 Apr 2026
- 2026Scalable Variational Bayesian Fine-Tuning of LLMs via Orthogonalized Low-Rank Adapters3 Apr 2026
- 2026Self-Aware Object Detection via Degradation Manifolds20 Feb 2026
- 2025Calibrating the Full Predictive Class Distribution of 3D Object Detectors for Autonomous Driving2 Oct 2025
- 2025Sample Margin-Aware Recalibration of Temperature Scaling30 Jun 2025
- 2024Feature Clipping for Uncertainty Calibration16 Oct 2024
- 2024Consistency Calibration: Improving Uncertainty Calibration via Consistency among Perturbed Neighbors16 Oct 2024
- 2024Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering13 May 2024
12 newest of 28 All 28 (JSON)