Evaluating Uncertainty Quantification in End-to-End Autonomous Driving Control
Not on the map. Why?
Abstract (arXiv)
A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from significant performance improvements, with millions of miles having been driven with no human intervention. Despite this, crashes and erroneous behaviours still occur, in part due to the complexity of verifying the correctness of DNNs and a lack of safety guarantees. In this paper, we demonstrate how quantitative measures of uncertainty can be extracted in real-time, and their quality evaluated in end-to-end controllers for self-driving cars. To this end we utilise a recent method for gathering approximate uncertainty information from DNNs without changing the network's architecture. We propose evaluation techniques for the uncertainty on two separate architectures which use the uncertainty to predict crashes up to five seconds in advance. We find that mutual information, a measure of uncertainty in classification networks, is a promising indicator of forthcoming crashes.
Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 7; 2023: 13; 2024: 6; 2025: 6; 2026: 5.
55 papers.
Sort:
By area:
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?cited by 125
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 101
- 2021Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classificationcited by 39
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 39
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021Efficient and Robust LiDAR-Based End-to-End Navigationcited by 22
- 2024Label-wise Aleatoric and Epistemic Uncertainty Quantificationcited by 22
- 2021Dynamic Bottleneck for Robust Self-Supervised Explorationcited by 21
- 2023Second-Order Uncertainty Quantification: Variance-Based Measurescited by 19
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Drivingcited by 17
38 more
- 2025Challenger: Affordable Adversarial Driving Video Generationcited by 16
- 2022Modular Conformal Calibrationcited by 15
- 2021Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoringcited by 11
- 2024Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantificationcited by 11
- 2021Understanding the Under-Coverage Bias in Uncertainty Estimationcited by 10
- 2021Prediction Surface Uncertainty Quantification in Object Detection Models for Autonomous Drivingcited by 10
- 2021RoMA: a Method for Neural Network Robustness Measurement and Assessmentcited by 10
- 2021Quantifying Epistemic Uncertainty in Deep Learningcited by 10
- 2023Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural Networkscited by 10
- 2023SMARLA: A Safety Monitoring Approach for Deep Reinforcement Learning Agentscited by 10
- 2021A Quantitative Comparison of Epistemic Uncertainty Maps Applied to Multi-Class Segmentationcited by 9
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlookscited by 9
- 2025An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regressioncited by 9
- 2021Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Drivingcited by 8
- 2021What classifiers know what they don't?cited by 6
- 2023Flexible Visual Recognition by Evidential Modeling of Confusion and Ignorancecited by 6
- 2024Probabilistic Calibration by Design for Neural Network Regressioncited by 6
- 2025Graph Evidential Learning for Anomaly Detectioncited by 5
- 2021Robust Vision-Based Cheat Detection in Competitive Gamingcited by 4
- 2023Deep Gaussian Mixture Ensemblescited by 4
- 2022Uncertainty Quantification for Deep Neural Networks: An Empirical Comparison and Usage Guidelinescited by 3
- 2023AUGCAL: Improving Sim2Real Adaptation by Uncertainty Calibration on Augmented Synthetic Imagescited by 3
- 2024The Misclassification Likelihood Matrix: Some Classes Are More Likely To Be Misclassified Than Otherscited by 3
- 2021Marginally calibrated response distributions for end-to-end learning in autonomous drivingcited by 2
- 2022Nonlinear MCMC for Bayesian Machine Learningcited by 2
- 2022A view on model misspecification in uncertainty quantificationcited by 2
- 2022Deep Variational Inverse Scatteringcited by 2
- 2023Confidence Calibration for Systems with Cascaded Predictive Modulescited by 2
- 2024When to Accept Automated Predictions and When to Defer to Human Judgment?cited by 2
- 2025Explorations of the Softmax Space: Knowing When the Neural Network Doesn't Knowcited by 2
- 2025Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scalingcited by 2
- 2025Uncertainty Quantification for Regression: A Unified Framework based on kernel scorescited by 2
- 2026The Origins of Stochasticity: Comprehensive Investigations on Uncertainty Quantification for Large Language Modelscited by 2
- 2021A Complete Characterisation of ReLU-Invariant Distributionscited by 1
- 2023Towards Dependable Autonomous Systems Based on Bayesian Deep Learning Componentscited by 1
- 2023Towards Quantification of Assurance for Learning-enabled Componentscited by 1
- 2023Uncertainty-aware deep learning for digital twin-driven monitoring: Application to fault detection in power linescited by 1
- 2023Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networkscited by 0
50 most cited of 55 All 55 (JSON)
- 2026Does Model Uncertainty Track Human Ambiguity? Evidence from Multi-Annotator Vision Benchmarks28 Sep 2026
- 2026Confidence-Gated Vision-Only Heading Alignment for UAV-UGV Cooperative Systems21 Jul 2026
- 2026The Origins of Stochasticity: Comprehensive Investigations on Uncertainty Quantification for Large Language Models22 Jun 2026
- 2026Complex-Valued Unitary Representations as Classification Heads for Improved Uncertainty Quantification in Deep Neural Networks17 Feb 2026
- 2026Semantic Misalignment in Vision-Language Models under Perceptual Degradation13 Jan 2026
- 2025Uncertainty Quantification for Regression: A Unified Framework based on kernel scores29 Oct 2025
- 2025Graph Evidential Learning for Anomaly Detection31 May 2025
- 2025Challenger: Affordable Adversarial Driving Video Generation21 May 2025
- 2025An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression25 Apr 2025
- 2025Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling21 Feb 2025
- 2025Explorations of the Softmax Space: Knowing When the Neural Network Doesn't Know1 Feb 2025
- 2024When to Accept Automated Predictions and When to Defer to Human Judgment?10 Jul 2024
38 more
- 2024The Misclassification Likelihood Matrix: Some Classes Are More Likely To Be Misclassified Than Others10 Jul 2024
- 2024Label-wise Aleatoric and Epistemic Uncertainty Quantification4 Jun 2024
- 2024Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification29 Apr 2024
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlooks10 Apr 2024
- 2024Probabilistic Calibration by Design for Neural Network Regression18 Mar 2024
- 2023Second-Order Uncertainty Quantification: Variance-Based Measures30 Dec 2023
- 2023AUGCAL: Improving Sim2Real Adaptation by Uncertainty Calibration on Augmented Synthetic Images11 Dec 2023
- 2023Confidence Calibration for Systems with Cascaded Predictive Modules21 Sep 2023
- 2023Flexible Visual Recognition by Evidential Modeling of Confusion and Ignorance14 Sep 2023
- 2023Single-shot Bayesian approximation for neural networks24 Aug 2023
- 2023SMARLA: A Safety Monitoring Approach for Deep Reinforcement Learning Agents3 Aug 2023
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun 2023
- 2023Deep Gaussian Mixture Ensembles12 Jun 2023
- 2023Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural Networks9 Jun 2023
- 2023Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks5 Apr 2023
- 2023Uncertainty-aware deep learning for digital twin-driven monitoring: Application to fault detection in power lines20 Mar 2023
- 2023Towards Quantification of Assurance for Learning-enabled Components21 Jan 2023
- 2023Towards Dependable Autonomous Systems Based on Bayesian Deep Learning Components12 Jan 2023
- 2022Uncertainty Quantification for Deep Neural Networks: An Empirical Comparison and Usage Guidelines14 Dec 2022
- 2022Deep Variational Inverse Scattering8 Dec 2022
- 2022A view on model misspecification in uncertainty quantification30 Oct 2022
- 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?7 Sep 2022
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks14 Jul 2022
- 2022Modular Conformal Calibration23 Jun 2022
- 2022Nonlinear MCMC for Bayesian Machine Learning11 Feb 2022
- 2021A Complete Characterisation of ReLU-Invariant Distributions13 Dec 2021
- 2021Quantifying Epistemic Uncertainty in Deep Learning23 Oct 2021
- 2021RoMA: a Method for Neural Network Robustness Measurement and Assessment21 Oct 2021
- 2021Dynamic Bottleneck for Robust Self-Supervised Exploration20 Oct 2021
- 2021Marginally calibrated response distributions for end-to-end learning in autonomous driving3 Oct 2021
- 2021A Quantitative Comparison of Epistemic Uncertainty Maps Applied to Multi-Class Segmentation22 Sep 2021
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review26 Jul 2021
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks15 Jul 2021
- 2021What classifiers know what they don't?13 Jul 2021
- 2021Prediction Surface Uncertainty Quantification in Object Detection Models for Autonomous Driving11 Jul 2021
- 2021Understanding the Under-Coverage Bias in Uncertainty Estimation10 Jun 2021
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning4 Jun 2021
- 2021Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Driving28 May 2021
50 newest of 55 All 55 (JSON)
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Drivingcited by 17
- 2025Challenger: Affordable Adversarial Driving Video Generationcited by 16
- 2021Marginally calibrated response distributions for end-to-end learning in autonomous drivingcited by 2
- 2025Challenger: Affordable Adversarial Driving Video Generation21 May 2025
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun 2023
- 2021Marginally calibrated response distributions for end-to-end learning in autonomous driving3 Oct 2021
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Driving21 May 2021
- 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?cited by 125
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 101
- 2021Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classificationcited by 39
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 39
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021Efficient and Robust LiDAR-Based End-to-End Navigationcited by 22
- 2024Label-wise Aleatoric and Epistemic Uncertainty Quantificationcited by 22
- 2021Dynamic Bottleneck for Robust Self-Supervised Explorationcited by 21
- 2023Second-Order Uncertainty Quantification: Variance-Based Measurescited by 19
- 2022Modular Conformal Calibrationcited by 15
- 2021Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoringcited by 11
12 most cited of 48 All 48 (JSON)
- 2026Confidence-Gated Vision-Only Heading Alignment for UAV-UGV Cooperative Systems21 Jul 2026
- 2026Complex-Valued Unitary Representations as Classification Heads for Improved Uncertainty Quantification in Deep Neural Networks17 Feb 2026
- 2025Uncertainty Quantification for Regression: A Unified Framework based on kernel scores29 Oct 2025
- 2025Graph Evidential Learning for Anomaly Detection31 May 2025
- 2025An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression25 Apr 2025
- 2025Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling21 Feb 2025
- 2025Explorations of the Softmax Space: Knowing When the Neural Network Doesn't Know1 Feb 2025
- 2024When to Accept Automated Predictions and When to Defer to Human Judgment?10 Jul 2024
- 2024The Misclassification Likelihood Matrix: Some Classes Are More Likely To Be Misclassified Than Others10 Jul 2024
- 2024Label-wise Aleatoric and Epistemic Uncertainty Quantification4 Jun 2024
- 2024Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification29 Apr 2024
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlooks10 Apr 2024
12 newest of 48 All 48 (JSON)