Uncertainty quantification for trustworthy deep learning: Methods and measures
Not on the map. Why?
Abstract (arXiv)
The deployment of deep neural networks in safety-critical domains demands reliable estimates of predictive confidence, yet conventional architectures lack principled uncertainty quantification. This survey provides a structured, critical review of methods for Uncertainty Quantification (UQ) in deep learning, scoped to ensemble-based and approximate Bayesian approaches and the measures used to summarize their outputs. Relative to existing UQ surveys, our contribution is depth on efficient ensemble approximations and single-pass methods, and a unified treatment that separates the method producing a predictive distribution from the measure that summarizes its uncertainty. We organize methods into five families: Bayesian neural networks, Monte Carlo Dropout, deep ensembles, efficient ensemble approximations, and last-layer or single-pass approaches. We situate adjacent work on evidential and prior networks, conformal prediction, and post-hoc calibration, together with the decision-time tasks of out-of-distribution detection and selective prediction. For each, we examine theoretical motivation, implementation, empirical performance, and limitations. We then review ensemble diversity theory and uncertainty measures and their decompositions, contrasting the entropy decomposition with pairwise divergence measures, and consolidate evaluation methodology so that our qualitative comparisons share a common basis. We close with a brief treatment of uncertainty in large language models and open research directions, including efficient epistemic measures for classification, last-layer diversity, diversity and calibration under shift, and hybrid architectures.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 133 of its 180 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
133 of 180 references.
References · 133
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
38 more
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2019Conformalized Quantile Regressioncited by 620
- 2017Deep Neural Networks as Gaussian Processescited by 617
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2021Revisiting the Calibration of Modern Neural Networkscited by 387
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
- 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 359
- 2020Calibrating Deep Neural Networks using Focal Losscited by 353
- 2017Snapshot Ensembles: Train 1, get M for freecited by 349
- 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 267
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
- 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 206
- 2018To Trust Or Not To Trust A Classifiercited by 205
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 193
- 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
50 most cited of 133 All 133 (JSON)
Built on by
Not cited yet.