mlsanityData to 7 Oct 2026

Uncertainty quantification for trustworthy deep learning: Methods and measures

arXiv 2607.28248 ↗First posted 30 Jul 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The deployment of deep neural networks in safety-critical domains demands reliable estimates of predictive confidence, yet conventional architectures lack principled uncertainty quantification. This survey provides a structured, critical review of methods for Uncertainty Quantification (UQ) in deep learning, scoped to ensemble-based and approximate Bayesian approaches and the measures used to summarize their outputs. Relative to existing UQ surveys, our contribution is depth on efficient ensemble approximations and single-pass methods, and a unified treatment that separates the method producing a predictive distribution from the measure that summarizes its uncertainty. We organize methods into five families: Bayesian neural networks, Monte Carlo Dropout, deep ensembles, efficient ensemble approximations, and last-layer or single-pass approaches. We situate adjacent work on evidential and prior networks, conformal prediction, and post-hoc calibration, together with the decision-time tasks of out-of-distribution detection and selective prediction. For each, we examine theoretical motivation, implementation, empirical performance, and limitations. We then review ensemble diversity theory and uncertainty measures and their decompositions, contrasting the entropy decomposition with pairwise divergence measures, and consolidate evaluation methodology so that our qualitative comparisons share a common basis. We close with a brief treatment of uncertainty in large language models and open research directions, including efficient epistemic measures for classification, last-layer diversity, diversity and calibration under shift, and hybrid architectures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 133 of its 180 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

133 of 180 references.

References · 133

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  4. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  6. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  7. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  8. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  9. 2016Variational Inference: A Review for Statisticianscited by 1,466
  10. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  11. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  12. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
38 more
  1. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
  2. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
  3. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
  4. 2017Deep Bayesian Active Learning with Image Datacited by 812
  5. 2017Selective Classification for Deep Neural Networkscited by 799
  6. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  7. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
  8. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  9. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
  10. 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
  11. 2019Conformalized Quantile Regressioncited by 620
  12. 2017Deep Neural Networks as Gaussian Processescited by 617
  13. 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
  14. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
  15. 2015Weight Uncertainty in Neural Networkscited by 554
  16. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
  17. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
  18. 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
  19. 2021Revisiting the Calibration of Modern Neural Networkscited by 387
  20. 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
  21. 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 359
  22. 2020Calibrating Deep Neural Networks using Focal Losscited by 353
  23. 2017Snapshot Ensembles: Train 1, get M for freecited by 349
  24. 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
  25. 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
  26. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  27. 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
  28. 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 267
  29. 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
  30. 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
  31. 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
  32. 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
  33. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 206
  34. 2018To Trust Or Not To Trust A Classifiercited by 205
  35. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  36. 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 193
  37. 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
  38. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182

50 most cited of 133 All 133 (JSON)

Built on by

Not cited yet.