Interpretable Uncertainty Quantification in AI for HEP
Not on the map. Why?
Abstract (arXiv)
Estimating uncertainty is at the core of performing scientific measurements in HEP: a measurement is not useful without an estimate of its uncertainty. The goal of uncertainty quantification (UQ) is inextricably linked to the question, "how do we physically and statistically interpret these uncertainties?" The answer to this question depends not only on the computational task we aim to undertake, but also on the methods we use for that task. For artificial intelligence (AI) applications in HEP, there are several areas where interpretable methods for UQ are essential, including inference, simulation, and control/decision-making. There exist some methods for each of these areas, but they have not yet been demonstrated to be as trustworthy as more traditional approaches currently employed in physics (e.g., non-AI frequentist and Bayesian methods). Shedding light on the questions above requires additional understanding of the interplay of AI systems and uncertainty quantification. We briefly discuss the existing methods in each area and relate them to tasks across HEP. We then discuss recommendations for avenues to pursue to develop the necessary techniques for reliable widespread usage of AI with UQ over the next decade.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 28 of its 64 references that are in the map. First posted on arXiv 5 Aug 2022.
Builds on
28 of 64 references.
References · 28
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2016Distribution-Free Predictive Inference For Regressioncited by 657
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
16 more
- 2019The frontier of simulation-based inferencecited by 490
- 2019Measuring Calibration in Deep Learningcited by 443
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2018Mining gold from implicit models to improve likelihood-free inferencecited by 60
- 2016Learning to Pivot with Adversarial Networkscited by 55
- 2017Adversarial Examples, Uncertainty, and Transfer Testing Robustness in Gaussian Process Hybrid Deep Networkscited by 48
- 2018Variational Autoencoders for New Physics Mining at the Large Hadron Collidercited by 40
- 2021AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantificationcited by 31
- 2021Diagnostics for Conditional Density Models and Bayesian Inference Algorithmscited by 26
- 2021Local Calibration: Metrics and Recalibrationcited by 23
- 2020Testing Goodness of Fit of Conditional Density Models with Kernelscited by 19
- 2020Empirical Frequentist Coverage of Deep Learning Uncertainty Quantification Procedurescited by 19
- 2021A Cautionary Tale of Decorrelating Theory Uncertaintiescited by 11
- 2020Adversarial domain adaptation to reduce sample bias of a high energy physics classifiercited by 9
- 201410 Simple Rules for the Care and Feeding of Scientific Datacited by 3
- 2021Re-calibrating Photometric Redshift Probability Distributions Using Feature-space Regressioncited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 3; 2025: 2; 2026: 1.
8 papers.
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learningcited by 10
- 2024Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationshipscited by 7
- 2023Feature Learning and Generalization in Deep Networks with Orthogonal Weightscited by 5
- 2024Calibrating Bayesian Generative Machine Learning for Bayesiamplificationcited by 5
- 2026Uncertainty in Physics and AI: Taxonomy, Quantification, and Validationcited by 3
- 2024FAIR Universe HiggsML Uncertainty Dataset and Competitioncited by 2
- 2025Stable and Interpretable Jet Physics with IRC-Safe Equivariant Feature Extractioncited by 2
- 2025Uncertainty Quantification From Scaling Laws in Deep Neural Networkscited by 0
- 2026Uncertainty in Physics and AI: Taxonomy, Quantification, and Validation11 May 2026
- 2025Stable and Interpretable Jet Physics with IRC-Safe Equivariant Feature Extraction26 Sep 2025
- 2025Uncertainty Quantification From Scaling Laws in Deep Neural Networks7 Mar 2025
- 2024FAIR Universe HiggsML Uncertainty Dataset and Competition3 Oct 2024
- 2024Calibrating Bayesian Generative Machine Learning for Bayesiamplification1 Aug 2024
- 2024Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships17 Jul 2024
- 2023Feature Learning and Generalization in Deep Networks with Orthogonal Weights11 Oct 2023
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learning15 Sep 2022