Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forces
Not on the map. Why?
Abstract (arXiv)
Inexpensive machine learning potentials are increasingly being used to speed up structural optimization and molecular dynamics simulations of materials by iteratively predicting and applying interatomic forces. In these settings, it is crucial to detect when predictions are unreliable to avoid wrong or misleading results. Here, we present a complete framework for training and recalibrating graph neural network ensemble models to produce accurate predictions of energy and forces with calibrated uncertainty estimates. The proposed method considers both epistemic and aleatoric uncertainty and the total uncertainties are recalibrated post hoc using a nonlinear scaling function to achieve good calibration on previously unseen data, without loss of predictive accuracy. The method is demonstrated and evaluated on two challenging, publicly available datasets, ANI-1x (Smith et al.) and Transition1x (Schreiner et al.), both containing diverse conformations far from equilibrium. A detailed analysis of the predictive performance and uncertainty calibration is provided. In all experiments, the proposed method achieved low prediction error and good uncertainty calibration, with predicted uncertainty correlating with expected error, on energy and forces. To the best of our knowledge, the method presented in this paper is the first to consider a complete framework for obtaining calibrated epistemic and aleatoric uncertainty predictions on both energy and forces in ML potentials.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 10 May 2023.
Builds on
10 of 21 references.
References · 10
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2017Snapshot Ensembles: Train 1, get M for freecited by 350
- 2019Evaluating and Calibrating Uncertainty Prediction in Regression Taskscited by 87
- 2018Less is more: sampling chemical space with active learningcited by 82
- 2020Uncertainty Quantification Using Neural Networks for Molecular Property Predictioncited by 66
- 2022Transition1x -- a Dataset for Building Generalizable Reactive Machine Learning Potentialscited by 37
- 2021Deep Ensembles from a Bayesian Perspectivecited by 27
- 2020Committee neural network potentials control generalization errors and enable active learningcited by 15
- 2021Assigning Confidence to Molecular Property Predictioncited by 14
- 2023Validation of uncertainty quantification metrics: a primer based on the consistency and adaptivity conceptscited by 5
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 1; 2026: 3.
10 papers.
- 2023Calibration in Machine Learning Uncertainty Quantification: beyond consistency to target adaptivitycited by 13
- 2026MADE: Benchmark Environments for Closed-Loop Materials Discoverycited by 7
- 2023Stratification of uncertainties recalibrated by isotonic regression and its impact on calibration error statisticscited by 6
- 2026Random-Set Graph Neural Networkscited by 3
- 2025Credal Graph Neural Networkscited by 2
- 2024Negative impact of heavy-tailed uncertainty and error distributions on the reliability of calibration statistics for machine learning regression taskscited by 1
- 2024Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentialscited by 1
- 2023Coherent energy and force uncertainty in deep learning force fieldscited by 0
- 2024Validation of ML-UQ calibration statistics using simulated reference values: a sensitivity analysiscited by 0
- 2026Online Surrogate Repair: Decoupling High-Fidelity Feedback from Search Length in Closed-Loop Discoverycited by 0
- 2026Online Surrogate Repair: Decoupling High-Fidelity Feedback from Search Length in Closed-Loop Discovery7 Sep 2026
- 2026Random-Set Graph Neural Networks12 May 2026
- 2026MADE: Benchmark Environments for Closed-Loop Materials Discovery28 Jan 2026
- 2025Credal Graph Neural Networks2 Dec 2025
- 2024Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentials27 Oct 2024
- 2024Validation of ML-UQ calibration statistics using simulated reference values: a sensitivity analysis1 Mar 2024
- 2024Negative impact of heavy-tailed uncertainty and error distributions on the reliability of calibration statistics for machine learning regression tasks15 Feb 2024
- 2023Coherent energy and force uncertainty in deep learning force fields7 Dec 2023
- 2023Calibration in Machine Learning Uncertainty Quantification: beyond consistency to target adaptivity12 Sep 2023
- 2023Stratification of uncertainties recalibrated by isotonic regression and its impact on calibration error statistics8 Jun 2023