Uncertainty Quantification of Surrogate Models using Conformal Prediction
Not on the map. Why?
Abstract (arXiv)
Data-driven surrogate models offer quick approximations to complex numerical and experimental systems but typically lack uncertainty quantification, limiting their reliability in safety-critical applications. While Bayesian methods provide uncertainty estimates, they offer no statistical guarantees and struggle with high-dimensional spatio-temporal problems due to computational costs. We present a conformal prediction (CP) framework that provides statistically guaranteed marginal coverage for surrogate models in a model-agnostic manner with near-zero computational cost. Our approach handles high-dimensional spatio-temporal outputs by performing cell-wise calibration while preserving the tensorial structure of predictions. Through extensive empirical evaluation across diverse applications including fluid dynamics, magnetohydrodynamics, weather forecasting, and fusion diagnostics, we demonstrate that CP achieves empirical coverage with valid error bars regardless of model architecture, training regime, or output dimensionality. We evaluate three nonconformity scores (conformalised quantile regression, absolute error residual, and standard deviation) for both deterministic and probabilistic models, showing that guaranteed coverage holds even for out-of-distribution predictions where models are deployed on physics regimes different from training data. Calibration requires only seconds to minutes on standard hardware. The framework enables rigorous validation of pre-trained surrogate models for downstream applications without retraining. While CP provides marginal rather than conditional coverage and assumes exchangeability between calibration and test data, our method circumvents the curse of dimensionality inherent in traditional uncertainty quantification approaches, offering a practical tool for trustworthy deployment of machine learning in physical sciences.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 33 of its 83 references that are in the map. First posted on arXiv 19 Aug 2024.
Builds on
33 of 83 references.
References · 33
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2016Distribution-Free Predictive Inference For Regressioncited by 657
- 2019Conformalized Quantile Regressioncited by 620
- 2019Conformal Prediction Under Covariate Shiftcited by 511
- 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 360
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
21 more
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
- 2022Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisonscited by 169
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
- 2020MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Frameworkcited by 78
- 2021Simulation Intelligence: Towards a New Generation of Scientific Methodscited by 68
- 2021Copula-based conformal prediction for Multi-Target Regressioncited by 53
- 2022Real-time high-resolution CO2 geological storage prediction using nested Fourier neural operatorscited by 47
- 2016Parameterized Machine Learning for High-Energy Physicscited by 33
- 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 31
- 2023Plasma Surrogate Modelling using Fourier Neural Operatorscited by 29
- 2021Conformal Prediction Bands for Multivariate Functional Datacited by 28
- 2024Calibrated Uncertainty Quantification for Operator Learning via Conformal Predictioncited by 25
- 2022Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Surveycited by 11
- 2023Solving multiphysics-based inverse problems with learned surrogates and constraintscited by 9
- 2016Accelerating the BSM interpretation of LHC data with machine learningcited by 5
- 2016False confidence, non-additive beliefs, and valid statistical inferencecited by 3
- 2021Fast Regression of the Tritium Breeding Ratio in Fusion Reactorscited by 3
Built on by
Citing papers per year: 2025: 8; 2026: 3.
11 papers.
- 2025Calibrated Physics-Informed Uncertainty Quantificationcited by 8
- 2025Guaranteed prediction sets for functional surrogate modelscited by 7
- 2025A Conformal Prediction Framework for Uncertainty Quantification in Physics-Informed Neural Networkscited by 5
- 2025ConfEviSurrogate: A Conformalized Evidential Surrogate Model for Uncertainty Quantificationcited by 1
- 2025Closed-Loop Neural Operator-Based Observer of Traffic Densitycited by 0
- 2025Control of dynamical systems with neural networkscited by 0
- 2025Conformalized Polynomial Chaos Expansion for Uncertainty-aware Surrogate Modelingcited by 0
- 2025Multi-fidelity aerodynamic data fusion by autoencoder transfer learningcited by 0
- 2026Reliability of Probabilistic Emulation of Physical Systemscited by 0
- 2026Structure-preserving uncertainty quantification for GENERIC dynamicscited by 0
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operatorscited by 0
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operators28 Aug 2026
- 2026Structure-preserving uncertainty quantification for GENERIC dynamics12 Aug 2026
- 2026Reliability of Probabilistic Emulation of Physical Systems11 Jun 2026
- 2025Multi-fidelity aerodynamic data fusion by autoencoder transfer learning15 Dec 2025
- 2025Conformalized Polynomial Chaos Expansion for Uncertainty-aware Surrogate Modeling25 Oct 2025
- 2025Control of dynamical systems with neural networks6 Oct 2025
- 2025A Conformal Prediction Framework for Uncertainty Quantification in Physics-Informed Neural Networks17 Sep 2025
- 2025Closed-Loop Neural Operator-Based Observer of Traffic Density7 Apr 2025
- 2025ConfEviSurrogate: A Conformalized Evidential Surrogate Model for Uncertainty Quantification3 Apr 2025
- 2025Calibrated Physics-Informed Uncertainty Quantification6 Feb 2025
- 2025Guaranteed prediction sets for functional surrogate models30 Jan 2025