mlsanityData to 14 Oct 2026

Active operator learning with predictive uncertainty quantification for partial differential equations

arXiv 2503.03178 ↗First posted 5 Mar 2025cs.LG math.PRcited by 12

Not on the map. Why?

Abstract (arXiv)

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. We propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework's uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 38 of its 66 references that are in the map. First posted on arXiv 5 Mar 2025.

Builds on

38 of 66 references.

References · 38

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  7. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  8. 2017Deep Bayesian Active Learning with Image Datacited by 819
  9. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  10. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  11. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  12. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
26 more
  1. 2022MIONet: Learning multiple-input operators via tensor productcited by 181
  2. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  3. 2022A Deeper Look into Aleatoric and Epistemic Uncertainty Disentanglementcited by 87
  4. 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
  5. 2022Reliable extrapolation of deep neural operators informed by physics or sparse observationscited by 62
  6. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  7. 2023Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestrationcited by 46
  8. 2024Continuum Attention for Neural Operatorscited by 40
  9. 2022Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priorscited by 39
  10. 2021Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural networkcited by 35
  11. 2024Transformers as Neural Operators for Solutions of Differential Equations with Finite Regularitycited by 34
  12. 2022Discovering and forecasting extreme events via active learning in neural operatorscited by 32
  13. 2022DeepONet-Grid-UQ: A Trustworthy Deep Operator Framework for Predicting the Power Grid's Post-Fault Trajectoriescited by 30
  14. 2022Accelerated Linearized Laplace Approximation for Bayesian Deep Learningcited by 28
  15. 2024Conformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networkscited by 28
  16. 2023PPDONet: Deep Operator Networks for Fast Prediction of Steady-State Solutions in Disk-Planet Systemscited by 19
  17. 2023Variational Linearized Laplace Approximation for Bayesian Deep Learningcited by 18
  18. 2023D2NO: Efficient Handling of Heterogeneous Input Function Spaces with Distributed Deep Neural Operatorscited by 18
  19. 2024MODNO: Multi Operator Learning With Distributed Neural Operatorscited by 14
  20. 2022Model-Parallel Fourier Neural Operators as Learned Surrogates for Large-Scale Parametric PDEscited by 13
  21. 2020Qualitative Analysis of Monte Carlo Dropoutcited by 11
  22. 2023Fourier Neural Operator Surrogate Model to Predict 3D Seismic Waves Propagationcited by 11
  23. 2024Efficient and generalizable nested Fourier-DeepONet for three-dimensional geological carbon sequestrationcited by 11
  24. 2024Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networkscited by 10
  25. 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogatescited by 8
  26. 2024Disk2Planet: A Robust and Automated Machine Learning Tool for Parameter Inference in Disk-Planet Systemscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 7.

12 papers.