mlsanityData to 14 Oct 2026

Uncertainty quantification for deeponets with ensemble kalman inversion

arXiv 2403.03444 ↗First posted 6 Mar 2024cs.LG cs.AI cs.NAcited by 4

Not on the map. Why?

Abstract (arXiv)

In recent years, operator learning, particularly the DeepONet, has received much attention for efficiently learning complex mappings between input and output functions across diverse fields. However, in practical scenarios with limited and noisy data, accessing the uncertainty in DeepONet predictions becomes essential, especially in mission-critical or safety-critical applications. Existing methods, either computationally intensive or yielding unsatisfactory uncertainty quantification, leave room for developing efficient and informative uncertainty quantification (UQ) techniques tailored for DeepONets. In this work, we proposed a novel inference approach for efficient UQ for operator learning by harnessing the power of the Ensemble Kalman Inversion (EKI) approach. EKI, known for its derivative-free, noise-robust, and highly parallelizable feature, has demonstrated its advantages for UQ for physics-informed neural networks [28]. Our innovative application of EKI enables us to efficiently train ensembles of DeepONets while obtaining informative uncertainty estimates for the output of interest. We deploy a mini-batch variant of EKI to accommodate larger datasets, mitigating the computational demand due to large datasets during the training stage. Furthermore, we introduce a heuristic method to estimate the artificial dynamics covariance, thereby improving our uncertainty estimates. Finally, we demonstrate the effectiveness and versatility of our proposed methodology across various benchmark problems, showcasing its potential to address the pressing challenges of uncertainty quantification in DeepONets, especially for practical applications with limited and noisy data.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 6 Mar 2024.

Builds on

14 of 34 references.

References · 14

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  4. 2016Variational Inference: A Review for Statisticianscited by 1,472
  5. 2023LNO: Laplace Neural Operator for Solving Differential Equationscited by 47
  6. 2022Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priorscited by 39
  7. 2018Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Taskscited by 37
  8. 2022DeepONet-Grid-UQ: A Trustworthy Deep Operator Framework for Predicting the Power Grid's Post-Fault Trajectoriescited by 30
  9. 2023Uncertainty quantification for noisy inputs-outputs in physics-informed neural networks and neural operatorscited by 28
  10. 2021Accelerated replica exchange stochastic gradient Langevin diffusion enhanced Bayesian DeepONet for solving noisy parametric PDEscited by 22
  11. 2023IB-UQ: Information bottleneck based uncertainty quantification for neural function regression and neural operator learningcited by 18
  12. 2015A regularizing iterative ensemble Kalman method for PDE-constrained inverse problemscited by 14
2 more
  1. 2017Ensemble Kalman methods for high-dimensional hierarchical dynamic space-time modelscited by 10
  2. 2022Non-Asymptotic Analysis of Ensemble Kalman Updates: Effective Dimension and Localizationcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.