Linearization Turns Neural Operators into Function-Valued Gaussian Processes
Not on the map. Why?
Abstract (arXiv)
Neural operators generalize neural networks to learn mappings between function spaces from data. They are commonly used to learn solution operators of parametric partial differential equations (PDEs) or propagators of time-dependent PDEs. However, to make them useful in high-stakes simulation scenarios, their inherent predictive error must be quantified reliably. We introduce LUNO, a novel framework for approximate Bayesian uncertainty quantification in trained neural operators. Our approach leverages model linearization to push (Gaussian) weight-space uncertainty forward to the neural operator's predictions. We show that this can be interpreted as a probabilistic version of the concept of currying from functional programming, yielding a function-valued (Gaussian) random process belief. Our framework provides a practical yet theoretically sound way to apply existing Bayesian deep learning methods such as the linearized Laplace approximation to neural operators. Just as the underlying neural operator, our approach is resolution-agnostic by design. The method adds minimal prediction overhead, can be applied post-hoc without retraining the network, and scales to large models and datasets. We evaluate these aspects in a case study on Fourier neural operators.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 48 of its 80 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
48 of 80 references.
References · 48
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 776
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2014New insights and perspectives on the natural gradient methodcited by 435
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 359
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
36 more
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2015Scalable Bayesian Optimization Using Deep Neural Networkscited by 284
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2019Cyclical Stochastic Gradient MCMC for Bayesian Deep Learningcited by 203
- 2018Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adamcited by 131
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
- 2017Noisy Natural Gradient as Variational Inferencecited by 94
- 2019Approximate Inference Turns Deep Networks into Gaussian Processescited by 89
- 2020Bayesian Deep Learning via Subnetwork Inferencecited by 85
- 2019'In-Between' Uncertainty in Bayesian Neural Networkscited by 79
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2023A Mathematical Guide to Operator Learningcited by 74
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
- 2020Pathwise Conditioning of Gaussian Processescited by 63
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 60
- 2015Operator-valued Kernels for Learning from Functional Response Datacited by 59
- 2023Kernel Methods are Competitive for Operator Learningcited by 50
- 2022Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solverscited by 40
- 2022NeuralUQ: A comprehensive library for uncertainty quantification in neural differential equations and operatorscited by 33
- 2023Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processescited by 31
- 2022Accelerated Linearized Laplace Approximation for Bayesian Deep Learningcited by 27
- 2022Approximate Bayesian Neural Operators: Uncertainty Quantification for Parametric PDEscited by 24
- 2024Discretization Error of Fourier Neural Operatorscited by 20
- 2023Variational Linearized Laplace Approximation for Bayesian Deep Learningcited by 17
- 2020Do ideas have shape? Idea registration as the continuous limit of artificial neural networkscited by 16
- 2021ViViT: Curvature access through the generalized Gauss-Newton's low-rank structurecited by 16
- 2022Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equationscited by 11
- 2023Forecasting subcritical cylinder wakes with Fourier Neural Operatorscited by 11
- 2023Sample Path Regularity of Gaussian Processes from the Covariance Kernelcited by 11
- 2020Improving predictions of Bayesian neural nets via local linearizationcited by 7
- 2023Resolution-Invariant Image Classification based on Fourier Neural Operatorscited by 7
- 2024Neural Operator induced Gaussian Process framework for probabilistic solution of parametric partial differential equationscited by 4
- 2024Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingalescited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 6.
11 papers.
- 2025Probabilistic neural operators for functional uncertainty quantificationcited by 17
- 2025laplax -- Laplace Approximations with JAXcited by 5
- 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equationscited by 2
- 2025Locally Adaptive Conformal Inference for Operator Modelscited by 2
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learningcited by 1
- 2026When Does AI for PDEs Yield Scientific Evidence?cited by 1
- 2025Infinite Neural Operators: Gaussian processes on functionscited by 0
- 2026Generative Neural Operators through Diffusion Last Layercited by 0
- 2026Wrong-Physics Backdoors in Neural PDE Operatorscited by 0
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operatorscited by 0
- 2026Predictive Uncertainty for Neural CAE Surrogatescited by 0
- 2026Predictive Uncertainty for Neural CAE Surrogates21 Sep 2026
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operators28 Aug 2026
- 2026When Does AI for PDEs Yield Scientific Evidence?23 Aug 2026
- 2026Wrong-Physics Backdoors in Neural PDE Operators20 Aug 2026
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learning16 Jun 2026
- 2026Generative Neural Operators through Diffusion Last Layer4 Feb 2026
- 2025Infinite Neural Operators: Gaussian processes on functions19 Oct 2025
- 2025Locally Adaptive Conformal Inference for Operator Models28 Jul 2025
- 2025laplax -- Laplace Approximations with JAX22 Jul 2025
- 2025Probabilistic neural operators for functional uncertainty quantification18 Feb 2025
- 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equations25 Nov 2024