Probabilistic Numerics and Uncertainty in Computations
Not on the map. Why?
Abstract (arXiv)
We deliver a call to arms for probabilistic numerical methods: algorithms for numerical tasks, including linear algebra, integration, optimization and solving differential equations, that return uncertainties in their calculations. Such uncertainties, arising from the loss of precision induced by numerical calculation with limited time or hardware, are important for much contemporary science and industry. Within applications such as climate science and astrophysics, the need to make decisions on the basis of computations with large and complex data has led to a renewed focus on the management of numerical uncertainty. We describe how several seminal classic numerical methods can be interpreted naturally as probabilistic inference. We then show that the probabilistic view suggests new algorithms that can flexibly be adapted to suit application specifics, while delivering improved empirical performance. We provide concrete illustrations of the benefits of probabilistic numeric algorithms on real scientific problems from astrometry and astronomical imaging, while highlighting open problems with these new algorithms. Finally, we describe how probabilistic numerical methods provide a coherent framework for identifying the uncertainty in calculations performed with a combination of numerical algorithms (e.g. both numerical optimisers and differential equation solvers), potentially allowing the diagnosis (and control) of error sources in computations.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 8; 2023: 10; 2024: 8; 2025: 6; 2026: 9.
59 papers.
Sort:
By area:
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Solving Schr"odinger Bridges via Maximum Likelihoodcited by 140
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
- 2022Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solverscited by 40
- 2021Computational Graph Completioncited by 28
- 2021Emulation of physical processes with Emukitcited by 24
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learningcited by 21
- 2022Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombinationcited by 20
- 2021High-Dimensional Gaussian Process Inference with Derivativescited by 16
- 2021Bayesian Numerical Methods for Nonlinear Partial Differential Equationscited by 15
- 2021Bayes-Newton Methods for Approximate Bayesian Inference with PSD Guaranteescited by 12
38 more
- 2024Computation-Aware Kalman Filtering and Smoothingcited by 12
- 2022Fenrir: Physics-Enhanced Regression for Initial Value Problemscited by 11
- 2021ProbNum: Probabilistic Numerics in Pythoncited by 10
- 2022Kernel Packet: An Exact and Scalable Algorithm for Gaussian Process Regression with Mat'ern Correlationscited by 10
- 2024Conditional Bayesian Quadraturecited by 8
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inferencecited by 8
- 2021Data-Centric Engineering: integrating simulation, machine learning and statistics. Challenges and Opportunitiescited by 7
- 2021Pick-and-Mix Information Operators for Probabilistic ODE Solverscited by 6
- 2023Adaptive Batch Sizes for Active Learning A Probabilistic Numerics Approachcited by 6
- 2021Bayesian Quadrature on Riemannian Data Manifoldscited by 5
- 2026BayeSQP: Bayesian Optimization through Sequential Quadratic Programmingcited by 5
- 2023Probabilistic Exponential Integratorscited by 4
- 2023Implicit Manifold Gaussian Process Regressioncited by 4
- 2024Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulationcited by 4
- 2021Advancing Trajectory Optimization with Approximate Inference: Exploration, Covariance Control and Adaptive Riskcited by 3
- 2021Approximate Bayesian inference from noisy likelihoods with Gaussian process emulated MCMCcited by 3
- 2021Efficient Stochastic Optimal Control through Approximate Bayesian Input Inferencecited by 3
- 2022PAGP: A physics-assisted Gaussian process framework with active learning for forward and inverse problems of partial differential equationscited by 3
- 2023Bayesian Numerical Integration with Neural Networkscited by 3
- 2023Data-Adaptive Probabilistic Likelihood Approximation for Ordinary Differential Equationscited by 3
- 2023Parallel-in-Time Probabilistic Numerical ODE Solverscited by 3
- 2024A Quadrature Approach for General-Purpose Batch Bayesian Optimization via Probabilistic Liftingcited by 3
- 2024Towards Gaussian Process for operator learning: an uncertainty aware resolution independent operator learning algorithm for computational mechanicscited by 3
- 2021Invariant Priors for Bayesian Quadraturecited by 2
- 2022Adaptive Cholesky Gaussian Processescited by 2
- 2023Accelerating Non-Conjugate Gaussian Processes By Trading Off Computation For Uncertaintycited by 2
- 2023Gaussian Process Regression under Computational and Epistemic Misspecificationcited by 2
- 2024Scaling up Probabilistic PDE Simulators with Structured Volumetric Informationcited by 2
- 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equationscited by 2
- 2025Online Conformal Probabilistic Numerics via Adaptive Edge-Cloud Offloadingcited by 1
- 2025Physics-based deep kernel learning for parameter estimation in high dimensional PDEscited by 1
- 2026Bayesian Quadraturecited by 1
- 2021A Probabilistically Motivated Learning Rate Adaptation for Stochastic Optimizationcited by 0
- 2021Black Box Probabilistic Numericscited by 0
- 2023Uncertainty Informed Optimal Resource Allocation with Gaussian Process based Bayesian Inferencecited by 0
- 2023Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Dockingcited by 0
- 2025An interpretation of the Brownian bridge as a physics-informed prior for the Poisson equationcited by 0
- 2025Scalable h-adaptive probabilistic solver for time-independent and time-dependent systemscited by 0
50 most cited of 59 All 59 (JSON)
- 2026Operator-Informed Gaussian Processes for Complex Helmholtz Wavefields: From Synthetic Benchmarks to In Vivo Brain Elastography15 Jul 2026
- 2026Hierarchical Bayesian Quadrature12 Jul 2026
- 2026Neural network surrogates with uncertainty quantification for inverse problems in partial differential equations18 Jun 2026
- 2026Stable and Scalable Probabilistic Numerical Solvers for Stiff and High-Dimensional ODEs6 Jun 2026
- 2026Time-adaptive infinite-dimensional Gaussian process regression on manifolds22 Mar 2026
- 2026Information Theoretic Bayesian Optimization over the Probability Simplex10 Mar 2026
- 2026Bayesian Quadrature18 Feb 2026
- 2026BayeSQP: Bayesian Optimization through Sequential Quadratic Programming3 Feb 2026
- 2026Machine learning assisted state prediction of misspecified linear dynamical system via modal reduction8 Jan 2026
- 2025Parametric Numerical Integration with (Differential) Machine Learning12 Dec 2025
- 2025PiERN: Token-Level Routing for Integrating High-Precision Computation and Reasoning17 Sep 2025
- 2025Physics-based deep kernel learning for parameter estimation in high dimensional PDEs17 Sep 2025
38 more
- 2025Scalable h-adaptive probabilistic solver for time-independent and time-dependent systems13 Aug 2025
- 2025Online Conformal Probabilistic Numerics via Adaptive Edge-Cloud Offloading18 Mar 2025
- 2025An interpretation of the Brownian bridge as a physics-informed prior for the Poisson equation28 Feb 2025
- 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equations25 Nov 2024
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inference1 Nov 2024
- 2024Towards Gaussian Process for operator learning: an uncertainty aware resolution independent operator learning algorithm for computational mechanics17 Sep 2024
- 2024Conditional Bayesian Quadrature24 Jun 2024
- 2024Scaling up Probabilistic PDE Simulators with Structured Volumetric Information7 Jun 2024
- 2024Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulation21 May 2024
- 2024Computation-Aware Kalman Filtering and Smoothing14 May 2024
- 2024A Quadrature Approach for General-Purpose Batch Bayesian Optimization via Probabilistic Lifting18 Apr 2024
- 2023Gaussian Process Regression under Computational and Epistemic Misspecification14 Dec 2023
- 2023Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking7 Nov 2023
- 2023Accelerating Non-Conjugate Gaussian Processes By Trading Off Computation For Uncertainty31 Oct 2023
- 2023Implicit Manifold Gaussian Process Regression30 Oct 2023
- 2023Parallel-in-Time Probabilistic Numerical ODE Solvers2 Oct 2023
- 2023Uncertainty Informed Optimal Resource Allocation with Gaussian Process based Bayesian Inference30 Jun 2023
- 2023Adaptive Batch Sizes for Active Learning A Probabilistic Numerics Approach9 Jun 2023
- 2023Data-Adaptive Probabilistic Likelihood Approximation for Ordinary Differential Equations8 Jun 2023
- 2023Probabilistic Exponential Integrators24 May 2023
- 2023Bayesian Numerical Integration with Neural Networks22 May 2023
- 2022Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solvers23 Dec 2022
- 2022Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombination9 Jun 2022
- 2022Posterior and Computational Uncertainty in Gaussian Processes30 May 2022
- 2022PAGP: A physics-assisted Gaussian process framework with active learning for forward and inverse problems of partial differential equations6 Apr 2022
- 2022Kernel Packet: An Exact and Scalable Algorithm for Gaussian Process Regression with Mat'ern Correlations7 Mar 2022
- 2022Adaptive Cholesky Gaussian Processes22 Feb 2022
- 2022Message Passing Neural PDE Solvers7 Feb 2022
- 2022Fenrir: Physics-Enhanced Regression for Initial Value Problems2 Feb 2022
- 2021ProbNum: Probabilistic Numerics in Python3 Dec 2021
- 2021Invariant Priors for Bayesian Quadrature2 Dec 2021
- 2021Data-Centric Engineering: integrating simulation, machine learning and statistics. Challenges and Opportunities7 Nov 2021
- 2021Bayes-Newton Methods for Approximate Bayesian Inference with PSD Guarantees2 Nov 2021
- 2021Emulation of physical processes with Emukit25 Oct 2021
- 2021Pick-and-Mix Information Operators for Probabilistic ODE Solvers20 Oct 2021
- 2021Computational Graph Completion20 Oct 2021
- 2021Black Box Probabilistic Numerics15 Jun 2021
- 2021Solving Schr"odinger Bridges via Maximum Likelihood3 Jun 2021
50 newest of 59 All 59 (JSON)
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Solving Schr"odinger Bridges via Maximum Likelihoodcited by 140
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
- 2022Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solverscited by 40
- 2021Computational Graph Completioncited by 28
- 2021Emulation of physical processes with Emukitcited by 24
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learningcited by 21
- 2022Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombinationcited by 20
- 2021High-Dimensional Gaussian Process Inference with Derivativescited by 16
- 2021Bayesian Numerical Methods for Nonlinear Partial Differential Equationscited by 15
- 2021Bayes-Newton Methods for Approximate Bayesian Inference with PSD Guaranteescited by 12
12 most cited of 58 All 58 (JSON)
- 2026Operator-Informed Gaussian Processes for Complex Helmholtz Wavefields: From Synthetic Benchmarks to In Vivo Brain Elastography15 Jul 2026
- 2026Hierarchical Bayesian Quadrature12 Jul 2026
- 2026Neural network surrogates with uncertainty quantification for inverse problems in partial differential equations18 Jun 2026
- 2026Stable and Scalable Probabilistic Numerical Solvers for Stiff and High-Dimensional ODEs6 Jun 2026
- 2026Time-adaptive infinite-dimensional Gaussian process regression on manifolds22 Mar 2026
- 2026Information Theoretic Bayesian Optimization over the Probability Simplex10 Mar 2026
- 2026Bayesian Quadrature18 Feb 2026
- 2026BayeSQP: Bayesian Optimization through Sequential Quadratic Programming3 Feb 2026
- 2026Machine learning assisted state prediction of misspecified linear dynamical system via modal reduction8 Jan 2026
- 2025Parametric Numerical Integration with (Differential) Machine Learning12 Dec 2025
- 2025Physics-based deep kernel learning for parameter estimation in high dimensional PDEs17 Sep 2025
- 2025Scalable h-adaptive probabilistic solver for time-independent and time-dependent systems13 Aug 2025
12 newest of 58 All 58 (JSON)