Numerical Gaussian Processes for Time-dependent and Non-linear Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
We introduce the concept of numerical Gaussian processes, which we define as Gaussian processes with covariance functions resulting from temporal discretization of time-dependent partial differential equations. Numerical Gaussian processes, by construction, are designed to deal with cases where: (1) all we observe are noisy data on black-box initial conditions, and (2) we are interested in quantifying the uncertainty associated with such noisy data in our solutions to time-dependent partial differential equations. Our method circumvents the need for spatial discretization of the differential operators by proper placement of Gaussian process priors. This is an attempt to construct structured and data-efficient learning machines, which are explicitly informed by the underlying physics that possibly generated the observed data. The effectiveness of the proposed approach is demonstrated through several benchmark problems involving linear and nonlinear time-dependent operators. In all examples, we are able to recover accurate approximations of the latent solutions, and consistently propagate uncertainty, even in cases involving very long time integration.
Key facts. Cited by 72 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 18; 2023: 15; 2024: 7; 2025: 12; 2026: 5.
72 papers.
Sort:
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 129
- 2021Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow modelscited by 35
- 2023Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processescited by 31
- 2022On the influence of over-parameterization in manifold based surrogates and deep neural operatorscited by 29
- 2022On the Role of Fixed Points of Dynamical Systems in Training Physics-Informed Neural Networkscited by 23
- 2022Scalable algorithms for physics-informed neural and graph networkscited by 21
- 2023Error Analysis of Kernel/GP Methods for Nonlinear and Parametric PDEscited by 21
- 2022A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problemscited by 20
- 2022Monte Carlo PINNs: deep learning approach for forward and inverse problems involving high dimensional fractional partial differential equationscited by 20
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
38 more
- 2021Recipes for when Physics Fails: Recovering Robust Learning of Physics Informed Neural Networkscited by 18
- 2022Gaussian Process Priors for Systems of Linear Partial Differential Equations with Constant Coefficientscited by 17
- 2021Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 16
- 2021Bayesian Numerical Methods for Nonlinear Partial Differential Equationscited by 15
- 2023Gaussian Process Port-Hamiltonian Systems: Bayesian Learning with Physics Priorcited by 15
- 2023A spectrum of physics-informed Gaussian processes for regression in engineeringcited by 14
- 2021A Deep Collocation Method for the Bending Analysis of Kirchhoff Platecited by 13
- 2021Probabilistic Numerical Method of Lines for Time-Dependent Partial Differential Equationscited by 13
- 2022MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problemscited by 13
- 2024Training Stiff Neural Ordinary Differential Equations with Implicit Single-Step Methodscited by 11
- 2022Bayesian Calibration of Imperfect Computer Models using Physics-Informed Priorscited by 9
- 2022Learning "best" kernels from data in Gaussian process regression. With application to aerodynamicscited by 9
- 2024Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learningcited by 9
- 2022D-CIPHER: Discovery of Closed-form Partial Differential Equationscited by 7
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysiscited by 7
- 2022Physics Informed Neural Network for Dynamic Stress Predictioncited by 6
- 2023Bayesian polynomial neural networks and polynomial neural ordinary differential equationscited by 6
- 2024Training Stiff Neural Ordinary Differential Equations with Explicit Exponential Integration Methodscited by 5
- 2023Physics-informed Gaussian process model for Euler-Bernoulli beam elementscited by 4
- 2024Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulationcited by 4
- 2025Physics-Informed Machine Learning in Biomedical Science and Engineeringcited by 4
- 2021A Temporal Kernel Approach for Deep Learning with Continuous-time Informationcited by 3
- 2021Learning Free-Surface Flow with Physics-Informed Neural Networkscited by 3
- 2022PAGP: A physics-assisted Gaussian process framework with active learning for forward and inverse problems of partial differential equationscited by 3
- 2023On the Integration of Physics-Based Machine Learning with Hierarchical Bayesian Modeling Techniquescited by 3
- 2023EPINN-NSE: Enhanced Physics-Informed Neural Networks for Solving Navier-Stokes Equationscited by 3
- 2023Exact Inference for Continuous-Time Gaussian Process Dynamicscited by 3
- 2023Tasks Makyth Models: Machine Learning Assisted Surrogates for Tipping Pointscited by 3
- 2025The Vanishing Gradient Problem for Stiff Neural Differential Equationscited by 3
- 2025Walsh-Hadamard Neural Operators for Solving PDEs with Discontinuous Coefficientscited by 3
- 2021Learning ODEs via Diffeomorphisms for Fast and Robust Integrationcited by 2
- 2022Incorporating Sum Constraints into Multitask Gaussian Processescited by 2
- 2022High Precision Differentiation Techniques for Data-Driven Solution of Nonlinear PDEs by Physics-Informed Neural Networkscited by 2
- 2023Decoding Mean Field Games from Population and Environment Observations By Gaussian Processescited by 2
- 2024Scaling up Probabilistic PDE Simulators with Structured Volumetric Informationcited by 2
- 2025Learning Surrogate Potential Mean Field Games via Gaussian Processes: A Data-Driven Approach to Ill-Posed Inverse Problemscited by 2
- 2025Next Generation Equation-Free Multiscale Modelling of Crowd Dynamics via Machine Learningcited by 2
- 2021Dominant motion identification of multi-particle system using deep learning from videocited by 1
50 most cited of 72 All 72 (JSON)
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026LIGO-PINN: Learned Initialization via Gated Optimization to Alleviate Convergence Failures in Physics Informed Neural Networks15 Jul 2026
- 2026A unified perspective of Gaussian process approximation for differential equations7 Jul 2026
- 2026Multifidelity-Augmented Gaussian Process Inputs for Surrogate Modeling from Scarce Data23 Mar 2026
- 2026Spatio-temporal probabilistic forecast using MMAF-guided learning16 Mar 2026
- 2025Walsh-Hadamard Neural Operators for Solving PDEs with Discontinuous Coefficients10 Nov 2025
- 2025HEATNETs: Explainable Random Feature Neural Networks for High-Dimensional Parabolic PDEs2 Nov 2025
- 2025Physics-augmented Multi-task Gaussian Process for Modeling Spatiotemporal Dynamics15 Oct 2025
- 2025Physics-Informed Machine Learning in Biomedical Science and Engineering6 Oct 2025
- 2025Physics-based deep kernel learning for parameter estimation in high dimensional PDEs17 Sep 2025
- 2025Next Generation Equation-Free Multiscale Modelling of Crowd Dynamics via Machine Learning5 Aug 2025
- 2025The Vanishing Gradient Problem for Stiff Neural Differential Equations2 Aug 2025
38 more
- 2025LVM-GP: Uncertainty-Aware PDE Solver via coupling latent variable model and Gaussian process30 Jul 2025
- 2025Gaussian process policy iteration with additive Schwarz acceleration for forward and inverse HJB and mean field game problems1 May 2025
- 2025A general physics-constrained method for the modelling of equation's closure terms with sparse data30 Apr 2025
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis2 Mar 2025
- 2025Learning Surrogate Potential Mean Field Games via Gaussian Processes: A Data-Driven Approach to Ill-Posed Inverse Problems17 Feb 2025
- 2024Training Stiff Neural Ordinary Differential Equations with Explicit Exponential Integration Methods2 Dec 2024
- 2024Training Stiff Neural Ordinary Differential Equations with Implicit Single-Step Methods8 Oct 2024
- 2024Linear Stability Analysis of Physics-Informed Random Projection Neural Networks for ODEs27 Aug 2024
- 2024Scaling up Probabilistic PDE Simulators with Structured Volumetric Information7 Jun 2024
- 2024Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulation21 May 2024
- 2024Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning12 Apr 2024
- 2024PINN-BO: A Black-box Optimization Algorithm using Physics-Informed Neural Networks5 Feb 2024
- 2023A Kronecker product accelerated efficient sparse Gaussian Process (E-SGP) for flow emulation13 Dec 2023
- 2023Decoding Mean Field Games from Population and Environment Observations By Gaussian Processes8 Dec 2023
- 2023Tasks Makyth Models: Machine Learning Assisted Surrogates for Tipping Points25 Sep 2023
- 2023A spectrum of physics-informed Gaussian processes for regression in engineering19 Sep 2023
- 2023Exact Inference for Continuous-Time Gaussian Process Dynamics5 Sep 2023
- 2023Bayesian polynomial neural networks and polynomial neural ordinary differential equations17 Aug 2023
- 2023Physics-informed Gaussian process model for Euler-Bernoulli beam elements5 Aug 2023
- 2023PDE-constrained Gaussian process surrogate modeling with uncertain data locations19 May 2023
- 2023Gaussian Process Port-Hamiltonian Systems: Bayesian Learning with Physics Prior15 May 2023
- 2023Error Analysis of Kernel/GP Methods for Nonlinear and Parametric PDEs8 May 2023
- 2023EPINN-NSE: Enhanced Physics-Informed Neural Networks for Solving Navier-Stokes Equations7 Apr 2023
- 2023Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processes3 Apr 2023
- 2023Laplace-fPINNs: Laplace-based fractional physics-informed neural networks for solving forward and inverse problems of subdiffusion3 Apr 2023
- 2023On the Integration of Physics-Based Machine Learning with Hierarchical Bayesian Modeling Techniques1 Mar 2023
- 2023The ADMM-PINNs Algorithmic Framework for Nonsmooth PDE-Constrained Optimization: A Deep Learning Approach16 Feb 2023
- 2022Gaussian Process Priors for Systems of Linear Partial Differential Equations with Constant Coefficients29 Dec 2022
- 2022Physics Informed Neural Network for Dynamic Stress Prediction28 Nov 2022
- 2022High Precision Differentiation Techniques for Data-Driven Solution of Nonlinear PDEs by Physics-Informed Neural Networks2 Oct 2022
- 2022Use of BNNM for interference wave solutions of the gBS-like equation and comparison with PINNs7 Aug 2022
- 2022D-CIPHER: Discovery of Closed-form Partial Differential Equations21 Jun 2022
- 2022Learning "best" kernels from data in Gaussian process regression. With application to aerodynamics3 Jun 2022
- 2022Scalable algorithms for physics-informed neural and graph networks16 May 2022
- 2022A hybrid data driven-physics constrained Gaussian process regression framework with deep kernel for uncertainty quantification13 May 2022
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Video29 Apr 2022
- 2022MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problems7 Apr 2022
- 2022PAGP: A physics-assisted Gaussian process framework with active learning for forward and inverse problems of partial differential equations6 Apr 2022
50 newest of 72 All 72 (JSON)
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
- 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 129
- 2021Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow modelscited by 35
- 2023Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processescited by 31
- 2022On the influence of over-parameterization in manifold based surrogates and deep neural operatorscited by 29
- 2022On the Role of Fixed Points of Dynamical Systems in Training Physics-Informed Neural Networkscited by 23
- 2022Scalable algorithms for physics-informed neural and graph networkscited by 21
- 2023Error Analysis of Kernel/GP Methods for Nonlinear and Parametric PDEscited by 21
- 2022A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problemscited by 20
- 2022Monte Carlo PINNs: deep learning approach for forward and inverse problems involving high dimensional fractional partial differential equationscited by 20
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
12 most cited of 72 All 72 (JSON)
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026LIGO-PINN: Learned Initialization via Gated Optimization to Alleviate Convergence Failures in Physics Informed Neural Networks15 Jul 2026
- 2026A unified perspective of Gaussian process approximation for differential equations7 Jul 2026
- 2026Multifidelity-Augmented Gaussian Process Inputs for Surrogate Modeling from Scarce Data23 Mar 2026
- 2026Spatio-temporal probabilistic forecast using MMAF-guided learning16 Mar 2026
- 2025Walsh-Hadamard Neural Operators for Solving PDEs with Discontinuous Coefficients10 Nov 2025
- 2025HEATNETs: Explainable Random Feature Neural Networks for High-Dimensional Parabolic PDEs2 Nov 2025
- 2025Physics-augmented Multi-task Gaussian Process for Modeling Spatiotemporal Dynamics15 Oct 2025
- 2025Physics-Informed Machine Learning in Biomedical Science and Engineering6 Oct 2025
- 2025Physics-based deep kernel learning for parameter estimation in high dimensional PDEs17 Sep 2025
- 2025Next Generation Equation-Free Multiscale Modelling of Crowd Dynamics via Machine Learning5 Aug 2025
- 2025The Vanishing Gradient Problem for Stiff Neural Differential Equations2 Aug 2025
12 newest of 72 All 72 (JSON)