Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
While there is currently a lot of enthusiasm about "big data", useful data is usually "small" and expensive to acquire. In this paper, we present a new paradigm of learning partial differential equations from em small data. In particular, we introduce hidden physics models, which are essentially data-efficient learning machines capable of leveraging the underlying laws of physics, expressed by time dependent and nonlinear partial differential equations, to extract patterns from high-dimensional data generated from experiments. The proposed methodology may be applied to the problem of learning, system identification, or data-driven discovery of partial differential equations. Our framework relies on Gaussian processes, a powerful tool for probabilistic inference over functions, that enables us to strike a balance between model complexity and data fitting. The effectiveness of the proposed approach is demonstrated through a variety of canonical problems, spanning a number of scientific domains, including the Navier-Stokes, Schr"odinger, Kuramoto-Sivashinsky, and time dependent linear fractional equations. The methodology provides a promising new direction for harnessing the long-standing developments of classical methods in applied mathematics and mathematical physics to design learning machines with the ability to operate in complex domains without requiring large quantities of data.
Key facts. Cited by 208 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 50; 2022: 51; 2023: 33; 2024: 31; 2025: 29; 2026: 14.
208 papers.
Sort:
By area:
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
- 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 78
- 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2021Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEscited by 56
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodologycited by 43
- 2021Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Mapscited by 41
38 more
- 2022Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priorscited by 39
- 2021A Physics-Informed Deep Learning Paradigm for Traffic State and Fundamental Diagram Estimationcited by 37
- 2021Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow modelscited by 34
- 2022Thermodynamics-informed graph neural networkscited by 31
- 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledgecited by 31
- 2021Learning elliptic partial differential equations with randomized linear algebracited by 29
- 2022wPINNs: Weak Physics informed neural networks for approximating entropy solutions of hyperbolic conservation lawscited by 29
- 2023An operator preconditioning perspective on training in physics-informed machine learningcited by 27
- 2022Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approachcited by 25
- 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
- 2023Reversible and irreversible bracket-based dynamics for deep graph neural networkscited by 25
- 2022Multigrid-augmented deep learning preconditioners for the Helmholtz equationcited by 24
- 2023Physics-informed neural networks for solving forward and inverse problems in complex beam systemscited by 24
- 2024tLaSDI: Thermodynamics-informed latent space dynamics identificationcited by 23
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2021Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observationscited by 20
- 2023GPT-PINN: Generative Pre-Trained Physics-Informed Neural Networks toward non-intrusive Meta-learning of parametric PDEscited by 20
- 2021DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimizationcited by 19
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
- 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
- 2022Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation datacited by 18
- 2022WeakIdent: Weak formulation for Identifying Differential Equations using Narrow-fit and Trimmingcited by 18
- 2023Learning Vortex Dynamics for Fluid Inference and Predictioncited by 17
- 2021Neural Network Training Using ℓ1-Regularization and Bi-fidelity Datacited by 16
- 2022Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approachcited by 15
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimationcited by 14
- 2021Data-driven approaches for predicting spread of infectious diseases through DINNs: Disease Informed Neural Networkscited by 14
- 2022A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networkscited by 14
- 2021A Deep Collocation Method for the Bending Analysis of Kirchhoff Platecited by 13
- 2021Gaussian processes meet NeuralODEs: A Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy datacited by 13
- 2022MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problemscited by 13
- 2023A spectrum of physics-informed Gaussian processes for regression in engineeringcited by 13
- 2021Bayesian Deep Learning for Partial Differential Equation Parameter Discovery with Sparse and Noisy Datacited by 12
- 2022State-of-the-Art Review of Design of Experiments for Physics-Informed Deep Learningcited by 12
- 2023Multi-Scale Message Passing Neural PDE Solverscited by 12
- 2023Physics-Informed Deep Learning For Traffic State Estimation: A Survey and the Outlookcited by 11
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layerscited by 11
- 2024Training Stiff Neural Ordinary Differential Equations with Implicit Single-Step Methodscited by 11
50 most cited of 208 All 208 (JSON)
- 2026Local gradient neural operator7 Sep 2026
- 2026Predicting Subsurface Abnormalities Growth using Physics-Informed Neural Networks1 Sep 2026
- 2026A Constitutive Markov Physics-Informed Neural Operator (MPNO) for Autoregressive Stability in Transient Dynamics26 Aug 2026
- 2026Uncertainty propagation in auto-regressive random neural network models20 Aug 2026
- 2026Parameterized Representations via Implicit Stochastic Modulation for High-Dimensional and High-Order Neural PDE Solvers20 Jun 2026
- 2026SirenFNO: Efficient and Full Frequency Learning of Fourier Neural Operators9 Jun 2026
- 2026Layer-wise Derivative Controlled Networks14 May 2026
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling12 May 2026
- 2026EqOD: Symmetry-Informed Stability Selection for PDE Identification12 May 2026
- 2026From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamics6 May 2026
- 2026WGFINNs: Weak formulation-based GENERIC formalism informed neural networks3 Apr 2026
- 2026Bias Inheritance in Neural-Symbolic Discovery of Constitutive Closures Under Function-Class Mismatch1 Apr 2026
38 more
- 2026From Complex Dynamics to DynFormer: Rethinking Transformers for PDEs3 Mar 2026
- 2026Dual-Level Models for Physics-Informed Multi-Step Time Series Forecasting12 Jan 2026
- 2025Convergence of the generalization error for deep gradient flow methods for PDEs31 Dec 2025
- 2025Simultaneous Approximation of the Score Function and Its Derivatives by Deep Neural Networks29 Dec 2025
- 2025Research and Prototyping Study of an LLM-Based Chatbot for Electromagnetic Simulations21 Nov 2025
- 2025Uncertainties in Physics-informed Inverse Problems: The Hidden Risk in Scientific AI6 Nov 2025
- 2025A Physics-informed Multi-resolution Neural Operator27 Oct 2025
- 2025Physics-augmented Multi-task Gaussian Process for Modeling Spatiotemporal Dynamics15 Oct 2025
- 2025Physics-based deep kernel learning for parameter estimation in high dimensional PDEs17 Sep 2025
- 2025Towards Reasoning for PDE Foundation Models: A Reward-Model-Driven Inference-Time-Scaling Algorithm2 Sep 2025
- 2025Learning with Mandelbrot and Julia31 Aug 2025
- 2025Morephy-Net: An Evolutionary Multi-objective Optimization for Replica-Exchange-based Physics-informed Neural Operator Learning Networks31 Aug 2025
- 2025Solved in Unit Domain: JacobiNet for Differentiable Coordinate-Transformed PINNs4 Aug 2025
- 2025The Vanishing Gradient Problem for Stiff Neural Differential Equations2 Aug 2025
- 2025Data-driven quantum Koopman method for simulating nonlinear dynamics29 Jul 2025
- 2025Data-Driven Adaptive Gradient Recovery for Unstructured Finite Volume Computations22 Jul 2025
- 2025Discovering Governing Equations in the Presence of Uncertainty13 Jul 2025
- 2025Neural Measures for learning distributions of Random PDEs2 Jul 2025
- 2025Neural Tangent Kernel Analysis to Probe Convergence in Physics-informed Neural Solvers: PIKANs vs. PINNs9 Jun 2025
- 2025FlowMixer: A Depth-Agnostic Neural Architecture for Interpretable Spatiotemporal Forecasting22 May 2025
- 2025A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Model11 May 2025
- 2025A general physics-constrained method for the modelling of equation's closure terms with sparse data30 Apr 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Uncertainty propagation in feed-forward neural network models27 Mar 2025
- 2025Exploration of Hepatitis B Virus Infection Dynamics through Physics-Informed Deep Learning Approach12 Mar 2025
- 2025Advancing Solutions for the Three-Body Problem Through Physics-Informed Neural Networks6 Mar 2025
- 2025Al-Khwarizmi: Discovering Physical Laws with Foundation Models3 Feb 2025
- 2025chebgreen: Learning and Interpolating Continuous Empirical Green's Functions from Data30 Jan 2025
- 2025No Equations Needed: Learning System Dynamics Without Relying on Closed-Form ODEs30 Jan 2025
- 2025Advanced Physics-Informed Neural Network with Residuals for Solving Complex Integral Equations22 Jan 2025
- 2025The Finite Element Neural Network Method: One Dimensional Study21 Jan 2025
- 2024Pulling the Carpet Below the Learner's Feet: Genetic Algorithm To Learn Ensemble Machine Learning Model During Concept Drift12 Dec 2024
- 2024Training Stiff Neural Ordinary Differential Equations with Explicit Exponential Integration Methods2 Dec 2024
- 2024Estimating unknown parameters in differential equations with a reinforcement learning based PSO method13 Nov 2024
- 2024Learning Interpretable Network Dynamics via Universal Neural Symbolic Regression11 Nov 2024
- 2024GoRINNs: Godunov-Riemann Informed Neural Networks for Learning Hyperbolic Conservation Laws29 Oct 2024
- 2024Physics-informed AI and ML-based sparse system identification algorithm for discovery of PDE's representing nonlinear dynamic systems13 Oct 2024
- 2024Training Stiff Neural Ordinary Differential Equations with Implicit Single-Step Methods8 Oct 2024
50 newest of 208 All 208 (JSON)
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
- 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 78
- 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2021Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEscited by 56
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodologycited by 43
- 2021Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Mapscited by 41
12 most cited of 205 All 205 (JSON)
- 2026Local gradient neural operator7 Sep 2026
- 2026Predicting Subsurface Abnormalities Growth using Physics-Informed Neural Networks1 Sep 2026
- 2026A Constitutive Markov Physics-Informed Neural Operator (MPNO) for Autoregressive Stability in Transient Dynamics26 Aug 2026
- 2026Uncertainty propagation in auto-regressive random neural network models20 Aug 2026
- 2026Parameterized Representations via Implicit Stochastic Modulation for High-Dimensional and High-Order Neural PDE Solvers20 Jun 2026
- 2026SirenFNO: Efficient and Full Frequency Learning of Fourier Neural Operators9 Jun 2026
- 2026Layer-wise Derivative Controlled Networks14 May 2026
- 2026EqOD: Symmetry-Informed Stability Selection for PDE Identification12 May 2026
- 2026From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamics6 May 2026
- 2026WGFINNs: Weak formulation-based GENERIC formalism informed neural networks3 Apr 2026
- 2026Bias Inheritance in Neural-Symbolic Discovery of Constitutive Closures Under Function-Class Mismatch1 Apr 2026
- 2026From Complex Dynamics to DynFormer: Rethinking Transformers for PDEs3 Mar 2026
12 newest of 205 All 205 (JSON)