Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
A long-standing problem at the interface of artificial intelligence and applied mathematics is to devise an algorithm capable of achieving human level or even superhuman proficiency in transforming observed data into predictive mathematical models of the physical world. In the current era of abundance of data and advanced machine learning capabilities, the natural question arises: How can we automatically uncover the underlying laws of physics from high-dimensional data generated from experiments? In this work, we put forth a deep learning approach for discovering nonlinear partial differential equations from scattered and potentially noisy observations in space and time. Specifically, we approximate the unknown solution as well as the nonlinear dynamics by two deep neural networks. The first network acts as a prior on the unknown solution and essentially enables us to avoid numerical differentiations which are inherently ill-conditioned and unstable. The second network represents the nonlinear dynamics and helps us distill the mechanisms that govern the evolution of a given spatiotemporal data-set. We test the effectiveness of our approach for several benchmark problems spanning a number of scientific domains and demonstrate how the proposed framework can help us accurately learn the underlying dynamics and forecast future states of the system. In particular, we study the Burgers', Korteweg-de Vries (KdV), Kuramoto-Sivashinsky, nonlinear Schr"odinger, and Navier-Stokes equations.
Key facts. Cited by 233 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 61; 2022: 46; 2023: 46; 2024: 43; 2025: 28; 2026: 9.
233 papers.
Sort:
By area:
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2021Efficient training of physics-informed neural networks via importance samplingcited by 109
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
- 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
38 more
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2023Separable Physics-Informed Neural Networkscited by 64
- 2021Policy Evaluation and Temporal-Difference Learning in Continuous Time and Space: A Martingale Approachcited by 62
- 2023PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networkscited by 62
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2021Learning in Sinusoidal Spaces with Physics-Informed Neural Networkscited by 61
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
- 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
- 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
- 2021Data-driven discovery of Green's functions with human-understandable deep learningcited by 43
- 2021Neural graphical modelling in continuous-time: consistency guarantees and algorithmscited by 42
- 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 40
- 2021Physics and Equality Constrained Artificial Neural Networks: Application to Forward and Inverse Problems with Multi-fidelity Data Fusioncited by 38
- 2021HyperPINN: Learning parameterized differential equations with physics-informed hypernetworkscited by 38
- 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 38
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
- 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
- 2021Learning elliptic partial differential equations with randomized linear algebracited by 29
- 2023Koopman neural operator as a mesh-free solver of non-linear partial differential equationscited by 29
- 2024RoPINN: Region Optimized Physics-Informed Neural Networkscited by 26
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Spacecited by 25
- 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
- 2022Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approachcited by 25
- 2021Hybrid FEM-NN models: Combining artificial neural networks with the finite element methodcited by 24
- 2021PDE-READ: Human-readable Partial Differential Equation Discovery using Deep Learningcited by 24
- 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
- 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
- 2022On the Role of Fixed Points of Dynamical Systems in Training Physics-Informed Neural Networkscited by 23
- 2022PIXEL: Physics-Informed Cell Representations for Fast and Accurate PDE Solverscited by 22
- 2021Physics-Informed Graphical Neural Network for Parameter & State Estimations in Power Systemscited by 21
- 2021Robust discovery of partial differential equations in complex situationscited by 21
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2024The Challenges of the Nonlinear Regime for Physics-Informed Neural Networkscited by 21
- 2022PDE-LEARN: Using Deep Learning to Discover Partial Differential Equations from Noisy, Limited Datacited by 20
- 2023GPT-PINN: Generative Pre-Trained Physics-Informed Neural Networks toward non-intrusive Meta-learning of parametric PDEscited by 20
50 most cited of 233 All 233 (JSON)
- 2026A Physics-Chemistry-Informed Neural Network (PCINN) for Real-Time Spatial-ALD Coverage Prediction and Reliable Kinetics Inversion31 Jul 2026
- 2026NPSolver: Neural Poisson Solver with Iterative Physics Supervision25 May 2026
- 2026Approximation of Maximally Monotone Operators : A Graph Convergence Perspective12 May 2026
- 2026Hierarchical Multi-Fidelity Learning for Predicting Three-Dimensional Flame Wrinkling and Turbulent Burning Velocity6 May 2026
- 2026Posterior-First Neural PDE Simulation: Inferring Hidden Problem State from a Single Field5 May 2026
- 2026SOLIS: Physics-Informed Learning of Interpretable Neural Surrogates for Nonlinear Systems16 Apr 2026
- 2026A Physics-Aware Framework for Short-Term GPU Power Forecasting of AI Data Centers14 Apr 2026
- 2026A Family of Adaptive Activation Functions for Mitigating Failure Modes in Physics-Informed Neural Networks18 Mar 2026
- 2026NewPINNs: Physics-Informing Neural Networks Using Conventional Solvers for Partial Differential Equations23 Jan 2026
- 2025The Mechanics of CNN Filtering with Rectification30 Dec 2025
- 2025A physics-informed U-Net-LSTM network for nonlinear structural response under seismic excitation26 Nov 2025
- 2025A joint optimization approach to identifying sparse dynamics using least squares kernel collocation23 Nov 2025
38 more
- 2025When is a System Discoverable from Data? Discovery Requires Chaos12 Nov 2025
- 2025PINN Balls: Scaling Second-Order Methods for PINNs with Domain Decomposition and Adaptive Sampling24 Oct 2025
- 2025Physics-Informed High-order Graph Dynamics Identification Learning for Predicting Complex Networks Long-term Dynamics10 Oct 2025
- 2025Equation-Free Coarse Control of Distributed Parameter Systems via Local Neural Operators28 Sep 2025
- 2025Variational Neural Networks for Observable Thermodynamics (V-NOTS)11 Sep 2025
- 2025Learning with Mandelbrot and Julia31 Aug 2025
- 2025Improving Long-term Autoregressive Spatiotemporal Predictions: A Proof of Concept with Fluid Dynamics25 Aug 2025
- 2025Physics-Inspired Spatial Temporal Graph Neural Networks for Predicting Industrial Chain Resilience22 Aug 2025
- 2025Solved in Unit Domain: JacobiNet for Differentiable Coordinate-Transformed PINNs4 Aug 2025
- 2025Physics-Informed Regression: Parameter Estimation in Parameter-Linear Nonlinear Dynamic Models25 Jul 2025
- 2025Small Data Explainer -- The impact of small data methods in everyday life15 Jul 2025
- 2025Toward accurate RUL and SoH estimation using reinforced graph-based physics-informed neural networks enhanced with dynamic weights13 Jul 2025
- 2025Cost-effective Reduced-Order Modeling via Bayesian Active Learning27 Jun 2025
- 2025On the definition and importance of interpretability in scientific machine learning16 May 2025
- 2025A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Model11 May 2025
- 2025Predictive Digital Twins for Thermal Management Using Machine Learning and Reduced-Order Models11 May 2025
- 2025DUE: A Deep Learning Framework and Library for Modeling Unknown Equations14 Apr 2025
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025BPINN-EM-Post: Bayesian Physics-Informed Neural Network based Stochastic Electromigration Damage Analysis in the Post-void Phase18 Mar 2025
- 2025Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operators14 Mar 2025
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis2 Mar 2025
- 2025Mechanistic PDE Networks for Discovery of Governing Equations25 Feb 2025
- 2025Connecting the geometry and dynamics of many-body complex systems with message passing neural operators21 Feb 2025
- 2025chebgreen: Learning and Interpolating Continuous Empirical Green's Functions from Data30 Jan 2025
- 2024Neural Port-Hamiltonian Differential Algebraic Equations for Compositional Learning of Electrical Networks15 Dec 2024
- 2024Learning Hidden Physics and System Parameters with Deep Operator Networks6 Dec 2024
- 2024A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systems5 Dec 2024
- 2024Transformer-based Koopman Autoencoder for Linearizing Fisher's Equation3 Dec 2024
- 2024Physics-Informed Autonomous LLM Agents for Explainable Power Electronics Modulation Design21 Nov 2024
- 2024Estimating unknown parameters in differential equations with a reinforcement learning based PSO method13 Nov 2024
- 2024Energy-based physics-informed neural network for frictionless contact problems under large deformation6 Nov 2024
- 2024LE-PDE++: Mamba for accelerating PDEs Simulations4 Nov 2024
- 2024LES-SINDy: Laplace-Enhanced Sparse Identification of Nonlinear Dynamical Systems4 Nov 2024
- 2024Dynamics-Encoded Deep Learning for Robust System Identification and Parameter Estimation5 Oct 2024
- 2024PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systems2 Oct 2024
- 2024Beyond Derivative Pathology of PINNs: Variable Splitting Strategy with Convergence Analysis30 Sep 2024
- 2024SetPINNs: Set-based Physics-informed Neural Networks30 Sep 2024
50 newest of 233 All 233 (JSON)
- 2023Extracting Reward Functions from Diffusion Modelscited by 17
- 2024Graph Neural Reaction Diffusion Modelscited by 6
- 2024Graph Neural Reaction Diffusion Models16 Jun 2024
- 2023Extracting Reward Functions from Diffusion Models1 Jun 2023
- 2024LE-PDE++: Mamba for accelerating PDEs Simulationscited by 0
- 2024LE-PDE++: Mamba for accelerating PDEs Simulations4 Nov 2024
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2021Efficient training of physics-informed neural networks via importance samplingcited by 109
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
- 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
12 most cited of 228 All 228 (JSON)
- 2026A Physics-Chemistry-Informed Neural Network (PCINN) for Real-Time Spatial-ALD Coverage Prediction and Reliable Kinetics Inversion31 Jul 2026
- 2026NPSolver: Neural Poisson Solver with Iterative Physics Supervision25 May 2026
- 2026Approximation of Maximally Monotone Operators : A Graph Convergence Perspective12 May 2026
- 2026Hierarchical Multi-Fidelity Learning for Predicting Three-Dimensional Flame Wrinkling and Turbulent Burning Velocity6 May 2026
- 2026Posterior-First Neural PDE Simulation: Inferring Hidden Problem State from a Single Field5 May 2026
- 2026SOLIS: Physics-Informed Learning of Interpretable Neural Surrogates for Nonlinear Systems16 Apr 2026
- 2026A Physics-Aware Framework for Short-Term GPU Power Forecasting of AI Data Centers14 Apr 2026
- 2026A Family of Adaptive Activation Functions for Mitigating Failure Modes in Physics-Informed Neural Networks18 Mar 2026
- 2026NewPINNs: Physics-Informing Neural Networks Using Conventional Solvers for Partial Differential Equations23 Jan 2026
- 2025The Mechanics of CNN Filtering with Rectification30 Dec 2025
- 2025A physics-informed U-Net-LSTM network for nonlinear structural response under seismic excitation26 Nov 2025
- 2025A joint optimization approach to identifying sparse dynamics using least squares kernel collocation23 Nov 2025
12 newest of 228 All 228 (JSON)