mlsanityData to 7 Oct 2026

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

arXiv 1801.06637 ↗First posted 20 Jan 2018stat.ML cs.LG cs.NAcited by 233

Not on the map. Why?

Abstract (arXiv)

A long-standing problem at the interface of artificial intelligence and applied mathematics is to devise an algorithm capable of achieving human level or even superhuman proficiency in transforming observed data into predictive mathematical models of the physical world. In the current era of abundance of data and advanced machine learning capabilities, the natural question arises: How can we automatically uncover the underlying laws of physics from high-dimensional data generated from experiments? In this work, we put forth a deep learning approach for discovering nonlinear partial differential equations from scattered and potentially noisy observations in space and time. Specifically, we approximate the unknown solution as well as the nonlinear dynamics by two deep neural networks. The first network acts as a prior on the unknown solution and essentially enables us to avoid numerical differentiations which are inherently ill-conditioned and unstable. The second network represents the nonlinear dynamics and helps us distill the mechanisms that govern the evolution of a given spatiotemporal data-set. We test the effectiveness of our approach for several benchmark problems spanning a number of scientific domains and demonstrate how the proposed framework can help us accurately learn the underlying dynamics and forecast future states of the system. In particular, we study the Burgers', Korteweg-de Vries (KdV), Kuramoto-Sivashinsky, nonlinear Schr"odinger, and Navier-Stokes equations.

Key facts. Cited by 233 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jan 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 61; 2022: 46; 2023: 46; 2024: 43; 2025: 28; 2026: 9.

233 papers.

Sort:

By area:

  1. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  2. 2022Message Passing Neural PDE Solverscited by 368
  3. 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
  4. 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
  5. 2021Efficient training of physics-informed neural networks via importance samplingcited by 109
  6. 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
  7. 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
  8. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  9. 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
  10. 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
  11. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
  12. 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
38 more
  1. 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
  2. 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
  3. 2023Separable Physics-Informed Neural Networkscited by 64
  4. 2021Policy Evaluation and Temporal-Difference Learning in Continuous Time and Space: A Martingale Approachcited by 62
  5. 2023PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networkscited by 62
  6. 2021Encoding physics to learn reaction-diffusion processescited by 61
  7. 2021Learning in Sinusoidal Spaces with Physics-Informed Neural Networkscited by 61
  8. 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
  9. 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
  10. 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
  11. 2021Data-driven discovery of Green's functions with human-understandable deep learningcited by 43
  12. 2021Neural graphical modelling in continuous-time: consistency guarantees and algorithmscited by 42
  13. 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 40
  14. 2021Physics and Equality Constrained Artificial Neural Networks: Application to Forward and Inverse Problems with Multi-fidelity Data Fusioncited by 38
  15. 2021HyperPINN: Learning parameterized differential equations with physics-informed hypernetworkscited by 38
  16. 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 38
  17. 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
  18. 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
  19. 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
  20. 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
  21. 2021Learning elliptic partial differential equations with randomized linear algebracited by 29
  22. 2023Koopman neural operator as a mesh-free solver of non-linear partial differential equationscited by 29
  23. 2024RoPINN: Region Optimized Physics-Informed Neural Networkscited by 26
  24. 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Spacecited by 25
  25. 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
  26. 2022Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approachcited by 25
  27. 2021Hybrid FEM-NN models: Combining artificial neural networks with the finite element methodcited by 24
  28. 2021PDE-READ: Human-readable Partial Differential Equation Discovery using Deep Learningcited by 24
  29. 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
  30. 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
  31. 2022On the Role of Fixed Points of Dynamical Systems in Training Physics-Informed Neural Networkscited by 23
  32. 2022PIXEL: Physics-Informed Cell Representations for Fast and Accurate PDE Solverscited by 22
  33. 2021Physics-Informed Graphical Neural Network for Parameter & State Estimations in Power Systemscited by 21
  34. 2021Robust discovery of partial differential equations in complex situationscited by 21
  35. 2023Deep Learning in Deterministic Computational Mechanicscited by 21
  36. 2024The Challenges of the Nonlinear Regime for Physics-Informed Neural Networkscited by 21
  37. 2022PDE-LEARN: Using Deep Learning to Discover Partial Differential Equations from Noisy, Limited Datacited by 20
  38. 2023GPT-PINN: Generative Pre-Trained Physics-Informed Neural Networks toward non-intrusive Meta-learning of parametric PDEscited by 20

50 most cited of 233 All 233 (JSON)