mlsanityData to 7 Oct 2026

Encoding physics to learn reaction-diffusion processes

arXiv 2106.04781 ↗First posted 9 Jun 2021cs.LG cs.NA math.NAcited by 61

Not on the map. Why?

Abstract (arXiv)

Modeling complex spatiotemporal dynamical systems, such as the reaction-diffusion processes, have largely relied on partial differential equations (PDEs). However, due to insufficient prior knowledge on some under-explored dynamical systems, such as those in chemistry, biology, geology, physics and ecology, and the lack of explicit PDE formulation used for describing the nonlinear process of the system variables, to predict the evolution of such a system remains a challenging task. Unifying measurement data and our limited prior physics knowledge via machine learning provides us with a new path to solving this problem. Existing physics-informed learning paradigms impose physics laws through soft penalty constraints, whose solution quality largely depends on a trial-and-error proper setting of hyperparameters. Since the core of such methods is still rooted in black-box neural networks, the resulting model generally lacks interpretability and suffers from critical issues of extrapolation and generalization. To this end, we propose a deep learning framework that forcibly encodes given physics structure to facilitate the learning of the spatiotemporal dynamics in sparse data regimes. We show how the proposed approach can be applied to a variety of problems regarding the PDE system, including forward and inverse analysis, data-driven modeling, and discovery of PDEs. The resultant learning paradigm that encodes physics shows high accuracy, robustness, interpretability and generalizability demonstrated via extensive numerical experiments.

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Builds on 57 of its 114 references that are in the map. First posted on arXiv 9 Jun 2021.

Builds on

57 of 114 references.

References · 57

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Going Deeper with Convolutionscited by 4,231
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  7. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  8. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  9. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  10. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  11. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  12. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
38 more
  1. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  2. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  3. 2021Machine learning accelerated computational fluid dynamicscited by 461
  4. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
  5. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  6. 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
  7. 2017PDE-Net: Learning PDEs from Datacited by 304
  8. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  9. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  10. 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
  11. 2018Deep Learning: A Critical Appraisalcited by 214
  12. 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
  13. 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
  14. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  15. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  16. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  17. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  18. 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 169
  19. 2020Physics-informed learning of governing equations from scarce datacited by 167
  20. 2017Detail-revealing Deep Video Super-resolutioncited by 147
  21. 2017Machine Learning of Linear Differential Equations using Gaussian Processescited by 139
  22. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
  23. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  24. 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 130
  25. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  26. 2018Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 120
  27. 2020Transformers for Modeling Physical Systemscited by 105
  28. 2020A fast and accurate physics-informed neural network reduced order model with shallow masked autoencodercited by 80
  29. 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
  30. 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
  31. 2018Deep Learning of Vortex Induced Vibrationscited by 74
  32. 2017Dual Motion GAN for Future-Flow Embedded Video Predictioncited by 69
  33. 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 60
  34. 2017Multi-level Residual Networks from Dynamical Systems Viewcited by 59
  35. 2020Physics-informed deep learning for incompressible laminar flowscited by 54
  36. 2020Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structurescited by 52
  37. 2020Geometric deep learning for computational mechanics Part I: Anisotropic Hyperelasticitycited by 49
  38. 2020Physics-Informed Neural Network for Modelling the Thermochemical Curing Process of Composite-Tool Systems During Manufacturecited by 48

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 18; 2025: 22; 2026: 14.

61 papers.

Sort:

By area:

  1. 2024PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systemscited by 18
  2. 2024P2C2Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamicscited by 13
  3. 2023Physics-aware Machine Learning Revolutionizes Scientific Paradigm for Machine Learning and Process-based Hydrologycited by 11
  4. 2024PiRD: Physics-informed Residual Diffusion for Flow Field Reconstructioncited by 10
  5. 2023PGODE: Towards High-quality System Dynamics Modelingcited by 7
  6. 2024Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Methodcited by 7
  7. 2023Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equationscited by 6
  8. 2024Spectral Informed Neural Network: An Efficient and Low-Memory PINNcited by 6
  9. 2023DCEM: A deep complementary energy method for solid mechanicscited by 5
  10. 2023Evolutionary Optimization of Physics-Informed Neural Networks: Advancing Generalizability by the Baldwin Effectcited by 5
  11. 2025PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systemscited by 5
  12. 2024PAPM: A Physics-aware Proxy Model for Process Systemscited by 4
38 more
  1. 2024Conservation-informed Graph Learning for Spatiotemporal Dynamics Predictioncited by 4
  2. 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulationcited by 4
  3. 2024Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularizationcited by 3
  4. 2025MultiPDENet: PDE-embedded Learning with Multi-time-stepping for Accelerated Flow Simulationcited by 3
  5. 2025PINP: Physics-Informed Neural Predictor with latent estimation of fluid flowscited by 3
  6. 2024Closed-form Solutions: A New Perspective on Solving Differential Equationscited by 2
  7. 2026Out-of-distribution generalization of deep-learning surrogates for 2D PDE-generated dynamics in the small-data regimecited by 2
  8. 2023DSAF: A Dual-Stage Adaptive Framework for Numerical Weather Prediction Downscalingcited by 1
  9. 2024A Physics-embedded Deep Learning Framework for Cloth Simulationcited by 1
  10. 2024Physics-embedded Fourier Neural Network for Partial Differential Equationscited by 1
  11. 2024Spatiotemporal Graph Learning with Direct Volumetric Information Passing and Feature Enhancementcited by 1
  12. 2024Implicit factorized transformer approach to fast prediction of turbulent channel flowscited by 1
  13. 2025PIMRL: Physics-Informed Multi-Scale Recurrent Learning for Burst-Sampled Spatiotemporal Dynamicscited by 1
  14. 2025Spectral-inspired Operator Learning with Limited Data and Unknown Physicscited by 1
  15. 2025PMNO: A novel physics guided multi-step neural operator predictor for partial differential equationscited by 1
  16. 2025Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flowscited by 1
  17. 2025Towards Generalizable PDE Dynamics Forecasting via Physics-Guided Invariant Learningcited by 1
  18. 2025Learnable Fractional Reaction-Diffusion Dynamics for Under-Display ToF Imaging and Beyondcited by 1
  19. 2025Physically consistent model learning for reaction-diffusion systemscited by 1
  20. 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimizationcited by 1
  21. 2026Physics-Informed Modeling for Wood Thermal Analysis and Predictioncited by 1
  22. 2023Crack-Net: Prediction of Crack Propagation in Compositescited by 0
  23. 2024A Novel Paradigm in Solving Multiscale Problemscited by 0
  24. 2024Machine Learning-Assisted Thermoelectric Cooling for On-Demand Multi-Hotspot Thermal Managementcited by 0
  25. 2024Vision-based Discovery of Nonlinear Dynamics for 3D Moving Targetcited by 0
  26. 2024Discovery and inversion of the viscoelastic wave equation in inhomogeneous mediacited by 0
  27. 2024NeuralMAG: Fast and Generalizable Micromagnetic Simulation with Deep Neural Netscited by 0
  28. 2025Over-PINNs: Enhancing Physics-Informed Neural Networks via Higher-Order Partial Derivative Overdetermination of PDEscited by 0
  29. 2025OmniFluids: Physics Pre-trained Modeling of Fluid Dynamicscited by 0
  30. 2025Using Deep Operators to Create Spatio-temporal Surrogates for Dynamical Systems under Uncertaintycited by 0
  31. 2025LFR-PINO: A Layered Fourier Reduced Physics-Informed Neural Operator for Parametric PDEscited by 0
  32. 2025Data-Driven Discovery of Emergent Dynamics in Reaction-Diffusion Systems from Sparse and Noisy Observationscited by 0
  33. 2025MNO: Multiscale Neural Operator for 3D Computational Fluid Dynamicscited by 0
  34. 2025Efficient High-Accuracy PDEs Solver with the Linear Attention Neural Operatorcited by 0
  35. 2025HPC-Driven Modeling with ML-Based Surrogates for Magnon-Photon Dynamics in Hybrid Quantum Systemscited by 0
  36. 2025Unlocking Out-of-Distribution Generalization in Dynamics through Physics-Guided Augmentationcited by 0
  37. 2025IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimationcited by 0
  38. 2025Stable spectral neural operator for learning stiff PDE systems from limited datacited by 0

50 most cited of 61 All 61 (JSON)