Hard Encoding of Physics for Learning Spatiotemporal Dynamics
Not on the map. Why?
Abstract (arXiv)
Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and epidemiology, remains uncertain or partially unknown, where very limited measurement data is yet available. To tackle this challenge, we propose a novel deep learning architecture that forcibly encodes known physics knowledge to facilitate learning in a data-driven manner. The coercive encoding mechanism of physics, which is fundamentally different from the penalty-based physics-informed learning, ensures the network to rigorously obey given physics. Instead of using nonlinear activation functions, we propose a novel elementwise product operation to achieve the nonlinearity of the model. Numerical experiment demonstrates that the resulting physics-encoded learning paradigm possesses remarkable robustness against data noise/scarcity and generalizability compared with some state-of-the-art models for data-driven modeling.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 2 May 2021.
Builds on
23 of 29 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2013Network In Networkcited by 600
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
- 2017Detail-revealing Deep Video Super-resolutioncited by 147
11 more
- 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
- 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
- 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
- 2018Deep Learning of Vortex Induced Vibrationscited by 74
- 2017Dual Motion GAN for Future-Flow Embedded Video Predictioncited by 69
- 2017Multi-level Residual Networks from Dynamical Systems Viewcited by 59
- 2020Physics-informed deep learning for incompressible laminar flowscited by 54
- 2016Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortexcited by 42
- 2020DiscretizationNet: A Machine-Learning based solver for Navier-Stokes Equations using Finite Volume Discretizationcited by 35
- 2015On learning optimized reaction diffusion processes for effective image restorationcited by 25
- 2018HybridNet: Integrating Model-based and Data-driven Learning to Predict Evolution of Dynamical Systemscited by 21
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 2; 2025: 1; 2026: 2.
8 papers.
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
- 2023Domain decomposition-based coupling of physics-informed neural networks via the Schwarz alternating methodcited by 9
- 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Expertscited by 9
- 2025When do World Models Successfully Learn Dynamical Systems?cited by 3
- 2024Dynamics-Encoded Deep Learning for Robust System Identification and Parameter Estimationcited by 0
- 2026Physics-Encoded Inverse Modeling for Arctic Snow Depth Estimationcited by 0
- 2026Neural Operator based Multi-Field Reconstruction of Inner Solar Boundary Statecited by 0
- 2026Neural Operator based Multi-Field Reconstruction of Inner Solar Boundary State24 Aug 2026
- 2026Physics-Encoded Inverse Modeling for Arctic Snow Depth Estimation23 Jan 2026
- 2025When do World Models Successfully Learn Dynamical Systems?7 Jul 2025
- 2024Dynamics-Encoded Deep Learning for Robust System Identification and Parameter Estimation5 Oct 2024
- 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Experts6 Feb 2024
- 2023Domain decomposition-based coupling of physics-informed neural networks via the Schwarz alternating method1 Nov 2023
- 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computing14 Nov 2022
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs26 Jun 2021