mlsanityData to 7 Oct 2026

Hard Encoding of Physics for Learning Spatiotemporal Dynamics

arXiv 2105.00557 ↗First posted 2 May 2021cs.LG cs.AI physics.comp-phcited by 8

Not on the map. Why?

Abstract (arXiv)

Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and epidemiology, remains uncertain or partially unknown, where very limited measurement data is yet available. To tackle this challenge, we propose a novel deep learning architecture that forcibly encodes known physics knowledge to facilitate learning in a data-driven manner. The coercive encoding mechanism of physics, which is fundamentally different from the penalty-based physics-informed learning, ensures the network to rigorously obey given physics. Instead of using nonlinear activation functions, we propose a novel elementwise product operation to achieve the nonlinearity of the model. Numerical experiment demonstrates that the resulting physics-encoded learning paradigm possesses remarkable robustness against data noise/scarcity and generalizability compared with some state-of-the-art models for data-driven modeling.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 2 May 2021.

Builds on

23 of 29 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  4. 2013Network In Networkcited by 600
  5. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  6. 2017PDE-Net: Learning PDEs from Datacited by 304
  7. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  8. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  9. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  10. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  11. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  12. 2017Detail-revealing Deep Video Super-resolutioncited by 147
11 more
  1. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  2. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  3. 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
  4. 2018Deep Learning of Vortex Induced Vibrationscited by 74
  5. 2017Dual Motion GAN for Future-Flow Embedded Video Predictioncited by 69
  6. 2017Multi-level Residual Networks from Dynamical Systems Viewcited by 59
  7. 2020Physics-informed deep learning for incompressible laminar flowscited by 54
  8. 2016Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortexcited by 42
  9. 2020DiscretizationNet: A Machine-Learning based solver for Navier-Stokes Equations using Finite Volume Discretizationcited by 35
  10. 2015On learning optimized reaction diffusion processes for effective image restorationcited by 25
  11. 2018HybridNet: Integrating Model-based and Data-driven Learning to Predict Evolution of Dynamical Systemscited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 2; 2025: 1; 2026: 2.

8 papers.