mlsanityData to 7 Oct 2026

Physics-Informed Regularization for Domain-Agnostic Dynamical System Modeling

arXiv 2410.06366 ↗First posted 8 Oct 2024cs.LG cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Learning complex physical dynamics purely from data is challenging due to the intrinsic properties of systems to be satisfied. Incorporating physics-informed priors, such as in Hamiltonian Neural Networks (HNNs), achieves high-precision modeling for energy-conservative systems. However, real-world systems often deviate from strict energy conservation and follow different physical priors. To address this, we present a framework that achieves high-precision modeling for a wide range of dynamical systems from the numerical aspect, by enforcing Time-Reversal Symmetry (TRS) via a novel regularization term. It helps preserve energies for conservative systems while serving as a strong inductive bias for non-conservative, reversible systems. While TRS is a domain-specific physical prior, we present the first theoretical proof that TRS loss can universally improve modeling accuracy by minimizing higher-order Taylor terms in ODE integration, which is numerically beneficial to various systems regardless of their properties, even for irreversible systems. By integrating the TRS loss within neural ordinary differential equation models, the proposed model TREAT demonstrates superior performance on diverse physical systems. It achieves a significant 11.5% MSE improvement in a challenging chaotic triple-pendulum scenario, underscoring TREAT's broad applicability and effectiveness.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 8 Oct 2024.

Builds on

28 of 56 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2021E(n) Equivariant Graph Neural Networkscited by 951
  4. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  5. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  6. 2019Hamiltonian Neural Networkscited by 702
  7. 2020Heterogeneous Graph Transformercited by 581
  8. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  9. 2020Lagrangian Neural Networkscited by 388
  10. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  11. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
  12. 2019Graph Neural Ordinary Differential Equationscited by 153
16 more
  1. 2019Hamiltonian Graph Networks with ODE Integratorscited by 107
  2. 2019Graph Normalizing Flowscited by 103
  3. 2020Dissipative SymODEN: Encoding Hamiltonian Dynamics with Dissipation and Control into Deep Learningcited by 77
  4. 2017Reversible Architectures for Arbitrarily Deep Residual Neural Networkscited by 69
  5. 2020Learning Continuous System Dynamics from Irregularly-Sampled Partial Observationscited by 60
  6. 2019Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRIcited by 39
  7. 2019Neural Dynamics on Complex Networkscited by 38
  8. 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 37
  9. 2016A probabilistic model for the numerical solution of initial value problemscited by 32
  10. 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 27
  11. 2023Generalizing Graph ODE for Learning Complex System Dynamics across Environmentscited by 23
  12. 2020Time-Reversal Symmetric ODE Networkcited by 19
  13. 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systemscited by 16
  14. 2020Scalable Graph Networks for Particle Simulationscited by 8
  15. 2024Causal Graph ODE: Continuous Treatment Effect Modeling in Multi-agent Dynamical Systemscited by 8
  16. 2022ModLaNets: Learning Generalisable Dynamics via Modularity and Physical Inductive Biascited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 2.

9 papers.