Physics-Informed Regularization for Domain-Agnostic Dynamical System Modeling
Not on the map. Why?
Abstract (arXiv)
Learning complex physical dynamics purely from data is challenging due to the intrinsic properties of systems to be satisfied. Incorporating physics-informed priors, such as in Hamiltonian Neural Networks (HNNs), achieves high-precision modeling for energy-conservative systems. However, real-world systems often deviate from strict energy conservation and follow different physical priors. To address this, we present a framework that achieves high-precision modeling for a wide range of dynamical systems from the numerical aspect, by enforcing Time-Reversal Symmetry (TRS) via a novel regularization term. It helps preserve energies for conservative systems while serving as a strong inductive bias for non-conservative, reversible systems. While TRS is a domain-specific physical prior, we present the first theoretical proof that TRS loss can universally improve modeling accuracy by minimizing higher-order Taylor terms in ODE integration, which is numerically beneficial to various systems regardless of their properties, even for irreversible systems. By integrating the TRS loss within neural ordinary differential equation models, the proposed model TREAT demonstrates superior performance on diverse physical systems. It achieves a significant 11.5% MSE improvement in a challenging chaotic triple-pendulum scenario, underscoring TREAT's broad applicability and effectiveness.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 8 Oct 2024.
Builds on
28 of 56 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2019Hamiltonian Neural Networkscited by 702
- 2020Heterogeneous Graph Transformercited by 581
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
- 2020Lagrangian Neural Networkscited by 388
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
- 2019Graph Neural Ordinary Differential Equationscited by 153
16 more
- 2019Hamiltonian Graph Networks with ODE Integratorscited by 107
- 2019Graph Normalizing Flowscited by 103
- 2020Dissipative SymODEN: Encoding Hamiltonian Dynamics with Dissipation and Control into Deep Learningcited by 77
- 2017Reversible Architectures for Arbitrarily Deep Residual Neural Networkscited by 69
- 2020Learning Continuous System Dynamics from Irregularly-Sampled Partial Observationscited by 60
- 2019Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRIcited by 39
- 2019Neural Dynamics on Complex Networkscited by 38
- 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 37
- 2016A probabilistic model for the numerical solution of initial value problemscited by 32
- 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 27
- 2023Generalizing Graph ODE for Learning Complex System Dynamics across Environmentscited by 23
- 2020Time-Reversal Symmetric ODE Networkcited by 19
- 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systemscited by 16
- 2020Scalable Graph Networks for Particle Simulationscited by 8
- 2024Causal Graph ODE: Continuous Treatment Effect Modeling in Multi-agent Dynamical Systemscited by 8
- 2022ModLaNets: Learning Generalisable Dynamics via Modularity and Physical Inductive Biascited by 4
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 2.
9 papers.
- 2025Graph ODEs and Beyond: A Comprehensive Survey on Integrating Differential Equations with Graph Neural Networkscited by 14
- 2024Architecture-Aware Learning Curve Extrapolation via Graph Ordinary Differential Equationcited by 5
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulationcited by 4
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modelingcited by 2
- 2024Predicting Time Series of Networked Dynamical Systems without Knowing Topologycited by 1
- 2025GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapterscited by 1
- 2025Towards Generalizable PDE Dynamics Forecasting via Physics-Guided Invariant Learningcited by 1
- 2026Generalizing Dynamics Modeling More Easily from Representation Perspectivecited by 0
- 2026Time-varying Interaction Graph ODE for Dynamic Graph Representation Learningcited by 0
- 2026Time-varying Interaction Graph ODE for Dynamic Graph Representation Learning27 Apr 2026
- 2026Generalizing Dynamics Modeling More Easily from Representation Perspective24 Mar 2026
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modeling5 Oct 2025
- 2025Towards Generalizable PDE Dynamics Forecasting via Physics-Guided Invariant Learning29 Sep 2025
- 2025GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapters2 Jul 2025
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulation25 May 2025
- 2025Graph ODEs and Beyond: A Comprehensive Survey on Integrating Differential Equations with Graph Neural Networks29 Mar 2025
- 2024Predicting Time Series of Networked Dynamical Systems without Knowing Topology25 Dec 2024
- 2024Architecture-Aware Learning Curve Extrapolation via Graph Ordinary Differential Equation20 Dec 2024