Improving Long-Range Interactions in Graph Neural Simulators via Hamiltonian Dynamics
Not on the map. Why?
Abstract (arXiv)
Learning to simulate complex physical systems from data has emerged as a promising way to overcome the limitations of traditional numerical solvers, which often require prohibitive computational costs for high-fidelity solutions. Recent Graph Neural Simulators (GNSs) accelerate simulations by learning dynamics on graph-structured data, yet often struggle to capture long-range interactions and suffer from error accumulation under autoregressive rollouts. To address these challenges, we propose Information-preserving Graph Neural Simulators (IGNS), a graph-based neural simulator built on the principles of Hamiltonian dynamics. This structure guarantees preservation of information across the graph, while extending to port-Hamiltonian systems allows the model to capture a broader class of dynamics, including non-conservative effects. IGNS further incorporates a warmup phase to initialize global context, geometric encoding to handle irregular meshes, and a multi-step training objective that facilitates PDE matching, where the trajectory produced by integrating the port-Hamiltonian core aligns with the ground-truth trajectory, thereby reducing rollout error. To evaluate these properties systematically, we introduce new benchmarks that target long-range dependencies and challenging external forcing scenarios. Across all tasks, IGNS consistently outperforms state-of-the-art GNSs, achieving higher accuracy and stability under challenging and complex dynamical systems. Our project page: https://thobotics.github.io/neural_pde_matching.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 57 of its 75 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
57 of 75 references.
References · 57
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2019Hamiltonian Neural Networkscited by 712
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
38 more
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2019Diffusion Improves Graph Learningcited by 414
- 2022Message Passing Neural PDE Solverscited by 386
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 220
- 2019Graph Matching Networks for Learning the Similarity of Graph Structured Objectscited by 205
- 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 184
- 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 166
- 2019Graph Neural Ordinary Differential Equationscited by 154
- 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 145
- 2022Graph-Coupled Oscillator Networkscited by 124
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 85
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 84
- 2023RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Toolscited by 76
- 2021Port-Hamiltonian Neural Networks for Learning Explicit Time-Dependent Dynamical Systemscited by 67
- 2022Anti-Symmetric DGN: a stable architecture for Deep Graph Networkscited by 60
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 57
- 2023Locality-Aware Graph-Rewiring in GNNscited by 56
- 2020Learning continuous-time PDEs from sparse data with graph neural networkscited by 53
- 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 45
- 2025On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learningcited by 43
- 2024Oscillatory State-Space Modelscited by 39
- 2022Learning the Dynamics of Physical Systems from Sparse Observations with Finite Element Networkscited by 34
- 2024On Oversquashing in Graph Neural Networks Through the Lens of Dynamical Systemscited by 28
- 2024Long Range Propagation on Continuous-Time Dynamic Graphscited by 28
- 2023Exposition on over-squashing problem on GNNs: Current Methods, Benchmarks and Challengescited by 22
- 2023Deep learning for dynamic graphs: models and benchmarkscited by 19
- 2021Hamiltonian Deep Neural Networks Guaranteeing Non-vanishing Gradients by Designcited by 18
- 2023Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networkscited by 18
- 2023Learning Flexible Body Collision Dynamics with Hierarchical Contact Mesh Transformercited by 18
- 2023Neural Oscillators are Universalcited by 16
- 2024Port-Hamiltonian Architectural Bias for Long-Range Propagation in Deep Graph Networkscited by 16
- 2023Grounding Graph Network Simulators using Physical Sensor Observationscited by 15
- 2025Return of ChebNet: Understanding and Improving an Overlooked GNN on Long Range Taskscited by 12
- 2024Temporal Graph ODEs for Irregularly-Sampled Time Seriescited by 11
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RLcited by 2
- 2025CORGI: GNNs with Convolutional Residual Global Interactions for Lagrangian Simulationcited by 1
- 2026Mesh Based Simulations with Spatial and Temporal awarenesscited by 0
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulatorscited by 0
- 2026LEIA: Learned Environment for Interactive Architected Materialscited by 0
- 2026Mechanism-Aware Ensemble Conditioning for Data-Limited Emulation of Extreme Eventscited by 0
- 2026Mechanism-Aware Ensemble Conditioning for Data-Limited Emulation of Extreme Events25 Sep 2026
- 2026Trust-Region Diffusion Policies for Massively Parallel On-Policy RL13 Jun 2026
- 2026LEIA: Learned Environment for Interactive Architected Materials27 May 2026
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulators10 May 2026
- 2026Mesh Based Simulations with Spatial and Temporal awareness2 May 2026
- 2025CORGI: GNNs with Convolutional Residual Global Interactions for Lagrangian Simulation28 Nov 2025