Newton-Cotes Graph Neural Networks: On the Time Evolution of Dynamic Systems
Not on the map. Why?
Abstract (arXiv)
Reasoning system dynamics is one of the most important analytical approaches for many scientific studies. With the initial state of a system as input, the recent graph neural networks (GNNs)-based methods are capable of predicting the future state distant in time with high accuracy. Although these methods have diverse designs in modeling the coordinates and interacting forces of the system, we show that they actually share a common paradigm that learns the integration of the velocity over the interval between the initial and terminal coordinates. However, their integrand is constant w.r.t. time. Inspired by this observation, we propose a new approach to predict the integration based on several velocity estimations with Newton-Cotes formulas and prove its effectiveness theoretically. Extensive experiments on several benchmarks empirically demonstrate consistent and significant improvement compared with the state-of-the-art methods.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 53 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
29 of 53 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2016Layer Normalizationcited by 5,579
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
17 more
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2018Neural Relational Inference for Interacting Systemscited by 339
- 2016Ladder Variational Autoencoderscited by 315
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2016Exploring the Limits of Language Modelingcited by 172
- 2019Graph Neural Ordinary Differential Equationscited by 153
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2019Hamiltonian Graph Networks with ODE Integratorscited by 107
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2018Flexible Neural Representation for Physics Predictioncited by 91
- 2019Learning to Exploit Long-term Relational Dependencies in Knowledge Graphscited by 83
- 2017DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamicscited by 79
- 2014Grammar as a Foreign Languagecited by 70
- 2022Equivariant Graph Mechanics Networks with Constraintscited by 67
- 2019Equivariant Flows: sampling configurations for multi-body systems with symmetric energiescited by 57
- 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
- 2022Equivariant Graph Hierarchy-Based Neural Networkscited by 24
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.