Relaxing Continuous Constraints of Equivariant Graph Neural Networks for Physical Dynamics Learning
Not on the map. Why?
Abstract (arXiv)
Incorporating Euclidean symmetries (e.g. rotation equivariance) as inductive biases into graph neural networks has improved their generalization ability and data efficiency in unbounded physical dynamics modeling. However, in various scientific and engineering applications, the symmetries of dynamics are frequently discrete due to the boundary conditions. Thus, existing GNNs either overlook necessary symmetry, resulting in suboptimal representation ability, or impose excessive equivariance, which fails to generalize to unobserved symmetric dynamics. In this work, we propose a general Discrete Equivariant Graph Neural Network (DEGNN) that guarantees equivariance to a given discrete point group. Specifically, we show that such discrete equivariant message passing could be constructed by transforming geometric features into permutation-invariant embeddings. Through relaxing continuous equivariant constraints, DEGNN can employ more geometric feature combinations to approximate unobserved physical object interaction functions. Two implementation approaches of DEGNN are proposed based on ranking or pooling permutation-invariant functions. We apply DEGNN to various physical dynamics, ranging from particle, molecular, crowd to vehicle dynamics. In twenty scenarios, DEGNN significantly outperforms existing state-of-the-art approaches. Moreover, we show that DEGNN is data efficient, learning with less data, and can generalize across scenarios such as unobserved orientation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 54 references that are in the map. First posted on arXiv 24 Jun 2024.
Builds on
29 of 54 references.
References · 29
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
17 more
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2020Machine Learning Force Fieldscited by 204
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 84
- 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
- 2022Equivariant Graph Mechanics Networks with Constraintscited by 67
- 2019Equivariant Flows: sampling configurations for multi-body systems with symmetric energiescited by 57
- 2023SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biasescited by 27
- 2023Generalizing Graph ODE for Learning Complex System Dynamics across Environmentscited by 23
- 2020Modelling High-Order Social Relations for Item Recommendationcited by 13
- 2020Hierarchical Graph Capsule Networkcited by 11
- 2023Spatial Attention Kinetic Networks with E(n)-Equivariancecited by 11
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignmentcited by 10
- 2022Human Mobility Modeling During the COVID-19 Pandemic via Deep Graph Diffusion Infomaxcited by 8
- 2024Deep Reinforcement Learning for Modelling Protein Complexescited by 5
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Relaxed Equivariance via Multitask Learningcited by 13
- 2024Relaxed Equivariance via Multitask Learning23 Oct 2024