Neural Relational Inference for Interacting Systems
Not on the map. Why?
Abstract (arXiv)
Interacting systems are prevalent in nature, from dynamical systems in physics to complex societal dynamics. The interplay of components can give rise to complex behavior, which can often be explained using a simple model of the system's constituent parts. In this work, we introduce the neural relational inference (NRI) model: an unsupervised model that learns to infer interactions while simultaneously learning the dynamics purely from observational data. Our model takes the form of a variational auto-encoder, in which the latent code represents the underlying interaction graph and the reconstruction is based on graph neural networks. In experiments on simulated physical systems, we show that our NRI model can accurately recover ground-truth interactions in an unsupervised manner. We further demonstrate that we can find an interpretable structure and predict complex dynamics in real motion capture and sports tracking data.
Key facts. Cited by 339 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 85; 2022: 81; 2023: 66; 2024: 53; 2025: 24; 2026: 28.
339 papers.
Sort:
By area:
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 270
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2021Towards Causal Representation Learningcited by 209
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2021Multi-Task Reinforcement Learning with Context-based Representationscited by 174
- 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 171
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
38 more
- 2022Equivariance with Learned Canonicalization Functionscited by 109
- 2022Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvaturecited by 98
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2021Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networkscited by 95
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2022Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 85
- 2023Everything is Connected: Graph Neural Networkscited by 85
- 2021Beltrami Flow and Neural Diffusion on Graphscited by 84
- 2021Neural Production Systems: Learning Rule-Governed Visual Dynamicscited by 75
- 2023A Comprehensive Survey on Deep Graph Representation Learningcited by 72
- 2021Cross-Node Federated Graph Neural Network for Spatio-Temporal Data Modelingcited by 69
- 2022A Survey on Deep Graph Generation: Methods and Applicationscited by 69
- 2022Equivariant Graph Mechanics Networks with Constraintscited by 68
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 65
- 2022ComPhy: Compositional Physical Reasoning of Objects and Events from Videoscited by 63
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2021ForceNet: A Graph Neural Network for Large-Scale Quantum Calculationscited by 58
- 2022Geometrically Equivariant Graph Neural Networks: A Surveycited by 56
- 2021Learning latent causal graphs via mixture oraclescited by 55
- 2023Clifford Group Equivariant Neural Networkscited by 55
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
- 2022Message passing all the way upcited by 47
- 2021Interpretable Models for Granger Causality Using Self-explaining Neural Networkscited by 45
- 2022MoCoDA: Model-based Counterfactual Data Augmentationcited by 44
- 2021Spatial Dual-Modality Graph Reasoning for Key Information Extractioncited by 43
- 2022Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecastingcited by 42
- 2022Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Seriescited by 42
- 2021Relating Graph Neural Networks to Structural Causal Modelscited by 41
- 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Spacecited by 41
- 2021Automated Machine Learning on Graphs: A Surveycited by 39
- 2022Learning Physical Dynamics with Subequivariant Graph Neural Networkscited by 39
- 2024Equivariant Graph Neural Operator for Modeling 3D Dynamicscited by 38
- 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 37
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
- 2022Is a Modular Architecture Enough?cited by 36
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
- 2021Transformers Generalize DeepSets and Can be Extended to Graphs and Hypergraphscited by 35
- 2022Multi-modal Graph Learning for Disease Predictioncited by 34
50 most cited of 339 All 339 (JSON)
- 2026Abductive World Modeling via Causal Representation Learning29 Sep 2026
- 2026ALICE: In-context, Zero-shot, Mutual Information Estimation28 Sep 2026
- 2026Adaptive Interaction Graphs for Particle Simulation25 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026Equivariance Breaks the Learning Rate8 Sep 2026
- 2026From topology learning to graph generation: A unifying perspective2 Sep 2026
- 2026LLMODE: Aligning ODEs with LLMs via Gated Token Injection for Irregular Spatio-Temporal Forecasting30 Aug 2026
- 2026Conservative Hybrid Graph Networks for Process Systems with Learned Routing28 Aug 2026
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphs28 Aug 2026
- 2026Planning as Emergent Behavior in Reinforcement Learning with Relational Hidden States20 Jul 2026
- 2026BubbleSH: A Dataset of Rising Bubbles with Deformable Interfaces8 Jul 2026
- 2026APT: Atomic Physical Transitions for Causal Video-Language Understanding17 Jun 2026
38 more
- 2026NetCause: Counterfactual Learning for Root Cause Analysis in Large-Scale Networks11 Jun 2026
- 2026DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace10 Jun 2026
- 2026AugRelNet: Relation-Augmented Dynamics for Structure Discovery and Forecasting from Limited Data8 Jun 2026
- 2026Graph Mamba Operator: A Latent Simulator for Interacting Particle Systems8 Jun 2026
- 2026When Are Neural Interaction Discoveries Real? Identifiability, Recoverability, and a Pre-Fit Diagnostic7 Jun 2026
- 2026The Polynomial Counting Capabilities of Message Passing Neural Networks11 May 2026
- 2026On Observation Time for Recovering Latent Hawkes Networks8 May 2026
- 2026Time-varying Interaction Graph ODE for Dynamic Graph Representation Learning27 Apr 2026
- 2026Hamiltonian Graph Inference Networks: Joint structure discovery and dynamics prediction for lattice Hamiltonian systems from trajectory data26 Apr 2026
- 2026CausalVAE as a Plug-in for World Models: Towards Reliable Counterfactual Dynamics9 Apr 2026
- 2026Generalizing Dynamics Modeling More Easily from Representation Perspective24 Mar 2026
- 2026Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attention15 Mar 2026
- 2026Hebbian-Oscillatory Co-Learning21 Feb 2026
- 2026PhysicsAgentABM: Physics-Guided Generative Agent-Based Modeling5 Feb 2026
- 2026Learn from A Rationalist: Distilling Intermediate Interpretable Rationales30 Jan 2026
- 2026GraIP: A Benchmarking Framework For Neural Graph Inverse Problems26 Jan 2026
- 2025Gradient-Based Join Ordering18 Nov 2025
- 2025HEIR: Learning Graph-Based Motion Hierarchies30 Oct 2025
- 2025Simulation-free Structure Learning for Stochastic Population Dynamics18 Oct 2025
- 2025Physics-Informed High-order Graph Dynamics Identification Learning for Predicting Complex Networks Long-term Dynamics10 Oct 2025
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modeling5 Oct 2025
- 2025Beyond Softmax: A Natural Parameterization for Categorical Random Variables29 Sep 2025
- 2025JointDiff: Bridging Continuous and Discrete in Multi-Agent Trajectory Generation26 Sep 2025
- 2025Self-Supervised Discovery of Neural Circuits in Spatially Patterned Neural Responses with Graph Neural Networks21 Sep 2025
- 2025Automated discovery of finite volume schemes using Graph Neural Networks26 Aug 2025
- 2025Graph Concept Bottleneck Models19 Aug 2025
- 2025BLIPs: Bayesian Learned Interatomic Potentials19 Aug 2025
- 2025Root Cause Analysis of Hydrogen Bond Separation in Spatio-Temporal Molecular Dynamics using Causal Models17 Aug 2025
- 2025Towards Real-World Rumor Detection: Anomaly Detection Framework with Graph Supervised Contrastive Learning10 Aug 2025
- 2025Propagation Tree Is Not Deep: Adaptive Graph Contrastive Learning Approach for Rumor Detection10 Aug 2025
- 2025Graph Representation Learning with Massive Unlabeled Data for Rumor Detection6 Aug 2025
- 2025Signed Graph Learning: Algorithms and Theory13 Jul 2025
- 2025Robust Learning on Noisy Graphs via Latent Space Constraints with External Knowledge7 Jul 2025
- 2025GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapters2 Jul 2025
- 2025Fast and Distributed Equivariant Graph Neural Networks by Virtual Node Learning24 Jun 2025
- 2025Beyond Attention: Learning Spatio-Temporal Dynamics with Emergent Interpretable Topologies1 Jun 2025
- 2025Learning (Approximately) Equivariant Networks via Constrained Optimization19 May 2025
- 2025Localized Graph-Based Neural Dynamics Models for Terrain Manipulation30 Mar 2025
50 newest of 339 All 339 (JSON)
- 2023Learning Dynamic Attribute-factored World Models for Efficient Multi-object Reinforcement Learningcited by 15
- 2025Four Principles for Physically Interpretable World Modelscited by 10
- 2024Language Agents Meet Causality -- Bridging LLMs and Causal World Modelscited by 9
- 2022Factored World Models for Zero-Shot Generalization in Robotic Manipulationcited by 6
- 2024Slot Structured World Modelscited by 5
- 2026CausalVAE as a Plug-in for World Models: Towards Reliable Counterfactual Dynamicscited by 2
- 2026Abductive World Modeling via Causal Representation Learningcited by 0
- 2026Abductive World Modeling via Causal Representation Learning29 Sep 2026
- 2026CausalVAE as a Plug-in for World Models: Towards Reliable Counterfactual Dynamics9 Apr 2026
- 2025Four Principles for Physically Interpretable World Models4 Mar 2025
- 2024Language Agents Meet Causality -- Bridging LLMs and Causal World Models25 Oct 2024
- 2024Slot Structured World Models8 Jan 2024
- 2023Learning Dynamic Attribute-factored World Models for Efficient Multi-object Reinforcement Learning18 Jul 2023
- 2022Factored World Models for Zero-Shot Generalization in Robotic Manipulation10 Feb 2022
- 2022MoCoDA: Model-based Counterfactual Data Augmentationcited by 44
- 2023Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approachcited by 14
- 2021Multi-Agent Imitation Learning with Copulascited by 13
- 2019Relational Mimic for Visual Adversarial Imitation Learningcited by 0
- 2021SS-MAIL: Self-Supervised Multi-Agent Imitation Learningcited by 0
- 2023Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approach25 Apr 2023
- 2022MoCoDA: Model-based Counterfactual Data Augmentation20 Oct 2022
- 2021SS-MAIL: Self-Supervised Multi-Agent Imitation Learning18 Oct 2021
- 2021Multi-Agent Imitation Learning with Copulas10 Jul 2021
- 2019Relational Mimic for Visual Adversarial Imitation Learning18 Dec 2019
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 270
- 2024Geometric Trajectory Diffusion Modelscited by 15
- 2025GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapterscited by 1
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2025GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapters2 Jul 2025
- 2024Geometric Trajectory Diffusion Models16 Oct 2024
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modeling2 Mar 2020
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2021Towards Causal Representation Learningcited by 209
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2021Multi-Task Reinforcement Learning with Context-based Representationscited by 174
- 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 171
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
- 2022Equivariance with Learned Canonicalization Functionscited by 109
12 most cited of 318 All 318 (JSON)
- 2026ALICE: In-context, Zero-shot, Mutual Information Estimation28 Sep 2026
- 2026Adaptive Interaction Graphs for Particle Simulation25 Sep 2026
- 2026Equivariance Breaks the Learning Rate8 Sep 2026
- 2026From topology learning to graph generation: A unifying perspective2 Sep 2026
- 2026LLMODE: Aligning ODEs with LLMs via Gated Token Injection for Irregular Spatio-Temporal Forecasting30 Aug 2026
- 2026Conservative Hybrid Graph Networks for Process Systems with Learned Routing28 Aug 2026
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphs28 Aug 2026
- 2026BubbleSH: A Dataset of Rising Bubbles with Deformable Interfaces8 Jul 2026
- 2026APT: Atomic Physical Transitions for Causal Video-Language Understanding17 Jun 2026
- 2026NetCause: Counterfactual Learning for Root Cause Analysis in Large-Scale Networks11 Jun 2026
- 2026DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace10 Jun 2026
- 2026AugRelNet: Relation-Augmented Dynamics for Structure Discovery and Forecasting from Limited Data8 Jun 2026
12 newest of 318 All 318 (JSON)