VAIN: Attentional Multi-agent Predictive Modeling
Not on the map. Why?
Abstract (arXiv)
Multi-agent predictive modeling is an essential step for understanding physical, social and team-play systems. Recently, Interaction Networks (INs) were proposed for the task of modeling multi-agent physical systems, INs scale with the number of interactions in the system (typically quadratic or higher order in the number of agents). In this paper we introduce VAIN, a novel attentional architecture for multi-agent predictive modeling that scales linearly with the number of agents. We show that VAIN is effective for multi-agent predictive modeling. Our method is evaluated on tasks from challenging multi-agent prediction domains: chess and soccer, and outperforms competing multi-agent approaches.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 18; 2022: 12; 2023: 11; 2024: 4; 2025: 4; 2026: 1.
51 papers.
Sort:
By area:
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2021Spatial Dual-Modality Graph Reasoning for Key Information Extractioncited by 43
- 2021Spatio-Temporal Dynamic Inference Network for Group Activity Recognitioncited by 42
- 2025Multi-Agent Coordination across Diverse Applications: A Surveycited by 37
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
38 more
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 34
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2021Conditional Neural Relational Inference for Interacting Systemscited by 28
- 2023A Review of Cooperation in Multi-agent Learningcited by 27
- 2022Latent Graph Inference using Product Manifoldscited by 23
- 2023From Latent Graph to Latent Topology Inference: Differentiable Cell Complex Modulecited by 19
- 2021Multi-Agent Imitation Learning with Copulascited by 13
- 2021Neural Relational Inference with Efficient Message Passing Mechanismscited by 10
- 2021Iterative SE(3)-Transformerscited by 10
- 2022Collaborative Perception for Autonomous Driving: Current Status and Future Trendcited by 10
- 2025mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Frameworkcited by 9
- 2021Time-series Imputation of Temporally-occluded Multiagent Trajectoriescited by 7
- 2022FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systemscited by 7
- 2022Concentration Network for Reinforcement Learning of Large-Scale Multi-Agent Systemscited by 7
- 2023Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Controlcited by 7
- 2021Data-driven Analysis for Understanding Team Sports Behaviorscited by 6
- 2021Grounded Relational Inference: Domain Knowledge Driven Explainable Autonomous Drivingcited by 6
- 2022CTRMs: Learning to Construct Cooperative Timed Roadmaps for Multi-agent Path Planning in Continuous Spacescited by 6
- 2022Graph Neural Networks to Predict Sports Outcomescited by 6
- 2023Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometriescited by 6
- 2025ClusterViG: Efficient Globally Aware Vision GNNs via Image Partitioningcited by 6
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral modelscited by 5
- 2023Causal-Based Supervision of Attention in Graph Neural Network: A Better and Simpler Choice towards Powerful Attentioncited by 5
- 2024Slot Structured World Modelscited by 5
- 2024The Bandit Whisperer: Communication Learning for Restless Banditscited by 5
- 2021Interpreting Depression From Question-wise Long-term Video Recording of SDS Evaluationcited by 4
- 2022Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Networkcited by 3
- 2021Discovering Latent Representations of Relations for Interacting Systemscited by 1
- 2022LearningGroup: A Real-Time Sparse Training on FPGA via Learnable Weight Grouping for Multi-Agent Reinforcement Learningcited by 1
- 2023Guided Image-to-Image Translation by Discriminator-Generator Communicationcited by 1
- 2023Social Occlusion Inference with Vectorized Representation for Autonomous Drivingcited by 1
- 2023Automated interpretation of congenital heart disease from multi-view echocardiogramscited by 1
- 2019Relational Mimic for Visual Adversarial Imitation Learningcited by 0
- 2021Soft Attention: Does it Actually Help to Learn Social Interactions in Pedestrian Trajectory Prediction?cited by 0
- 2022PooL: Pheromone-inspired Communication Framework forLarge Scale Multi-Agent Reinforcement Learningcited by 0
- 2023QMNet: Importance-Aware Message Exchange for Decentralized Multi-Agent Reinforcement Learningcited by 0
- 2024Battery GraphNets : Relational Learning for Lithium-ion Batteries(LiBs) Life Estimationcited by 0
- 2025Graph Attention for Heterogeneous Graphs with Positional Encodingcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Communication-Aware Multi-Agent Reinforcement Learning for Decentralized Cooperative UAV Deployment17 Mar 2026
- 2025Graph Attention for Heterogeneous Graphs with Positional Encoding3 Apr 2025
- 2025Multi-Agent Coordination across Diverse Applications: A Survey20 Feb 2025
- 2025mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework21 Jan 2025
- 2025ClusterViG: Efficient Globally Aware Vision GNNs via Image Partitioning18 Jan 2025
- 2024Battery GraphNets : Relational Learning for Lithium-ion Batteries(LiBs) Life Estimation14 Aug 2024
- 2024The Bandit Whisperer: Communication Learning for Restless Bandits11 Aug 2024
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions17 May 2024
- 2024Slot Structured World Models8 Jan 2024
- 2023A Review of Cooperation in Multi-agent Learning8 Dec 2023
- 2023Automated interpretation of congenital heart disease from multi-view echocardiograms30 Nov 2023
- 2023Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries23 Oct 2023
38 more
- 2023Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control3 Oct 2023
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception26 Jul 2023
- 2023QMNet: Importance-Aware Message Exchange for Decentralized Multi-Agent Reinforcement Learning18 Jul 2023
- 2023From Latent Graph to Latent Topology Inference: Differentiable Cell Complex Module25 May 2023
- 2023Causal-Based Supervision of Attention in Graph Neural Network: A Better and Simpler Choice towards Powerful Attention22 May 2023
- 2023Social Occlusion Inference with Vectorized Representation for Autonomous Driving18 Mar 2023
- 2023Guided Image-to-Image Translation by Discriminator-Generator Communication7 Mar 2023
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges16 Jan 2023
- 2022Latent Graph Inference using Product Manifolds26 Nov 2022
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregation3 Nov 2022
- 2022LearningGroup: A Real-Time Sparse Training on FPGA via Learnable Weight Grouping for Multi-Agent Reinforcement Learning29 Oct 2022
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Maps26 Sep 2022
- 2022Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Network28 Aug 2022
- 2022Collaborative Perception for Autonomous Driving: Current Status and Future Trend22 Aug 2022
- 2022Graph Neural Networks to Predict Sports Outcomes28 Jul 2022
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goes27 Apr 2022
- 2022Concentration Network for Reinforcement Learning of Large-Scale Multi-Agent Systems12 Mar 2022
- 2022PooL: Pheromone-inspired Communication Framework forLarge Scale Multi-Agent Reinforcement Learning20 Feb 2022
- 2022FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systems28 Jan 2022
- 2022CTRMs: Learning to Construct Cooperative Timed Roadmaps for Multi-agent Path Planning in Continuous Spaces24 Jan 2022
- 2021Discovering Latent Representations of Relations for Interacting Systems10 Nov 2021
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perception1 Nov 2021
- 2021Spatio-Temporal Dynamic Inference Network for Group Activity Recognition26 Aug 2021
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecasting3 Aug 2021
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral models12 Jul 2021
- 2021Multi-Agent Imitation Learning with Copulas10 Jul 2021
- 2021Interpreting Depression From Question-wise Long-term Video Recording of SDS Evaluation25 Jun 2021
- 2021Conditional Neural Relational Inference for Interacting Systems21 Jun 2021
- 2021Soft Attention: Does it Actually Help to Learn Social Interactions in Pedestrian Trajectory Prediction?16 Jun 2021
- 2021Time-series Imputation of Temporally-occluded Multiagent Trajectories8 Jun 2021
- 2021How Attentive are Graph Attention Networks?30 May 2021
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges27 Apr 2021
- 2021Spatial Dual-Modality Graph Reasoning for Key Information Extraction26 Mar 2021
- 2021Iterative SE(3)-Transformers26 Feb 2021
- 2021Grounded Relational Inference: Domain Knowledge Driven Explainable Autonomous Driving23 Feb 2021
- 2021Data-driven Analysis for Understanding Team Sports Behaviors15 Feb 2021
- 2021Neural Relational Inference with Efficient Message Passing Mechanisms23 Jan 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
50 newest of 51 All 51 (JSON)
- 2021Multi-Agent Imitation Learning with Copulascited by 13
- 2019Relational Mimic for Visual Adversarial Imitation Learningcited by 0
- 2021Multi-Agent Imitation Learning with Copulas10 Jul 2021
- 2019Relational Mimic for Visual Adversarial Imitation Learning18 Dec 2019
- 2024Slot Structured World Modelscited by 5
- 2024Slot Structured World Models8 Jan 2024
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2021Spatial Dual-Modality Graph Reasoning for Key Information Extractioncited by 43
- 2021Spatio-Temporal Dynamic Inference Network for Group Activity Recognitioncited by 42
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 34
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2021Conditional Neural Relational Inference for Interacting Systemscited by 28
12 most cited of 45 All 45 (JSON)
- 2026Communication-Aware Multi-Agent Reinforcement Learning for Decentralized Cooperative UAV Deployment17 Mar 2026
- 2025Graph Attention for Heterogeneous Graphs with Positional Encoding3 Apr 2025
- 2025mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework21 Jan 2025
- 2025ClusterViG: Efficient Globally Aware Vision GNNs via Image Partitioning18 Jan 2025
- 2024Battery GraphNets : Relational Learning for Lithium-ion Batteries(LiBs) Life Estimation14 Aug 2024
- 2024The Bandit Whisperer: Communication Learning for Restless Bandits11 Aug 2024
- 2023A Review of Cooperation in Multi-agent Learning8 Dec 2023
- 2023Automated interpretation of congenital heart disease from multi-view echocardiograms30 Nov 2023
- 2023Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries23 Oct 2023
- 2023Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control3 Oct 2023
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception26 Jul 2023
- 2023QMNet: Importance-Aware Message Exchange for Decentralized Multi-Agent Reinforcement Learning18 Jul 2023
12 newest of 45 All 45 (JSON)