Learning Attentional Communication for Multi-Agent Cooperation
Not on the map. Why?
Abstract (arXiv)
Communication could potentially be an effective way for multi-agent cooperation. However, information sharing among all agents or in predefined communication architectures that existing methods adopt can be problematic. When there is a large number of agents, agents cannot differentiate valuable information that helps cooperative decision making from globally shared information. Therefore, communication barely helps, and could even impair the learning of multi-agent cooperation. Predefined communication architectures, on the other hand, restrict communication among agents and thus restrain potential cooperation. To tackle these difficulties, in this paper, we propose an attentional communication model that learns when communication is needed and how to integrate shared information for cooperative decision making. Our model leads to efficient and effective communication for large-scale multi-agent cooperation. Empirically, we show the strength of our model in a variety of cooperative scenarios, where agents are able to develop more coordinated and sophisticated strategies than existing methods.
Key facts. Cited by 170 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 43; 2023: 34; 2024: 23; 2025: 21; 2026: 22.
170 papers.
Sort:
By area:
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2021Cooperative Exploration for Multi-Agent Deep Reinforcement Learningcited by 57
- 2021Contrasting Centralized and Decentralized Critics in Multi-Agent Reinforcement Learningcited by 54
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulationcited by 49
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 47
38 more
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 34
- 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
- 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 30
- 2022A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learningcited by 28
- 2022Challenges and Opportunities in Deep Reinforcement Learning with Graph Neural Networks: A Comprehensive review of Algorithms and Applicationscited by 27
- 2023A Review of Cooperation in Multi-agent Learningcited by 27
- 2021Variational Automatic Curriculum Learning for Sparse-Reward Cooperative Multi-Agent Problemscited by 25
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 24
- 2021Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learningcited by 20
- 2021GridToPix: Training Embodied Agents with Minimal Supervisioncited by 20
- 2021Learning Efficient Multi-Agent Cooperative Visual Explorationcited by 19
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Collaborative Visual Navigationcited by 18
- 2021Mis-spoke or mis-lead: Achieving Robustness in Multi-Agent Communicative Reinforcement Learningcited by 18
- 2023Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?cited by 18
- 2023Asynchronous Multi-Agent Reinforcement Learning for Efficient Real-Time Multi-Robot Cooperative Explorationcited by 17
- 2022An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobilitycited by 16
- 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
- 2024Generative Emergent Communication: Large Language Model is a Collective World Modelcited by 15
- 2022Multi-Agent Policy Transfer via Task Relationship Modelingcited by 14
- 2022Multi-Agent Coordination via Multi-Level Communicationcited by 14
- 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
- 2023Context-aware Communication for Multi-agent Reinforcement Learningcited by 13
- 2022Value Functions Factorization with Latent State Information Sharing in Decentralized Multi-Agent Policy Gradientscited by 12
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2024CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperationcited by 12
- 2021Learning Emergent Discrete Message Communication for Cooperative Reinforcement Learningcited by 11
- 2022Adaptive Discrete Communication Bottlenecks with Dynamic Vector Quantizationcited by 11
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 11
- 2022Policy Diagnosis via Measuring Role Diversity in Cooperative Multi-agent RLcited by 11
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
- 2021Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid Worldcited by 10
- 2022Collaborative Perception for Autonomous Driving: Current Status and Future Trendcited by 10
- 2022Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learningcited by 10
- 2022Agent-Temporal Attention for Reward Redistribution in Episodic Multi-Agent Reinforcement Learningcited by 9
- 2022DACOM: Learning Delay-Aware Communication for Multi-Agent Reinforcement Learningcited by 9
50 most cited of 170 All 170 (JSON)
- 2026Emergent Specialization in Populations of Self-Supervised Collaborative Vision Experts Without a Shared Gate or Cross-Agent Gradients29 Sep 2026
- 2026Evolutionary Stability Does Not Guarantee Learning Accessibility: A Multi-Agent Reinforcement Learning Perspective on Cooperation Emergence23 Sep 2026
- 2026Robust and Efficient Communication for Multi-Agent Learning14 Sep 2026
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Loss20 Jul 2026
- 2026Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning12 Jul 2026
- 2026HiComm: Hierarchical Communication for Multi-agent Reinforcement Learning28 Jun 2026
- 2026MASK: Multi-Agent Semantic K-Scheduling for Risk-Sensitive 6G Robotics8 Jun 2026
- 2026Network Distributed Multi-Agent Reinforcement Learning for Consensus Control of Quadcopters1 Jun 2026
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus1 Jun 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning17 May 2026
- 2026Agent-GWO: Collaborative Agents for Dynamic Prompt Optimization in Large Language Models14 Apr 2026
38 more
- 2026Evaluating Cooperation in LLM Social Groups through Elected Leadership13 Apr 2026
- 2026Communication Gain and Delay Cost Under Cross-Timestep Delays in Cooperative Multi-Agent Reinforcement Learning4 Apr 2026
- 2026Cascade-Aware Multi-Agent Routing: Spatio-Temporal Sidecars and Geometry-Switching17 Mar 2026
- 2026Interference-Aware K-Step Reachable Communication in Multi-Agent Reinforcement Learning16 Mar 2026
- 2026A Semi-Decentralized Approach to Multiagent Control12 Mar 2026
- 2026SCoUT: Scalable Communication via Utility-Guided Temporal Grouping in Multi-Agent Reinforcement Learning5 Mar 2026
- 2026GlobeDiff: State Diffusion Process for Partial Observability in Multi-Agent Systems17 Feb 2026
- 2026Spatiotemporal Decision Transformer for Traffic Coordination2 Feb 2026
- 2026Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantization2 Feb 2026
- 2026Communication Methods in Multi-Agent Reinforcement Learning19 Jan 2026
- 2025Bandwidth-constrained Variational Message Encoding for Cooperative Multi-agent Reinforcement Learning11 Dec 2025
- 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interaction17 Nov 2025
- 2025Goal-Oriented Multi-Agent Reinforcement Learning for Decentralized Agent Teams15 Nov 2025
- 2025Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling for Strategic Multiagent Settings13 Nov 2025
- 2025A Negotiation-Based Multi-Agent Reinforcement Learning Approach for Dynamic Scheduling of Reconfigurable Manufacturing Systems11 Nov 2025
- 2025On the Fundamental Limitations of Decentralized Learnable Reward Shaping in Cooperative Multi-Agent Reinforcement Learning27 Oct 2025
- 2025Unifying Agent Interaction and World Information for Multi-agent Coordination29 Sep 2025
- 2025Policy Compatible Skill Incremental Learning via Lazy Learning Interface24 Sep 2025
- 2025Hierarchical Message-Passing Policies for Multi-Agent Reinforcement Learning31 Jul 2025
- 2025Enhancing Multi-Agent Collaboration with Attention-Based Actor-Critic Policies30 Jul 2025
- 2025GenAI-based Multi-Agent Reinforcement Learning towards Distributed Agent Intelligence: A Generative-RL Agent Perspective13 Jul 2025
- 2025Ego-centric Learning of Communicative World Models for Autonomous Driving9 Jun 2025
- 2025Internet of Agents: Fundamentals, Applications, and Challenges12 May 2025
- 2025Interpretable Emergent Language Using Inter-Agent Transformers4 May 2025
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar 2025
- 2025Q-MARL: A quantum-inspired algorithm using neural message passing for large-scale multi-agent reinforcement learning10 Mar 2025
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learning27 Feb 2025
- 2025Reducing Variance Caused by Communication in Decentralized Multi-agent Deep Reinforcement Learning10 Feb 2025
- 2025Contextual Knowledge Sharing in Multi-Agent Reinforcement Learning with Decentralized Communication and Coordination26 Jan 2025
- 2025BMG-Q: Localized Bipartite Match Graph Attention Q-Learning for Ride-Pooling Order Dispatch23 Jan 2025
- 2025mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework21 Jan 2025
- 2024Generative Emergent Communication: Large Language Model is a Collective World Model31 Dec 2024
- 2024Tacit Learning with Adaptive Information Selection for Cooperative Multi-Agent Reinforcement Learning20 Dec 2024
- 2024CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperation7 Nov 2024
- 2024Communication Learning in Multi-Agent Systems from Graph Modeling Perspective1 Nov 2024
- 2024Cooperation and Fairness in Multi-Agent Reinforcement Learning19 Oct 2024
- 2024On Diffusion Models for Multi-Agent Partial Observability: Shared Attractors, Error Bounds, and Composite Flow17 Oct 2024
- 2024DCMAC: Demand-aware Customized Multi-Agent Communication via Upper Bound Training11 Sep 2024
50 newest of 170 All 170 (JSON)
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
- 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
- 2024CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperationcited by 12
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensuscited by 2
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus1 Jun 2026
- 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interaction17 Nov 2025
- 2025Internet of Agents: Fundamentals, Applications, and Challenges12 May 2025
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar 2025
- 2024CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperation7 Nov 2024
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions17 May 2024
- 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul 2023
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2021Cooperative Exploration for Multi-Agent Deep Reinforcement Learningcited by 57
- 2021Contrasting Centralized and Decentralized Critics in Multi-Agent Reinforcement Learningcited by 54
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulationcited by 49
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 47
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 34
- 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
12 most cited of 154 All 154 (JSON)
- 2026Emergent Specialization in Populations of Self-Supervised Collaborative Vision Experts Without a Shared Gate or Cross-Agent Gradients29 Sep 2026
- 2026Evolutionary Stability Does Not Guarantee Learning Accessibility: A Multi-Agent Reinforcement Learning Perspective on Cooperation Emergence23 Sep 2026
- 2026Robust and Efficient Communication for Multi-Agent Learning14 Sep 2026
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Loss20 Jul 2026
- 2026Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning12 Jul 2026
- 2026HiComm: Hierarchical Communication for Multi-agent Reinforcement Learning28 Jun 2026
- 2026MASK: Multi-Agent Semantic K-Scheduling for Risk-Sensitive 6G Robotics8 Jun 2026
- 2026Network Distributed Multi-Agent Reinforcement Learning for Consensus Control of Quadcopters1 Jun 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning17 May 2026
- 2026Evaluating Cooperation in LLM Social Groups through Elected Leadership13 Apr 2026
- 2026Communication Gain and Delay Cost Under Cross-Timestep Delays in Cooperative Multi-Agent Reinforcement Learning4 Apr 2026
12 newest of 154 All 154 (JSON)