Learning when to Communicate at Scale in Multiagent Cooperative and Competitive Tasks
Not on the map. Why?
Abstract (arXiv)
Learning when to communicate and doing that effectively is essential in multi-agent tasks. Recent works show that continuous communication allows efficient training with back-propagation in multi-agent scenarios, but have been restricted to fully-cooperative tasks. In this paper, we present Individualized Controlled Continuous Communication Model (IC3Net) which has better training efficiency than simple continuous communication model, and can be applied to semi-cooperative and competitive settings along with the cooperative settings. IC3Net controls continuous communication with a gating mechanism and uses individualized rewards foreach agent to gain better performance and scalability while fixing credit assignment issues. Using variety of tasks including StarCraft BroodWars explore and combat scenarios, we show that our network yields improved performance and convergence rates than the baselines as the scale increases. Our results convey that IC3Net agents learn when to communicate based on the scenario and profitability.
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 26; 2023: 26; 2024: 10; 2025: 13; 2026: 21.
114 papers.
Sort:
By area:
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2021Celebrating Diversity in Shared Multi-Agent Reinforcement Learningcited by 96
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Towards a Standardised Performance Evaluation Protocol for Cooperative MARLcited by 48
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 47
- 2025Multi-Agent Coordination across Diverse Applications: A Surveycited by 37
- 2021Learning Selective Communication for Multi-Agent Path Findingcited by 32
- 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
- 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
38 more
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 28
- 2023A Review of Cooperation in Multi-agent Learningcited by 27
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 24
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Collaborative Visual Navigationcited by 18
- 2021Mis-spoke or mis-lead: Achieving Robustness in Multi-Agent Communicative Reinforcement Learningcited by 18
- 2021Emergent Communication under Competitioncited by 17
- 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communicationcited by 17
- 2022An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobilitycited by 16
- 2021Self-Organized Polynomial-Time Coordination Graphscited by 14
- 2021Neurosymbolic Transformers for Multi-Agent Communicationcited by 13
- 2021Learning Emergent Discrete Message Communication for Cooperative Reinforcement Learningcited by 11
- 2022Adaptive Discrete Communication Bottlenecks with Dynamic Vector Quantizationcited by 11
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 11
- 2022Policy Diagnosis via Measuring Role Diversity in Cooperative Multi-agent RLcited by 11
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
- 2023Referential communication in heterogeneous communities of pre-trained visual deep networkscited by 10
- 2023Learning Multi-Agent Communication with Contrastive Learningcited by 9
- 2025mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Frameworkcited by 9
- 2024T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integrationcited by 8
- 2022FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systemscited by 7
- 2023RGMComm: Return Gap Minimization via Discrete Communications in Multi-Agent Reinforcement Learningcited by 7
- 2023Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Controlcited by 7
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learningcited by 7
- 2022Interpretable Learned Emergent Communication for Human-Agent Teamscited by 6
- 2022Scalable Model-based Policy Optimization for Decentralized Networked Systemscited by 6
- 2022CLAS: Coordinating Multi-Robot Manipulation with Central Latent Action Spacescited by 6
- 2023Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanismcited by 6
- 2022Communication-Efficient Actor-Critic Methods for Homogeneous Markov Gamescited by 5
- 2022Learning Latent Representations to Co-Adapt to Humanscited by 5
- 2023Towards Effective and Interpretable Human-Agent Collaboration in MOBA Games: A Communication Perspectivecited by 5
- 2023Learning Models of Adversarial Agent Behavior under Partial Observabilitycited by 5
- 2024The Bandit Whisperer: Communication Learning for Restless Banditscited by 5
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent Systemcited by 5
- 2022Learning to Ground Decentralized Multi-Agent Communication with Contrastive Learningcited by 4
- 2022Collaborative 3D Object Detection for Automatic Vehicle Systems via Learnable Communicationscited by 4
- 2022Over-communicate no more: Situated RL agents learn concise communication protocolscited by 4
- 2023Towards Skilled Population Curriculum for Multi-Agent Reinforcement Learningcited by 4
50 most cited of 114 All 114 (JSON)
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026Latent Telepathy: Multi-Robot Communication with Self-Supervised Perceptual Latents20 Sep 2026
- 2026BANDMAS: Causality-Inspired Semantic Packet Scheduling for Bandwidth-Efficient Multi-Agent Collaboration1 Aug 2026
- 2026Task-Oriented Sensing and Covert Transmissions for Collaborative Multi-AUV Systems15 Jul 2026
- 2026HiComm: Hierarchical Communication for Multi-agent Reinforcement Learning28 Jun 2026
- 2026MASK: Multi-Agent Semantic K-Scheduling for Risk-Sensitive 6G Robotics8 Jun 2026
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus1 Jun 2026
- 2026When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL21 May 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learning18 May 2026
- 2026Finding the Weakest Link: Adversarial Attack against Multi-Agent Communications13 May 2026
- 2026On-Orbit Space AI: Federated, Multi-Agent, and Collaborative Algorithms for Satellite Constellations15 Apr 2026
38 more
- 2026AgentComm-Bench: Stress-Testing Cooperative Embodied AI Under Latency, Packet Loss, and Bandwidth Collapse18 Mar 2026
- 2026In Trust We Survive: Emergent Trust Learning18 Mar 2026
- 2026Learning Communication Between Heterogeneous Agents in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence17 Mar 2026
- 2026A Semi-Decentralized Approach to Multiagent Control12 Mar 2026
- 2026SCoUT: Scalable Communication via Utility-Guided Temporal Grouping in Multi-Agent Reinforcement Learning5 Mar 2026
- 2026Send Less, Perceive More: Masked Quantized Point Cloud Communication for Loss-Tolerant Collaborative Perception25 Feb 2026
- 2026GlobeDiff: State Diffusion Process for Partial Observability in Multi-Agent Systems17 Feb 2026
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent System3 Feb 2026
- 2026Interactive Distillation for Cooperative Multi-Agent Reinforcement Learning8 Jan 2026
- 2025Bandwidth-constrained Variational Message Encoding for Cooperative Multi-agent Reinforcement Learning11 Dec 2025
- 2025Communication to Completion: Modeling Collaborative Workflows with Intelligent Multi-Agent Communication22 Oct 2025
- 2025Unifying Agent Interaction and World Information for Multi-agent Coordination29 Sep 2025
- 2025Hierarchical Message-Passing Policies for Multi-Agent Reinforcement Learning31 Jul 2025
- 2025Clutter Detection and Removal by Multi-Objective Analysis for Photographic Guidance19 Jul 2025
- 2025Internet of Agents: Fundamentals, Applications, and Challenges12 May 2025
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey1 May 2025
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability11 Apr 2025
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar 2025
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learning27 Feb 2025
- 2025Multi-Agent Coordination across Diverse Applications: A Survey20 Feb 2025
- 2025Contextual Knowledge Sharing in Multi-Agent Reinforcement Learning with Decentralized Communication and Coordination26 Jan 2025
- 2025mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework21 Jan 2025
- 2024Multi-Agent Q-Learning for Real-Time Load Balancing User Association and Handover in Mobile Networks22 Dec 2024
- 2024Communication Learning in Multi-Agent Systems from Graph Modeling Perspective1 Nov 2024
- 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communication25 Sep 2024
- 2024DCMAC: Demand-aware Customized Multi-Agent Communication via Upper Bound Training11 Sep 2024
- 2024The Bandit Whisperer: Communication Learning for Restless Bandits11 Aug 2024
- 2024Multi-agent Cooperative Games Using Belief Map Assisted Training27 Jun 2024
- 2024Learning Multi-Agent Communication from Graph Modeling Perspective14 May 2024
- 2024Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning11 Mar 2024
- 2024Social Environment Design21 Feb 2024
- 2024T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integration19 Jan 2024
- 2023Robust Communicative Multi-Agent Reinforcement Learning with Active Defense16 Dec 2023
- 2023Multi-agent Reinforcement Learning: A Comprehensive Survey15 Dec 2023
- 2023A Review of Cooperation in Multi-agent Learning8 Dec 2023
- 2023Learning to Cooperate and Communicate Over Imperfect Channels24 Nov 2023
- 2023Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control3 Oct 2023
- 2023COMPOSER: Scalable and Robust Modular Policies for Snake Robots2 Oct 2023
50 newest of 114 All 114 (JSON)
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025Multi-Agent Coordination across Diverse Applications: A Surveycited by 37
- 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 28
- 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communicationcited by 17
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent Systemcited by 5
- 2026LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learningcited by 2
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensuscited by 2
- 2025Communication to Completion: Modeling Collaborative Workflows with Intelligent Multi-Agent Communicationcited by 1
- 2026BANDMAS: Causality-Inspired Semantic Packet Scheduling for Bandwidth-Efficient Multi-Agent Collaborationcited by 0
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarmscited by 0
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026BANDMAS: Causality-Inspired Semantic Packet Scheduling for Bandwidth-Efficient Multi-Agent Collaboration1 Aug 2026
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus1 Jun 2026
- 2026LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learning18 May 2026
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent System3 Feb 2026
- 2025Communication to Completion: Modeling Collaborative Workflows with Intelligent Multi-Agent Communication22 Oct 2025
- 2025Internet of Agents: Fundamentals, Applications, and Challenges12 May 2025
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey1 May 2025
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar 2025
- 2025Multi-Agent Coordination across Diverse Applications: A Survey20 Feb 2025
- 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communication25 Sep 2024
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2021Celebrating Diversity in Shared Multi-Agent Reinforcement Learningcited by 96
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Towards a Standardised Performance Evaluation Protocol for Cooperative MARLcited by 48
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 47
- 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
- 2023A Review of Cooperation in Multi-agent Learningcited by 27
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 24
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Collaborative Visual Navigationcited by 18
12 most cited of 102 All 102 (JSON)
- 2026Latent Telepathy: Multi-Robot Communication with Self-Supervised Perceptual Latents20 Sep 2026
- 2026Task-Oriented Sensing and Covert Transmissions for Collaborative Multi-AUV Systems15 Jul 2026
- 2026HiComm: Hierarchical Communication for Multi-agent Reinforcement Learning28 Jun 2026
- 2026MASK: Multi-Agent Semantic K-Scheduling for Risk-Sensitive 6G Robotics8 Jun 2026
- 2026When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL21 May 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026Finding the Weakest Link: Adversarial Attack against Multi-Agent Communications13 May 2026
- 2026On-Orbit Space AI: Federated, Multi-Agent, and Collaborative Algorithms for Satellite Constellations15 Apr 2026
- 2026AgentComm-Bench: Stress-Testing Cooperative Embodied AI Under Latency, Packet Loss, and Bandwidth Collapse18 Mar 2026
- 2026In Trust We Survive: Emergent Trust Learning18 Mar 2026
- 2026Learning Communication Between Heterogeneous Agents in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence17 Mar 2026
- 2026A Semi-Decentralized Approach to Multiagent Control12 Mar 2026
12 newest of 102 All 102 (JSON)