TarMAC: Targeted Multi-Agent Communication
Not on the map. Why?
Abstract (arXiv)
We propose a targeted communication architecture for multi-agent reinforcement learning, where agents learn both what messages to send and whom to address them to while performing cooperative tasks in partially-observable environments. This targeting behavior is learnt solely from downstream task-specific reward without any communication supervision. We additionally augment this with a multi-round communication approach where agents coordinate via multiple rounds of communication before taking actions in the environment. We evaluate our approach on a diverse set of cooperative multi-agent tasks, of varying difficulties, with varying number of agents, in a variety of environments ranging from 2D grid layouts of shapes and simulated traffic junctions to 3D indoor environments, and demonstrate the benefits of targeted and multi-round communication. Moreover, we show that the targeted communication strategies learned by agents are interpretable and intuitive. Finally, we show that our architecture can be easily extended to mixed and competitive environments, leading to improved performance and sample complexity over recent state-of-the-art approaches.
Key facts. Cited by 208 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 35; 2023: 42; 2024: 19; 2025: 17; 2026: 65.
208 papers.
Sort:
By area:
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
- 2021Contrasting Centralized and Decentralized Critics in Multi-Agent Reinforcement Learningcited by 56
- 2021Scalar reward is not enough: A response to Silver, Singh, Precup and Sutton (2021)cited by 55
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Towards a Standardised Performance Evaluation Protocol for Cooperative MARLcited by 49
38 more
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 48
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2025Multi-Agent Coordination across Diverse Applications: A Surveycited by 37
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 36
- 2021Offline Decentralized Multi-Agent Reinforcement Learningcited by 33
- 2021Distributed Heuristic Multi-Agent Path Finding with Communicationcited by 32
- 2021Learning Selective Communication for Multi-Agent Path Findingcited by 32
- 2022AssistQ: Affordance-centric Question-driven Task Completion for Egocentric Assistantcited by 32
- 2022A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learningcited by 31
- 2023A Review of Cooperation in Multi-agent Learningcited by 29
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 25
- 2021Learning to Draw: Emergent Communication through Sketchingcited by 23
- 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
- 2021Emergent Communication under Competitioncited by 18
- 2021Collaborative Visual Navigationcited by 18
- 2021Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learningcited by 18
- 2021Mis-spoke or mis-lead: Achieving Robustness in Multi-Agent Communicative Reinforcement Learningcited by 18
- 2023Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?cited by 18
- 2021Causal Multi-Agent Reinforcement Learning: Review and Open Problemscited by 16
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 16
- 2021Self-Organized Polynomial-Time Coordination Graphscited by 15
- 2022Iterated Reasoning with Mutual Information in Cooperative and Byzantine Decentralized Teamingcited by 14
- 2022QGNN: Value Function Factorisation with Graph Neural Networkscited by 14
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 14
- 2022Multi-Agent Coordination via Multi-Level Communicationcited by 14
- 2021Neurosymbolic Transformers for Multi-Agent Communicationcited by 13
- 2023Dealing With Non-stationarity in Decentralized Cooperative Multi-Agent Deep Reinforcement Learning via Multi-Timescale Learningcited by 13
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 13
- 2023Context-aware Communication for Multi-agent Reinforcement Learningcited by 13
- 2022Value Functions Factorization with Latent State Information Sharing in Decentralized Multi-Agent Policy Gradientscited by 12
- 2021Learning Emergent Discrete Message Communication for Cooperative Reinforcement Learningcited by 11
- 2022Adaptive Discrete Communication Bottlenecks with Dynamic Vector Quantizationcited by 11
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
- 2021Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid Worldcited by 10
- 2021Communicating via Markov Decision Processescited by 10
- 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledgecited by 10
- 2022Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learningcited by 10
- 2024T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integrationcited by 10
50 most cited of 208 All 208 (JSON)
- 2026Narrowing the Collaboration Gap, Probably13 Oct 2026
- 2026Position: Beyond Training Time, Test-Time Coordination is Essential for Cooperative MARL12 Oct 2026
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026CoLA: Multi-VLA Coordination via Learned Adapters11 Oct 2026
- 2026Continual Graph Multi-Agent Reinforcement Learning7 Oct 2026
- 2026Network-in-the-Loop at Scale: GPU-Batched 5G Simulation for Massively Parallel Robot Learning1 Oct 2026
- 2026Emergent Specialization in Populations of Self-Supervised Collaborative Vision Experts Without a Shared Gate or Cross-Agent Gradients29 Sep 2026
- 2026Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination28 Sep 2026
- 2026Attention-based Hierarchical Variational Information Bottleneck for Robust Multi-Agent Communication under Variable Bandwidth28 Sep 2026
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026HySTAR: Anchored Hypergraphs for Stable Credit Assignment in Cooperative Multi-Agent Reinforcement Learning25 Sep 2026
- 2026Latent Telepathy: Multi-Robot Communication with Self-Supervised Perceptual Latents20 Sep 2026
38 more
- 2026Robust and Efficient Communication for Multi-Agent Learning14 Sep 2026
- 2026Exploring Collaboration between a language and a non-language agent31 Aug 2026
- 2026WONDER: A Radio World Model-based Negotiation Framework for Multi-Agent UAV Coverage Optimization16 Aug 2026
- 2026UC-PSRO: Utility-Conditioned Policy-Space Response Oracles with a Communication-Dropout Curriculum for Game-Theoretic Course-of-Action Generation in Adversarial Swarms15 Aug 2026
- 2026Selection-Invariant Communication Compilers for Privacy-Aware Multi-Agent LLM Workflows4 Aug 2026
- 2026BANDMAS: Causality-Inspired Semantic Packet Scheduling for Bandwidth-Efficient Multi-Agent Collaboration1 Aug 2026
- 2026Compact Latent Coordination for Autonomous Vehicles at Unsignalized Intersections23 Jul 2026
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Loss20 Jul 2026
- 2026Task-Oriented Sensing and Covert Transmissions for Collaborative Multi-AUV Systems15 Jul 2026
- 2026Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning12 Jul 2026
- 2026MUTE: Return-Preserving Communication Unlearning for Efficient Multi-Agent Coordination3 Jul 2026
- 2026HiComm: Hierarchical Communication for Multi-agent Reinforcement Learning28 Jun 2026
- 2026GCT-MARL: Graph-Based Contrastive Transfer for Sample-Efficient Cooperative Multi-Agent Reinforcement Learning23 Jun 2026
- 2026The Hitchhiker's Guide to Agentic AI: From Foundations to Systems22 Jun 2026
- 2026Formal Verification of Learned Multi-Agent Communication Policies via Decision Tree Distillation17 Jun 2026
- 2026MASK: Multi-Agent Semantic K-Scheduling for Risk-Sensitive 6G Robotics8 Jun 2026
- 2026Network Distributed Multi-Agent Reinforcement Learning for Consensus Control of Quadcopters1 Jun 2026
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus1 Jun 2026
- 2026SPIN: Decentralized Swarm Control via Tensorized Policy Coordination25 May 2026
- 2026Acting on the Unseen: Communication-Free Collaborative Filtering for Decentralized Multi-Robot Task Allocation25 May 2026
- 2026When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL21 May 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learning18 May 2026
- 2026Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning17 May 2026
- 2026SACHI: Structured Agent Coordination via Holistic Information Integration in Multi-Agent Reinforcement Learning8 May 2026
- 2026Quality-Aware Exploration Budget Allocation for Cooperative Multi-Agent Reinforcement Learning3 May 2026
- 2026On-Orbit Space AI: Federated, Multi-Agent, and Collaborative Algorithms for Satellite Constellations15 Apr 2026
- 2026Bridging MARL to SARL: An Order-Independent Multi-Agent Transformer via Latent Consensus15 Apr 2026
- 2026Multi-Agent Decision-Focused Learning via Value-Aware Sequential Communication10 Apr 2026
- 2026Wireless Communication Enhanced Value Decomposition for Multi-Agent Reinforcement Learning9 Apr 2026
- 2026Breakthrough the Suboptimal Stable Point in Value-Factorization-Based Multi-Agent Reinforcement Learning7 Apr 2026
- 2026Symbolic-Vector Attention Fusion for Collective Intelligence5 Apr 2026
- 2026Communication Gain and Delay Cost Under Cross-Timestep Delays in Cooperative Multi-Agent Reinforcement Learning4 Apr 2026
- 2026Reason-to-Transmit: Deliberative Adaptive Communication for Cooperative Perception19 Mar 2026
- 2026Emergent Compositional Communication for Latent World Properties18 Mar 2026
- 2026AgentComm-Bench: Stress-Testing Cooperative Embodied AI Under Latency, Packet Loss, and Bandwidth Collapse18 Mar 2026
- 2026In Trust We Survive: Emergent Trust Learning18 Mar 2026
- 2026Learning Communication Between Heterogeneous Agents in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence17 Mar 2026
50 newest of 208 All 208 (JSON)
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2025Multi-Agent Coordination across Diverse Applications: A Surveycited by 37
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent Systemcited by 5
- 2026LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learningcited by 2
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensuscited by 2
- 2026Exploring Collaboration between a language and a non-language agentcited by 1
- 2026Selection-Invariant Communication Compilers for Privacy-Aware Multi-Agent LLM Workflowscited by 1
- 2025EncGPT: A Multi-Agent Workflow for Dynamic Encryption Algorithmscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026Exploring Collaboration between a language and a non-language agent31 Aug 2026
- 2026Selection-Invariant Communication Compilers for Privacy-Aware Multi-Agent LLM Workflows4 Aug 2026
- 2026BANDMAS: Causality-Inspired Semantic Packet Scheduling for Bandwidth-Efficient Multi-Agent Collaboration1 Aug 2026
- 2026Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus1 Jun 2026
- 2026LLM-Guided Communication for Cooperative Multi-Agent Reinforcement Learning18 May 2026
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent System3 Feb 2026
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms2 Jul 2025
- 2025EncGPT: A Multi-Agent Workflow for Dynamic Encryption Algorithms29 Mar 2025
- 2025Multi-Agent Coordination across Diverse Applications: A Survey20 Feb 2025
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions17 May 2024
12 newest of 14 All 14 (JSON)
- 2025Decentralized Consensus Inference-based Hierarchical Reinforcement Learning for Multi-Constrained UAV Pursuit-Evasion Gamecited by 2
- 2025Interpretable Emergent Language Using Inter-Agent Transformerscited by 1
- 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learningcited by 1
- 2026Task-Oriented Sensing and Covert Transmissions for Collaborative Multi-AUV Systemscited by 0
- 2026Task-Oriented Sensing and Covert Transmissions for Collaborative Multi-AUV Systems15 Jul 2026
- 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning3 Nov 2025
- 2025Decentralized Consensus Inference-based Hierarchical Reinforcement Learning for Multi-Constrained UAV Pursuit-Evasion Game22 Jun 2025
- 2025Interpretable Emergent Language Using Inter-Agent Transformers4 May 2025
- 2024Grounded Answers for Multi-agent Decision-making Problem through Generative World Modelcited by 6
- 2025Ego-centric Learning of Communicative World Models for Autonomous Drivingcited by 2
- 2026WONDER: A Radio World Model-based Negotiation Framework for Multi-Agent UAV Coverage Optimizationcited by 0
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communicationcited by 0
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026WONDER: A Radio World Model-based Negotiation Framework for Multi-Agent UAV Coverage Optimization16 Aug 2026
- 2025Ego-centric Learning of Communicative World Models for Autonomous Driving9 Jun 2025
- 2024Grounded Answers for Multi-agent Decision-making Problem through Generative World Model3 Oct 2024
- 2025Interactive Learning for LLM Reasoningcited by 5
- 2026The Hitchhiker's Guide to Agentic AI: From Foundations to Systemscited by 0
- 2026The Hitchhiker's Guide to Agentic AI: From Foundations to Systems22 Jun 2026
- 2025Interactive Learning for LLM Reasoning30 Sep 2025
- 2026CoLA: Multi-VLA Coordination via Learned Adapterscited by 0
- 2026CoLA: Multi-VLA Coordination via Learned Adapters11 Oct 2026
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
- 2021Contrasting Centralized and Decentralized Critics in Multi-Agent Reinforcement Learningcited by 56
- 2021Scalar reward is not enough: A response to Silver, Singh, Precup and Sutton (2021)cited by 55
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Towards a Standardised Performance Evaluation Protocol for Cooperative MARLcited by 49
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 48
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 36
- 2021Offline Decentralized Multi-Agent Reinforcement Learningcited by 33
12 most cited of 175 All 175 (JSON)
- 2026Narrowing the Collaboration Gap, Probably13 Oct 2026
- 2026Position: Beyond Training Time, Test-Time Coordination is Essential for Cooperative MARL12 Oct 2026
- 2026Continual Graph Multi-Agent Reinforcement Learning7 Oct 2026
- 2026Network-in-the-Loop at Scale: GPU-Batched 5G Simulation for Massively Parallel Robot Learning1 Oct 2026
- 2026Emergent Specialization in Populations of Self-Supervised Collaborative Vision Experts Without a Shared Gate or Cross-Agent Gradients29 Sep 2026
- 2026Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination28 Sep 2026
- 2026Attention-based Hierarchical Variational Information Bottleneck for Robust Multi-Agent Communication under Variable Bandwidth28 Sep 2026
- 2026HySTAR: Anchored Hypergraphs for Stable Credit Assignment in Cooperative Multi-Agent Reinforcement Learning25 Sep 2026
- 2026Latent Telepathy: Multi-Robot Communication with Self-Supervised Perceptual Latents20 Sep 2026
- 2026Robust and Efficient Communication for Multi-Agent Learning14 Sep 2026
- 2026UC-PSRO: Utility-Conditioned Policy-Space Response Oracles with a Communication-Dropout Curriculum for Game-Theoretic Course-of-Action Generation in Adversarial Swarms15 Aug 2026
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Loss20 Jul 2026
12 newest of 175 All 175 (JSON)