Learning to cooperate: Emergent communication in multi-agent navigation
Not on the map. Why?
Abstract (arXiv)
Emergent communication in artificial agents has been studied to understand language evolution, as well as to develop artificial systems that learn to communicate with humans. We show that agents performing a cooperative navigation task in various gridworld environments learn an interpretable communication protocol that enables them to efficiently, and in many cases, optimally, solve the task. An analysis of the agents' policies reveals that emergent signals spatially cluster the state space, with signals referring to specific locations and spatial directions such as "left", "up", or "upper left room". Using populations of agents, we show that the emergent protocol has basic compositional structure, thus exhibiting a core property of natural language.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 4; 2024: 2; 2025: 2; 2026: 1.
18 papers.
Sort:
By area:
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2024SocraSynth: Multi-LLM Reasoning with Conditional Statisticscited by 13
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictabilitycited by 11
- 2022MA-Dreamer: Coordination and communication through shared imaginationcited by 6
- 2022Over-communicate no more: Situated RL agents learn concise communication protocolscited by 4
- 2021Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channelcited by 3
- 2023Emergent Communication in Interactive Sketch Question Answeringcited by 3
- 2025LLM-Mediated Guidance of MARL Systemscited by 3
- 2023A framework for the emergence and analysis of language in social learning agentscited by 2
- 2023Joining the Conversation: Towards Language Acquisition for Ad Hoc Team Playcited by 2
6 more
- 2022Detecting danger in gridworlds using Gromov's Link Conditioncited by 1
- 2023Cooperative Multi-Agent Learning for Navigation via Structured State Abstractioncited by 1
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foragingcited by 1
- 2021Toward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Languagecited by 0
- 2022A Cooperative Reinforcement Learning Environment for Detecting and Penalizing Betrayalcited by 0
- 2026Robust and Efficient Communication for Multi-Agent Learningcited by 0
- 2026Robust and Efficient Communication for Multi-Agent Learning14 Sep 2026
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foraging19 May 2025
- 2025LLM-Mediated Guidance of MARL Systems16 Mar 2025
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2024SocraSynth: Multi-LLM Reasoning with Conditional Statistics19 Jan 2024
- 2023Emergent Communication in Interactive Sketch Question Answering24 Oct 2023
- 2023Cooperative Multi-Agent Learning for Navigation via Structured State Abstraction20 Jun 2023
- 2023Joining the Conversation: Towards Language Acquisition for Ad Hoc Team Play20 May 2023
- 2023A framework for the emergence and analysis of language in social learning agents4 May 2023
- 2022Over-communicate no more: Situated RL agents learn concise communication protocols2 Nov 2022
- 2022A Cooperative Reinforcement Learning Environment for Detecting and Penalizing Betrayal23 Oct 2022
- 2022MA-Dreamer: Coordination and communication through shared imagination10 Apr 2022
6 more
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communication16 Mar 2022
- 2022Detecting danger in gridworlds using Gromov's Link Condition17 Jan 2022
- 2021Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channel4 Nov 2021
- 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents12 Oct 2021
- 2021Toward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Language20 Jul 2021
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictability7 Jun 2021
- 2024SocraSynth: Multi-LLM Reasoning with Conditional Statisticscited by 13
- 2024SocraSynth: Multi-LLM Reasoning with Conditional Statistics19 Jan 2024
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictabilitycited by 11
- 2022MA-Dreamer: Coordination and communication through shared imaginationcited by 6
- 2022Over-communicate no more: Situated RL agents learn concise communication protocolscited by 4
- 2021Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channelcited by 3
- 2023Emergent Communication in Interactive Sketch Question Answeringcited by 3
- 2025LLM-Mediated Guidance of MARL Systemscited by 3
- 2023A framework for the emergence and analysis of language in social learning agentscited by 2
- 2023Joining the Conversation: Towards Language Acquisition for Ad Hoc Team Playcited by 2
- 2022Detecting danger in gridworlds using Gromov's Link Conditioncited by 1
12 most cited of 17 All 17 (JSON)
- 2026Robust and Efficient Communication for Multi-Agent Learning14 Sep 2026
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foraging19 May 2025
- 2025LLM-Mediated Guidance of MARL Systems16 Mar 2025
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2023Emergent Communication in Interactive Sketch Question Answering24 Oct 2023
- 2023Cooperative Multi-Agent Learning for Navigation via Structured State Abstraction20 Jun 2023
- 2023Joining the Conversation: Towards Language Acquisition for Ad Hoc Team Play20 May 2023
- 2023A framework for the emergence and analysis of language in social learning agents4 May 2023
- 2022Over-communicate no more: Situated RL agents learn concise communication protocols2 Nov 2022
- 2022A Cooperative Reinforcement Learning Environment for Detecting and Penalizing Betrayal23 Oct 2022
- 2022MA-Dreamer: Coordination and communication through shared imagination10 Apr 2022
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communication16 Mar 2022
12 newest of 17 All 17 (JSON)