Biases for Emergent Communication in Multi-agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We study the problem of emergent communication, in which language arises because speakers and listeners must communicate information in order to solve tasks. In temporally extended reinforcement learning domains, it has proved hard to learn such communication without centralized training of agents, due in part to a difficult joint exploration problem. We introduce inductive biases for positive signalling and positive listening, which ease this problem. In a simple one-step environment, we demonstrate how these biases ease the learning problem. We also apply our methods to a more extended environment, showing that agents with these inductive biases achieve better performance, and analyse the resulting communication protocols.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 10; 2023: 9; 2024: 3; 2025: 11; 2026: 3.
48 papers.
Sort:
By area:
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2021Emergent Discrete Communication in Semantic Spacescited by 20
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
- 2021Emergent Communication under Competitioncited by 17
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2021Emergent Graphical Conventions in a Visual Communication Gamecited by 16
- 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 12
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperationcited by 11
- 2023Learning Multi-Agent Communication with Contrastive Learningcited by 9
- 2022First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximizationcited by 8
36 more
- 2025Echoing: Identity Failures when LLM Agents Talk to Each Othercited by 8
- 2022Towards Human-Agent Communication via the Information Bottleneck Principlecited by 7
- 2023Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translationcited by 7
- 2021Multi-Agent Curricula and Emergent Implicit Signalingcited by 6
- 2023Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generationcited by 6
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Criticcited by 5
- 2021Model-based Reinforcement Learning for Service Mesh Fault Resiliency in a Web Application-levelcited by 5
- 2025AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systemscited by 5
- 2022Learning to Ground Decentralized Multi-Agent Communication with Contrastive Learningcited by 4
- 2022Over-communicate no more: Situated RL agents learn concise communication protocolscited by 4
- 2023Learning Multi-Object Positional Relationships via Emergent Communicationcited by 4
- 2021Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channelcited by 3
- 2022Towards True Lossless Sparse Communication in Multi-Agent Systemscited by 3
- 2023On the Role of Emergent Communication for Social Learning in Multi-Agent Reinforcement Learningcited by 3
- 2025Heterogeneous Adversarial Play in Interactive Environmentscited by 3
- 2022Symbol Emergence as Inter-personal Categorization with Head-to-head Latent Wordcited by 2
- 2022Recommendations for Systematic Research on Emergent Languagecited by 2
- 2022Developing, Evaluating and Scaling Learning Agents in Multi-Agent Environmentscited by 2
- 2023Efficient Communication via Self-supervised Information Aggregation for Online and Offline Multi-agent Reinforcement Learningcited by 2
- 2021Inference-Based Deterministic Messaging For Multi-Agent Communicationcited by 1
- 2021Convergence Rates of Average-Reward Multi-agent Reinforcement Learning via Randomized Linear Programmingcited by 1
- 2024ClusterComm: Discrete Communication in Decentralized MARL using Internal Representation Clusteringcited by 1
- 2024PACE: Procedural Abstractions for Communicating Efficientlycited by 1
- 2025GenAI-based Multi-Agent Reinforcement Learning towards Distributed Agent Intelligence: A Generative-RL Agent Perspectivecited by 1
- 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learningcited by 1
- 2026DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contentioncited by 1
- 2021Multi-lingual agents through multi-headed neural networkscited by 0
- 2023Inductive Bias for Emergent Communication in a Continuous Settingcited by 0
- 2023Symbol emergence as interpersonal cross-situational learning: the emergence of lexical knowledge with combinatorialitycited by 0
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantizationcited by 0
- 2025AI-AI Esthetic Collaboration with Explicit Semiotic Awareness and Emergent Grammar Developmentcited by 0
- 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Modelscited by 0
- 2025Trust-Based Social Learning for Communication (TSLEC) Protocol Evolution in Multi-Agent Reinforcement Learningcited by 0
- 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligencecited by 0
- 2026Semantic Rate-Distortion for Bounded Multi-Agent Communication: Capacity-Derived Semantic Spaces and the Communication Cost of Alignmentcited by 0
- 2026Emergence, Not Bandwidth: Physical Coupling and the Limits of Learned Multi-Agent Communicationcited by 0
- 2026Emergence, Not Bandwidth: Physical Coupling and the Limits of Learned Multi-Agent Communication28 Sep 2026
- 2026Semantic Rate-Distortion for Bounded Multi-Agent Communication: Capacity-Derived Semantic Spaces and the Communication Cost of Alignment10 Apr 2026
- 2026DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contention2 Feb 2026
- 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence9 Dec 2025
- 2025Trust-Based Social Learning for Communication (TSLEC) Protocol Evolution in Multi-Agent Reinforcement Learning24 Nov 2025
- 2025Echoing: Identity Failures when LLM Agents Talk to Each Other12 Nov 2025
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperation4 Nov 2025
- 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning3 Nov 2025
- 2025Heterogeneous Adversarial Play in Interactive Environments21 Oct 2025
- 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models3 Oct 2025
- 2025AI-AI Esthetic Collaboration with Explicit Semiotic Awareness and Emergent Grammar Development27 Aug 2025
- 2025GenAI-based Multi-Agent Reinforcement Learning towards Distributed Agent Intelligence: A Generative-RL Agent Perspective13 Jul 2025
36 more
- 2025AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systems7 Jul 2025
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantization6 Mar 2025
- 2024PACE: Procedural Abstractions for Communicating Efficiently30 Sep 2024
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2024ClusterComm: Discrete Communication in Decentralized MARL using Internal Representation Clustering7 Jan 2024
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Research1 Aug 2023
- 2023Learning Multi-Agent Communication with Contrastive Learning3 Jul 2023
- 2023Symbol emergence as interpersonal cross-situational learning: the emergence of lexical knowledge with combinatoriality27 Jun 2023
- 2023Inductive Bias for Emergent Communication in a Continuous Setting6 Jun 2023
- 2023Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generation9 May 2023
- 2023On the Role of Emergent Communication for Social Learning in Multi-Agent Reinforcement Learning28 Feb 2023
- 2023Efficient Communication via Self-supervised Information Aggregation for Online and Offline Multi-agent Reinforcement Learning19 Feb 2023
- 2023Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation18 Feb 2023
- 2023Learning Multi-Object Positional Relationships via Emergent Communication16 Feb 2023
- 2022Towards True Lossless Sparse Communication in Multi-Agent Systems30 Nov 2022
- 2022Over-communicate no more: Situated RL agents learn concise communication protocols2 Nov 2022
- 2022Developing, Evaluating and Scaling Learning Agents in Multi-Agent Environments22 Sep 2022
- 2022Towards Human-Agent Communication via the Information Bottleneck Principle30 Jun 2022
- 2022Recommendations for Systematic Research on Emergent Language22 Jun 2022
- 2022Symbol Emergence as Inter-personal Categorization with Head-to-head Latent Word24 May 2022
- 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Models24 May 2022
- 2022First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximization24 May 2022
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communication16 Mar 2022
- 2022Learning to Ground Decentralized Multi-Agent Communication with Contrastive Learning7 Mar 2022
- 2021Emergent Graphical Conventions in a Visual Communication Game28 Nov 2021
- 2021Multi-lingual agents through multi-headed neural networks22 Nov 2021
- 2021Towards Learning to Speak and Hear Through Multi-Agent Communication over a Continuous Acoustic Channel4 Nov 2021
- 2021Learning to Ground Multi-Agent Communication with Autoencoders28 Oct 2021
- 2021Convergence Rates of Average-Reward Multi-agent Reinforcement Learning via Randomized Linear Programming22 Oct 2021
- 2021Model-based Reinforcement Learning for Service Mesh Fault Resiliency in a Web Application-level21 Oct 2021
- 2021Emergent Discrete Communication in Semantic Spaces4 Aug 2021
- 2021Multi-Agent Curricula and Emergent Implicit Signaling21 Jun 2021
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Critic29 May 2021
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communication14 Mar 2021
- 2021Inference-Based Deterministic Messaging For Multi-Agent Communication3 Mar 2021
- 2021Emergent Communication under Competition25 Jan 2021
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperationcited by 11
- 2025Echoing: Identity Failures when LLM Agents Talk to Each Othercited by 8
- 2026DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contentioncited by 1
- 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Modelscited by 0
- 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligencecited by 0
- 2026DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contention2 Feb 2026
- 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence9 Dec 2025
- 2025Echoing: Identity Failures when LLM Agents Talk to Each Other12 Nov 2025
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperation4 Nov 2025
- 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models3 Oct 2025
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2021Learning to Ground Multi-Agent Communication with Autoencoderscited by 37
- 2021Emergent Discrete Communication in Semantic Spacescited by 20
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
- 2021Emergent Communication under Competitioncited by 17
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2021Emergent Graphical Conventions in a Visual Communication Gamecited by 16
- 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 12
- 2023Learning Multi-Agent Communication with Contrastive Learningcited by 9
- 2022First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximizationcited by 8
- 2022Towards Human-Agent Communication via the Information Bottleneck Principlecited by 7
12 most cited of 42 All 42 (JSON)
- 2026Emergence, Not Bandwidth: Physical Coupling and the Limits of Learned Multi-Agent Communication28 Sep 2026
- 2026Semantic Rate-Distortion for Bounded Multi-Agent Communication: Capacity-Derived Semantic Spaces and the Communication Cost of Alignment10 Apr 2026
- 2025Trust-Based Social Learning for Communication (TSLEC) Protocol Evolution in Multi-Agent Reinforcement Learning24 Nov 2025
- 2025Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning3 Nov 2025
- 2025Heterogeneous Adversarial Play in Interactive Environments21 Oct 2025
- 2025AI-AI Esthetic Collaboration with Explicit Semiotic Awareness and Emergent Grammar Development27 Aug 2025
- 2025GenAI-based Multi-Agent Reinforcement Learning towards Distributed Agent Intelligence: A Generative-RL Agent Perspective13 Jul 2025
- 2025AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systems7 Jul 2025
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantization6 Mar 2025
- 2024PACE: Procedural Abstractions for Communicating Efficiently30 Sep 2024
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2024ClusterComm: Discrete Communication in Decentralized MARL using Internal Representation Clustering7 Jan 2024
12 newest of 42 All 42 (JSON)