Multi-Agent Cooperation and the Emergence of (Natural) Language
Not on the map. Why?
Cited by 26 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The current mainstream approach to train natural language systems is to expose them to large amounts of text. This passive learning is problematic if we are interested in developing interactive machines, such as conversational agents. We propose a framework for language learning that relies on multi-agent communication. We study this learning in the context of referential games. In these games, a sender and a receiver see a pair of images. The sender is told one of them is the target and is allowed to send a message from a fixed, arbitrary vocabulary to the receiver. The receiver must rely on this message to identify the target. Thus, the agents develop their own language interactively out of the need to communicate. We show that two networks with simple configurations are able to learn to coordinate in the referential game. We further explore how to make changes to the game environment to cause the "word meanings" induced in the game to better reflect intuitive semantic properties of the images. In addition, we present a simple strategy for grounding the agents' code into natural language. Both of these are necessary steps towards developing machines that are able to communicate with humans productively.
Key facts. Cited by 181 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 35; 2022: 24; 2023: 36; 2024: 24; 2025: 24; 2026: 38.
181 papers.
Sort:
By area:
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2024Emergent social conventions and collective bias in LLM populationscited by 115
- 2022What Artificial Neural Networks Can Tell Us About Human Language Acquisitioncited by 97
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
- 2024Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitatecited by 46
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2021Emergent Communication of Generalizationscited by 41
- 2021Word Acquisition in Neural Language Modelscited by 41
- 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent Systemcited by 40
- 2022Fortuitous Forgetting in Connectionist Networkscited by 39
- 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Modelscited by 33
- 2021Few-shot Language Coordination by Modeling Theory of Mindcited by 32
38 more
- 2025Enabling Agents to Communicate Entirely in Latent Spacecited by 31
- 2022Emergent Communication: Generalization and Overfitting in Lewis Gamescited by 28
- 2021Interactive Learning from Activity Descriptioncited by 26
- 2021On the Critical Role of Conventions in Adaptive Human-AI Collaborationcited by 26
- 2021Interpretable agent communication from scratch (with a generic visual processor emerging on the side)cited by 25
- 2022Scalable Multi-Agent Model-Based Reinforcement Learningcited by 24
- 2021Learning to Draw: Emergent Communication through Sketchingcited by 23
- 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?cited by 23
- 2021Iterated learning for emergent systematicity in VQAcited by 21
- 2021Semantics-Native Communication with Contextual Reasoningcited by 21
- 2021Emergent Discrete Communication in Semantic Spacescited by 20
- 2024A social path to human-like artificial intelligencecited by 20
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
- 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
- 2022Linking Emergent and Natural Languages via Corpus Transfercited by 19
- 2021Collaborative Visual Navigationcited by 18
- 2023A Model-Based Solution to the Offline Multi-Agent Reinforcement Learning Coordination Problemcited by 18
- 2021Emergent Communication under Competitioncited by 17
- 2024Iterated Learning Improves Compositionality in Large Vision-Language Modelscited by 17
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communicationcited by 17
- 2021Emergent Graphical Conventions in a Visual Communication Gamecited by 16
- 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
- 2021Solving Common-Payoff Games with Approximate Policy Iterationcited by 15
- 2023Computational Language Acquisition with Theory of Mindcited by 15
- 2025Communicating Activations Between Language Model Agentscited by 15
- 2025Training Language Models for Social Deduction with Multi-Agent Reinforcement Learningcited by 15
- 2021The Emergence of the Shape Bias Results from Communicative Efficiencycited by 13
- 2023What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structurecited by 13
- 2021HAMMER: Multi-Level Coordination of Reinforcement Learning Agents via Learned Messagingcited by 12
- 2021Active Divergence with Generative Deep Learning -- A Survey and Taxonomycited by 12
- 2021Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communicationcited by 12
- 2023Dialogue Games for Benchmarking Language Understanding: Motivation, Taxonomy, Strategycited by 12
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 12
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictabilitycited by 11
- 2022Adaptive Discrete Communication Bottlenecks with Dynamic Vector Quantizationcited by 11
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segmentscited by 11
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
50 most cited of 181 All 181 (JSON)
- 2026Covert Assistance: Helpful LLM Agents Evade Oversight in Multi-Agent Systems30 Sep 2026
- 2026Despite Instructions: Frontier Agents Improvise Covert Channels at Test Time26 Sep 2026
- 2026Communication between Frozen Large Language Models via Prompt Optimization in a Referential Game25 Sep 2026
- 2026Indirect tipping: a social attack surface in AI agent populations21 Sep 2026
- 2026Toward a Unified Mathematics of Concepts21 Sep 2026
- 2026For Your Eyes Only: Evaluating Coordination Between Isolated Language Model Instances16 Sep 2026
- 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition7 Sep 2026
- 2026GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions1 Sep 2026
- 2026What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societies20 Aug 2026
- 2026When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs5 Aug 2026
- 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach3 Aug 2026
- 2026Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM29 Jul 2026
38 more
- 2026Provably Optimal Learning Algorithms for Assistance Games9 Jul 2026
- 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation4 Jul 2026
- 2026From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agents30 Jun 2026
- 2026At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent25 Jun 2026
- 2026Lexical Consensus: Grounded Word Learning and Shared Meaning in Artificial Agents20 Jun 2026
- 2026Drawing with Strangers: Population Scaling Drives Zero-Shot Mutual Intelligibility in Emergent Sketching9 Jun 2026
- 2026Emergent Language as an Approach to Conscious AI4 Jun 2026
- 2026Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion29 May 2026
- 2026Model Collapse as Cultural Evolution21 May 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels13 May 2026
- 2026Phase Transitions in Affective Meaning Divergence: The Hidden Drift Before the Break9 May 2026
- 2026Language Game: Talking to Non-Human Systems5 May 2026
- 2026Semantic Rate-Distortion for Bounded Multi-Agent Communication: Capacity-Derived Semantic Spaces and the Communication Cost of Alignment10 Apr 2026
- 2026SNEAK: Evaluating Strategic Communication and Information Leakage in Large Language Models31 Mar 2026
- 2026Math Takes Two: A test for emergent mathematical reasoning in communication30 Mar 2026
- 2026Emergent Compositional Communication for Latent World Properties18 Mar 2026
- 2026Can LLMs Perceive Time? An Empirical Investigation9 Mar 2026
- 2026Evaluating the relationship between regularity and learnability in recursive numeral systems using Reinforcement Learning25 Feb 2026
- 2026Verifiable Semantics for Agent-to-Agent Communication18 Feb 2026
- 2026Variable-Length Semantic IDs for Recommender Systems18 Feb 2026
- 2026Fluid-Agent Reinforcement Learning16 Feb 2026
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
- 2026Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems29 Jan 2026
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Models28 Jan 2026
- 2026CtD: Composition through Decomposition in Emergent Communication15 Jan 2026
- 2025Trust-Based Social Learning for Communication (TSLEC) Protocol Evolution in Multi-Agent Reinforcement Learning24 Nov 2025
- 2025On the Optimality of Kinship Naming: an Information-theoretic Approach24 Nov 2025
- 2025Enabling Agents to Communicate Entirely in Latent Space12 Nov 2025
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperation4 Nov 2025
- 2025Teacher Demonstrations in a BabyLM's Zone of Proximal Development for Contingent Multi-Turn Interaction23 Oct 2025
- 2025Static Sandboxes Are Inadequate: Modeling Societal Complexity Requires Open-Ended Co-Evolution in LLM-Based Multi-Agent Simulations15 Oct 2025
- 2025AOAD-MAT: Transformer-based multi-agent deep reinforcement learning model considering agents' order of action decisions15 Oct 2025
- 2025Successful Misunderstandings: Learning to Coordinate Without Being Understood29 Sep 2025
- 2025AI-AI Esthetic Collaboration with Explicit Semiotic Awareness and Emergent Grammar Development27 Aug 2025
- 2025CORE: Measuring Multi-Agent LLM Interaction Quality under Game-Theoretic Pressures16 Aug 2025
- 2025Dynamic Strategy Adaptation in Multi-Agent Environments with Large Language Models1 Jul 2025
- 2025Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AI18 Jun 2025
50 newest of 181 All 181 (JSON)
- 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent Systemcited by 40
- 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Modelscited by 33
- 2025Enabling Agents to Communicate Entirely in Latent Spacecited by 31
- 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communicationcited by 17
- 2025Training Language Models for Social Deduction with Multi-Agent Reinforcement Learningcited by 15
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperationcited by 11
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
- 2025Agentic LLM Framework for Adaptive Decision Discoursecited by 6
- 2025CORE: Measuring Multi-Agent LLM Interaction Quality under Game-Theoretic Pressurescited by 5
- 2026Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLMcited by 5
- 2026From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agentscited by 4
12 most cited of 23 All 23 (JSON)
- 2026Covert Assistance: Helpful LLM Agents Evade Oversight in Multi-Agent Systems30 Sep 2026
- 2026Despite Instructions: Frontier Agents Improvise Covert Channels at Test Time26 Sep 2026
- 2026Indirect tipping: a social attack surface in AI agent populations21 Sep 2026
- 2026GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions1 Sep 2026
- 2026When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs5 Aug 2026
- 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach3 Aug 2026
- 2026Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM29 Jul 2026
- 2026From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agents30 Jun 2026
- 2026At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent25 Jun 2026
- 2026Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion29 May 2026
- 2026Verifiable Semantics for Agent-to-Agent Communication18 Feb 2026
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
12 newest of 23 All 23 (JSON)
- 2024Iterated Learning Improves Compositionality in Large Vision-Language Modelscited by 17
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Modelscited by 2
- 2025Metropolis-Hastings Captioning Game: Knowledge Fusion of Vision Language Models via Decentralized Bayesian Inferencecited by 1
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Models28 Jan 2026
- 2025Metropolis-Hastings Captioning Game: Knowledge Fusion of Vision Language Models via Decentralized Bayesian Inference13 Apr 2025
- 2024Iterated Learning Improves Compositionality in Large Vision-Language Models2 Apr 2024
- 2021Cooperative Self-training of Machine Reading Comprehensioncited by 5
- 2026Model Collapse as Cultural Evolutioncited by 1
- 2026Model Collapse as Cultural Evolution21 May 2026
- 2021Cooperative Self-training of Machine Reading Comprehension12 Mar 2021
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2024Emergent social conventions and collective bias in LLM populationscited by 115
- 2022What Artificial Neural Networks Can Tell Us About Human Language Acquisitioncited by 97
- 2024Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitatecited by 46
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2021Emergent Communication of Generalizationscited by 41
- 2021Word Acquisition in Neural Language Modelscited by 41
- 2022Fortuitous Forgetting in Connectionist Networkscited by 39
- 2021Few-shot Language Coordination by Modeling Theory of Mindcited by 32
- 2022Emergent Communication: Generalization and Overfitting in Lewis Gamescited by 28
- 2021Interactive Learning from Activity Descriptioncited by 26
- 2021On the Critical Role of Conventions in Adaptive Human-AI Collaborationcited by 26
12 most cited of 146 All 146 (JSON)
- 2026Communication between Frozen Large Language Models via Prompt Optimization in a Referential Game25 Sep 2026
- 2026Toward a Unified Mathematics of Concepts21 Sep 2026
- 2026For Your Eyes Only: Evaluating Coordination Between Isolated Language Model Instances16 Sep 2026
- 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition7 Sep 2026
- 2026What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societies20 Aug 2026
- 2026Provably Optimal Learning Algorithms for Assistance Games9 Jul 2026
- 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation4 Jul 2026
- 2026Lexical Consensus: Grounded Word Learning and Shared Meaning in Artificial Agents20 Jun 2026
- 2026Drawing with Strangers: Population Scaling Drives Zero-Shot Mutual Intelligibility in Emergent Sketching9 Jun 2026
- 2026Emergent Language as an Approach to Conscious AI4 Jun 2026
- 2026Decoupling Communication from Policy: Robust MARL under Bandwidth Constraints20 May 2026
- 2026Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels13 May 2026
12 newest of 146 All 146 (JSON)