Emergent Language: A Survey and Taxonomy
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
The field of emergent language represents a novel area of research within the domain of artificial intelligence, particularly within the context of multi-agent reinforcement learning. Although the concept of studying language emergence is not new, early approaches were primarily concerned with explaining human language formation, with little consideration given to its potential utility for artificial agents. In contrast, studies based on reinforcement learning aim to develop communicative capabilities in agents that are comparable to or even superior to human language. Thus, they extend beyond the learned statistical representations that are common in natural language processing research. This gives rise to a number of fundamental questions, from the prerequisites for language emergence to the criteria for measuring its success. This paper addresses these questions by providing a comprehensive review of 181 scientific publications on emergent language in artificial intelligence. Its objective is to serve as a reference for researchers interested in or proficient in the field. Consequently, the main contributions are the definition and overview of the prevailing terminology, the analysis of existing evaluation methods and metrics, and the description of the identified research gaps.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 34 of its 73 references that are in the map. First posted on arXiv 4 Sep 2024.
Builds on
34 of 73 references.
References · 34
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
- 2019The Hanabi Challenge: A New Frontier for AI Researchcited by 197
- 2018A Survey and Critique of Multiagent Deep Reinforcement Learningcited by 177
- 2017Natural Language Processing: State of The Art, Current Trends and Challengescited by 114
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2020Compositionality and Generalization in Emergent Languagescited by 103
- 2017MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligencecited by 71
- 2021Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?cited by 55
- 2020Morphology Matters: A Multilingual Language Modeling Analysiscited by 37
22 more
- 2019Learning to Interactively Learn and Assistcited by 20
- 2019Improving Coordination in Small-Scale Multi-Agent Deep Reinforcement Learning through Memory-driven Communicationcited by 18
- 2020Co-evolution of language and agents in referential gamescited by 18
- 2020Emergent Language Generalization and Acquisition Speed are not tied to Compositionalitycited by 17
- 2019Symbol Emergence as an Interpersonal Multimodal Categorizationcited by 14
- 2020Internal and external pressures on language emergence: least effort, object constancy and frequencycited by 13
- 2020Emergent Communication Pretraining for Few-Shot Machine Translationcited by 13
- 2021The Emergence of the Shape Bias Results from Communicative Efficiencycited by 13
- 2021Multiagent Multimodal Categorization for Symbol Emergence: Emergent Communication via Interpersonal Cross-modal Inferencecited by 10
- 2020The Grammar of Emergent Languagescited by 9
- 2022Defending Compositionality in Emergent Languagescited by 8
- 2022Emergent Quantized Communicationcited by 7
- 2024Concept-Best-Matching: Evaluating Compositionality in Emergent Communicationcited by 7
- 2023Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generationcited by 6
- 2021Mutual influence between language and perception in multi-agent communication gamescited by 5
- 2022Learning to translate by learning to communicatecited by 4
- 2023Learning Multi-Object Positional Relationships via Emergent Communicationcited by 4
- 2021Preference Communication in Multi-Objective Normal-Form Gamescited by 3
- 2018Emergence of linguistic conventions in multi-agent reinforcement learningcited by 2
- 2019Emergence of Writing Systems Through Multi-Agent Cooperationcited by 2
- 2022Emergent communication enhances foraging behaviour in evolved swarms controlled by Spiking Neural Networkscited by 2
- 2016On the emergence of syntactic structures: quantifying and modelling duality of patterningcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 7; 2026: 5.
13 papers.
Sort:
By area:
- 2024Generative Emergent Communication: Large Language Model is a Collective World Modelcited by 15
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
- 2025Decentralized Collective World Model for Emergent Communication and Coordinationcited by 5
- 2025System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systemscited by 2
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foragingcited by 1
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationcited by 1
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantizationcited by 0
- 2025Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AIcited by 0
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?cited by 0
- 2026Emergent Communication between Heterogeneous Visual Agents through Decentralized Learningcited by 0
- 2026Emergent Language as an Approach to Conscious AIcited by 0
- 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generationcited by 0
- 2026On the Monitorability of Natural Language Autoencoders: Identification vs Discrimination13 Oct 2026
- 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation4 Jul 2026
- 2026Emergent Language as an Approach to Conscious AI4 Jun 2026
- 2026Emergent Communication between Heterogeneous Visual Agents through Decentralized Learning12 May 2026
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation7 Aug 2025
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?27 Jun 2025
- 2025Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AI18 Jun 2025
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foraging19 May 2025
- 2025Decentralized Collective World Model for Emergent Communication and Coordination4 Apr 2025
- 2025System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems8 Mar 2025
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantization6 Mar 2025
1 more
- 2025System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systemscited by 2
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foragingcited by 1
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationcited by 1
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantizationcited by 0
- 2025Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AIcited by 0
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?cited by 0
- 2026Emergent Communication between Heterogeneous Visual Agents through Decentralized Learningcited by 0
- 2026Emergent Language as an Approach to Conscious AIcited by 0
- 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generationcited by 0
- 2026On the Monitorability of Natural Language Autoencoders: Identification vs Discriminationcited by 0
- 2026On the Monitorability of Natural Language Autoencoders: Identification vs Discrimination13 Oct 2026
- 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation4 Jul 2026
- 2026Emergent Language as an Approach to Conscious AI4 Jun 2026
- 2026Emergent Communication between Heterogeneous Visual Agents through Decentralized Learning12 May 2026
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation7 Aug 2025
- 2025Why Are Parsing Actions for Understanding Message Hierarchies Not Random?27 Jun 2025
- 2025Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AI18 Jun 2025
- 2025From Grunts to Lexicons: Emergent Language from Cooperative Foraging19 May 2025
- 2025System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems8 Mar 2025
- 2025VQEL: Enabling Self-Play in Emergent Language Games via Agent-Internal Vector Quantization6 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication
- 2025Emergent Abilities in Large Language Models: A Survey
- 2026GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026The Rise of Verbal Reinforcement Learning
- 2025Small Language Models are the Future of Agentic AI
- 2024Searching for Structure: Investigating Emergent Communication with Large Language Models
- 2025A Survey on Agentic Multimodal Large Language Models