From Grunts to Lexicons: Emergent Language from Cooperative Foraging
Not on the map. Why?
Abstract (arXiv)
Language is a powerful communicative and cognitive tool. It enables humans to express thoughts, share intentions, and reason about complex phenomena. Despite our fluency in using and understanding language, the question of how it arises and evolves over time remains unsolved. A leading hypothesis in linguistics and anthropology posits that language evolved to meet the ecological and social demands of early human cooperation. Language did not arise in isolation, but through shared survival goals. Inspired by this view, we investigate the emergence of language in multi-agent Foraging Games. These environments are designed to reflect the cognitive and ecological constraints believed to have influenced the evolution of communication. Agents operate in a shared grid world with only partial knowledge about other agents and the environment, and must coordinate to complete games like picking up high-value targets or executing temporally ordered actions. Using end-to-end deep reinforcement learning, agents learn both actions and communication strategies from scratch. We find that agents develop communication protocols with hallmark features of natural language: arbitrariness, interchangeability, displacement, cultural transmission, and compositionality. We quantify each property and analyze how different factors, such as population size, social dynamics, and temporal dependencies, shape specific aspects of the emergent language. Our framework serves as a platform for studying how language can evolve from partial observability, temporal reasoning, and cooperative goals in embodied multi-agent settings. We will release all data, code, and models publicly.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 76 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
38 of 76 references.
References · 38
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2020Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?cited by 294
- 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 263
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
- 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 185
- 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 170
- 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
26 more
- 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
- 2020Deep Implicit Coordination Graphs for Multi-agent Reinforcement Learningcited by 60
- 2020Agent Modelling under Partial Observability for Deep Reinforcement Learningcited by 57
- 2019Two Body Problem: Collaborative Visual Task Completioncited by 45
- 2015A Game-Theoretic Model and Best-Response Learning Method for Ad Hoc Coordination in Multiagent Systemscited by 44
- 2019EGG: a toolkit for research on Emergence of lanGuage in Gamescited by 42
- 2021Emergent Communication of Generalizationscited by 42
- 2019Emergent Linguistic Phenomena in Multi-Agent Communication Gamescited by 36
- 2022On the role of population heterogeneity in emergent communicationcited by 24
- 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?cited by 23
- 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
- 2022Linking Emergent and Natural Languages via Corpus Transfercited by 19
- 2020Learning to cooperate: Emergent communication in multi-agent navigationcited by 18
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2022ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependencycited by 15
- 2024Emergent Language: A Survey and Taxonomycited by 13
- 2022Trust Region Bounds for Decentralized PPO Under Non-stationaritycited by 11
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segmentscited by 11
- 2023EC^2: Emergent Communication for Embodied Controlcited by 10
- 2024Learning to Communicate Through Implicit Communication Channelscited by 7
- 2021Multi-Agent Curricula and Emergent Implicit Signalingcited by 6
- 2024Speaking Your Language: Spatial Relationships in Interpretable Emergent Communicationcited by 3
- 2020Reinforcement Communication Learning in Different Social Network Structurescited by 2
- 2024Semantics and Spatiality of Emergent Communicationcited by 2
- 2022Taming Multi-Agent Reinforcement Learning with Estimator Variance Reductioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Emergent Language as an Approach to Conscious AIcited by 0
- 2026Emergent Language as an Approach to Conscious AI4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
- 2025Collaboration and Conflict between Humans and Language Models through the Lens of Game Theory
- 2026The Rise of Verbal Reinforcement Learning
- 2024Searching for Structure: Investigating Emergent Communication with Large Language Models
- 2026SAGE: A Quantitative Evaluation of Socialized Evolution in Agent Ecosystems
- 2024Mimicry and the Emergence of Cooperative Communication ↗
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
- 2026Payoff scaling shapes cooperation in LLM agents across languages