mlsanityData to 14 Oct 2026

From Grunts to Lexicons: Emergent Language from Cooperative Foraging

arXiv 2505.12872 ↗First posted 19 May 2025cs.AI cs.LG cs.MAcited by 1

Not on the map. Why?

Abstract (arXiv)

Language is a powerful communicative and cognitive tool. It enables humans to express thoughts, share intentions, and reason about complex phenomena. Despite our fluency in using and understanding language, the question of how it arises and evolves over time remains unsolved. A leading hypothesis in linguistics and anthropology posits that language evolved to meet the ecological and social demands of early human cooperation. Language did not arise in isolation, but through shared survival goals. Inspired by this view, we investigate the emergence of language in multi-agent Foraging Games. These environments are designed to reflect the cognitive and ecological constraints believed to have influenced the evolution of communication. Agents operate in a shared grid world with only partial knowledge about other agents and the environment, and must coordinate to complete games like picking up high-value targets or executing temporally ordered actions. Using end-to-end deep reinforcement learning, agents learn both actions and communication strategies from scratch. We find that agents develop communication protocols with hallmark features of natural language: arbitrariness, interchangeability, displacement, cultural transmission, and compositionality. We quantify each property and analyze how different factors, such as population size, social dynamics, and temporal dependencies, shape specific aspects of the emergent language. Our framework serves as a platform for studying how language can evolve from partial observability, temporal reasoning, and cooperative goals in embodied multi-agent settings. We will release all data, code, and models publicly.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 76 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

38 of 76 references.

References · 38

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  3. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  4. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
  5. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
  6. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  7. 2020Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?cited by 294
  8. 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 263
  9. 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
  10. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 185
  11. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 170
  12. 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
26 more
  1. 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
  2. 2020Deep Implicit Coordination Graphs for Multi-agent Reinforcement Learningcited by 60
  3. 2020Agent Modelling under Partial Observability for Deep Reinforcement Learningcited by 57
  4. 2019Two Body Problem: Collaborative Visual Task Completioncited by 45
  5. 2015A Game-Theoretic Model and Best-Response Learning Method for Ad Hoc Coordination in Multiagent Systemscited by 44
  6. 2019EGG: a toolkit for research on Emergence of lanGuage in Gamescited by 42
  7. 2021Emergent Communication of Generalizationscited by 42
  8. 2019Emergent Linguistic Phenomena in Multi-Agent Communication Gamescited by 36
  9. 2022On the role of population heterogeneity in emergent communicationcited by 24
  10. 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?cited by 23
  11. 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
  12. 2022Linking Emergent and Natural Languages via Corpus Transfercited by 19
  13. 2020Learning to cooperate: Emergent communication in multi-agent navigationcited by 18
  14. 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
  15. 2022ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependencycited by 15
  16. 2024Emergent Language: A Survey and Taxonomycited by 13
  17. 2022Trust Region Bounds for Decentralized PPO Under Non-stationaritycited by 11
  18. 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
  19. 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segmentscited by 11
  20. 2023EC^2: Emergent Communication for Embodied Controlcited by 10
  21. 2024Learning to Communicate Through Implicit Communication Channelscited by 7
  22. 2021Multi-Agent Curricula and Emergent Implicit Signalingcited by 6
  23. 2024Speaking Your Language: Spatial Relationships in Interpretable Emergent Communicationcited by 3
  24. 2020Reinforcement Communication Learning in Different Social Network Structurescited by 2
  25. 2024Semantics and Spatiality of Emergent Communicationcited by 2
  26. 2022Taming Multi-Agent Reinforcement Learning with Estimator Variance Reductioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
  2. 2025Collaboration and Conflict between Humans and Language Models through the Lens of Game Theory
  3. 2026The Rise of Verbal Reinforcement Learning
  4. 2024Searching for Structure: Investigating Emergent Communication with Large Language Models
  5. 2026SAGE: A Quantitative Evaluation of Socialized Evolution in Agent Ecosystems
  6. 2024Mimicry and the Emergence of Cooperative Communication ↗
  7. 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
  8. 2026Payoff scaling shapes cooperation in LLM agents across languages