mlsanityData to 7 Oct 2026

A framework for the emergence and analysis of language in social learning agents

arXiv 2305.02632 ↗First posted 4 May 2023cs.CL cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Artificial neural networks (ANNs) are increasingly used as research models, but questions remain about their generalizability and representational invariance. Biological neural networks under social constraints evolved to enable communicable representations, demonstrating generalization capabilities. This study proposes a communication protocol between cooperative agents to analyze the formation of individual and shared abstractions and their impact on task performance. This communication protocol aims to mimic language features by encoding high-dimensional information through low-dimensional representation. Using grid-world mazes and reinforcement learning, teacher ANNs pass a compressed message to a student ANN for better task completion. Through this, the student achieves a higher goal-finding rate and generalizes the goal location across task worlds. Further optimizing message content to maximize student reward improves information encoding, suggesting that an accurate representation in the space of messages requires bi-directional input. This highlights the role of language as a common representation between agents and its implications on generalization capabilities.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 95 references that are in the map. First posted on arXiv 4 May 2023.

Builds on

32 of 95 references.

References · 32

  1. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
  2. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  3. 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 257
  4. 2018An Introduction to Deep Reinforcement Learningcited by 201
  5. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
  6. 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 180
  7. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 168
  8. 2019A Review of Cooperative Multi-Agent Deep Reinforcement Learningcited by 147
  9. 2022Language Models as Agent Modelscited by 131
  10. 2017Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbolscited by 123
  11. 2020Compositionality and Generalization in Emergent Languagescited by 103
  12. 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
20 more
  1. 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
  2. 2016Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learnercited by 68
  3. 2019On the Pitfalls of Measuring Emergent Communicationcited by 66
  4. 2019Anti-efficient encoding in emergent communicationcited by 59
  5. 2019The PhotoBook Dataset: Building Common Ground through Visually-Grounded Dialoguecited by 46
  6. 2020Emergent Social Learning via Multi-agent Reinforcement Learningcited by 44
  7. 2021Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responsescited by 34
  8. 2022On the role of population heterogeneity in emergent communicationcited by 24
  9. 2018Learning Goal Embeddings via Self-Play for Hierarchical Reinforcement Learningcited by 23
  10. 2020"LazImpa": Lazy and Impatient neural agents learn to communicate efficientlycited by 23
  11. 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?cited by 23
  12. 2017Emergent Translation in Multi-Agent Communicationcited by 22
  13. 2021Emergent Discrete Communication in Semantic Spacescited by 20
  14. 2020Learning to cooperate: Emergent communication in multi-agent navigationcited by 18
  15. 2020Emergence of Pragmatics from Referential Game between Theory of Mind Agentscited by 17
  16. 2020Emergent Language Generalization and Acquisition Speed are not tied to Compositionalitycited by 17
  17. 2019Shaping representations through communication: community size effect in artificial learning systemscited by 14
  18. 2022Continual task learning in natural and artificial agentscited by 12
  19. 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approachescited by 12
  20. 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictabilitycited by 11

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.