mlsanityData to 7 Oct 2026

Towards More Human-like AI Communication: A Review of Emergent Communication Research

arXiv 2308.02541 ↗First posted 1 Aug 2023cs.CL cs.AI cs.HCcited by 12

Not on the map. Why?

Abstract (arXiv)

In the recent shift towards human-centric AI, the need for machines to accurately use natural language has become increasingly important. While a common approach to achieve this is to train large language models, this method presents a form of learning misalignment where the model may not capture the underlying structure and reasoning humans employ in using natural language, potentially leading to unexpected or unreliable behavior. Emergent communication (Emecom) is a field of research that has seen a growing number of publications in recent years, aiming to develop artificial agents capable of using natural language in a way that goes beyond simple discriminative tasks and can effectively communicate and learn new concepts. In this review, we present Emecom under two aspects. Firstly, we delineate all the common proprieties we find across the literature and how they relate to human interactions. Secondly, we identify two subcategories and highlight their characteristics and open challenges. We encourage researchers to work together by demonstrating that different methods can be viewed as diverse solutions to a common problem and emphasize the importance of including diverse perspectives and expertise in the field. We believe a deeper understanding of human communication is crucial to developing machines that can accurately use natural language in human-machine interactions.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 101 of its 184 references that are in the map. First posted on arXiv 1 Aug 2023.

Builds on

101 of 184 references.

References · 101

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  7. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  8. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  9. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  10. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  11. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
  12. 2016Learning Multiagent Communication with Backpropagationcited by 355
38 more
  1. 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 260
  2. 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 257
  3. 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
  4. 2018Machine Theory of Mindcited by 222
  5. 2017Learning with Opponent-Learning Awarenesscited by 218
  6. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
  7. 2018TarMAC: Targeted Multi-Agent Communicationcited by 201
  8. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
  9. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 168
  10. 2019Language as an Abstraction for Hierarchical Deep Reinforcement Learningcited by 138
  11. 2017Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbolscited by 123
  12. 2014Neural Variational Inference and Learning in Belief Networkscited by 116
  13. 2020How Can We Accelerate Progress Towards Human-like Linguistic Generalization?cited by 114
  14. 2020Compositionality and Generalization in Emergent Languagescited by 103
  15. 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
  16. 2020Learning Latent Representations to Influence Multi-Agent Interactioncited by 92
  17. 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
  18. 2019Measuring Compositionality in Representation Learningcited by 84
  19. 2020Compositional Languages Emerge in a Neural Iterated Learning Modelcited by 75
  20. 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 70
  21. 2016Reasoning About Pragmatics with Neural Listeners and Speakerscited by 68
  22. 2019On the Pitfalls of Measuring Emergent Communicationcited by 66
  23. 2019Ease-of-Teaching and Language Structure from Emergent Communicationcited by 65
  24. 2020Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learningcited by 65
  25. 2018Modeling Others using Oneself in Multi-Agent Reinforcement Learningcited by 64
  26. 2016Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Changecited by 63
  27. 2018Emergent Communication through Negotiationcited by 62
  28. 2019Learning Efficient Multi-agent Communication: An Information Bottleneck Approachcited by 60
  29. 2019Anti-efficient encoding in emergent communicationcited by 59
  30. 2019Linguistic generalization and compositionality in modern artificial neural networkscited by 58
  31. 2020Countering Language Drift with Seeded Iterated Learningcited by 57
  32. 2019Countering Language Drift via Visual Groundingcited by 55
  33. 2018Learning Policy Representations in Multiagent Systemscited by 48
  34. 2019Biases for Emergent Communication in Multi-agent Reinforcement Learningcited by 48
  35. 2018Learning to Teach in Cooperative Multiagent Reinforcement Learningcited by 45
  36. 2018How agents see things: On visual representations in an emergent language gamecited by 45
  37. 2021Discrete-Valued Neural Communicationcited by 39
  38. 2022Fortuitous Forgetting in Connectionist Networkscited by 39

50 most cited of 101 All 101 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 5; 2026: 2.

12 papers.