mlsanityData to 14 Oct 2026

Shaping Shared Languages: Human and Large Language Models' Inductive Biases in Emergent Communication

arXiv 2503.04395 ↗First posted 6 Mar 2025cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human, LLM-LLM and Human-LLM experiments. We show that referentially grounded vocabularies emerge that enable reliable communication in all conditions, even when humans textitand LLMs collaborate. Comparisons between conditions reveal that languages optimised for LLMs subtly differ from those optimised for humans. Interestingly, interactions between humans and LLMs alleviate these differences and result in vocabularies more human-like than LLM-like. These findings advance our understanding of the role inductive biases in LLMs play in the dynamic nature of human language and contribute to maintaining alignment in human and machine communication. In particular, our work underscores the need to think of new LLM training methods that include human interaction and shows that using communicative success as a reward signal can be a fruitful, novel direction.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 24 of its 64 references that are in the map. First posted on arXiv 6 Mar 2025.

Builds on

24 of 64 references.

References · 24

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
  5. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
  6. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 170
  7. 2023Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMscited by 124
  8. 2022What Artificial Neural Networks Can Tell Us About Human Language Acquisitioncited by 99
  9. 2023Verbosity Bias in Preference Labeling by Large Language Modelscited by 91
  10. 2024"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Modelscited by 69
  11. 2023Machine Culturecited by 55
  12. 2025How Linguistics Learned to Stop Worrying and Love the Language Modelscited by 51
12 more
  1. 2024Mission: Impossible Language Modelscited by 32
  2. 2024Language Models as Models of Languagecited by 24
  3. 2024A distributional simplicity bias in the learning dynamics of transformerscited by 24
  4. 2023Bayes in the age of intelligent machinescited by 22
  5. 2024A Study on Large Language Models' Limitations in Multiple-Choice Question Answeringcited by 22
  6. 2023Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understandingcited by 20
  7. 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspectivecited by 17
  8. 2015A Roadmap towards Machine Intelligencecited by 15
  9. 2023What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structurecited by 13
  10. 2024Learning and communication pressures in neural networks: Lessons from emergent communicationcited by 8
  11. 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communicationcited by 7
  12. 2024What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.