Shaping Shared Languages: Human and Large Language Models' Inductive Biases in Emergent Communication
Not on the map. Why?
Abstract (arXiv)
Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human, LLM-LLM and Human-LLM experiments. We show that referentially grounded vocabularies emerge that enable reliable communication in all conditions, even when humans textitand LLMs collaborate. Comparisons between conditions reveal that languages optimised for LLMs subtly differ from those optimised for humans. Interestingly, interactions between humans and LLMs alleviate these differences and result in vocabularies more human-like than LLM-like. These findings advance our understanding of the role inductive biases in LLMs play in the dynamic nature of human language and contribute to maintaining alignment in human and machine communication. In particular, our work underscores the need to think of new LLM training methods that include human interaction and shows that using communicative success as a reward signal can be a fruitful, novel direction.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 24 of its 64 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
24 of 64 references.
References · 24
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
- 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 170
- 2023Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMscited by 124
- 2022What Artificial Neural Networks Can Tell Us About Human Language Acquisitioncited by 99
- 2023Verbosity Bias in Preference Labeling by Large Language Modelscited by 91
- 2024"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Modelscited by 69
- 2023Machine Culturecited by 55
- 2025How Linguistics Learned to Stop Worrying and Love the Language Modelscited by 51
12 more
- 2024Mission: Impossible Language Modelscited by 32
- 2024Language Models as Models of Languagecited by 24
- 2024A distributional simplicity bias in the learning dynamics of transformerscited by 24
- 2023Bayes in the age of intelligent machinescited by 22
- 2024A Study on Large Language Models' Limitations in Multiple-Choice Question Answeringcited by 22
- 2023Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understandingcited by 20
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspectivecited by 17
- 2015A Roadmap towards Machine Intelligencecited by 15
- 2023What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structurecited by 13
- 2024Learning and communication pressures in neural networks: Lessons from emergent communicationcited by 8
- 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communicationcited by 7
- 2024What does Kiki look like? Cross-modal associations between speech sounds and visual shapes in vision-and-language modelscited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 8.
10 papers.
- 2025ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipelinecited by 4
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Modelscited by 2
- 2025Losing our Tail, Again: (Un)Natural Selection & Multilingual LLMscited by 1
- 2026Model Collapse as Cultural Evolutioncited by 1
- 2026Private Etymology: Designing Relational Reuse of Shared Symbols in Long-Term Human-AI Interactioncited by 1
- 2026Traces of Social Competence in Large Language Modelscited by 0
- 2026Translating Signals to Languages for sEMG-Based Activity Recognitioncited by 0
- 2026A Dynamic-Semantics Framework for Grounding Human Referring Expressions in Visual Perceptual Datacited by 0
- 2026Detecting and Guiding LLM-Generated Korean Poetry with Interpretable Form-level Featurescited by 0
- 2026KoAGE: Do Large Language Models Know, Learn, and Coin Korean Neologisms?cited by 0
- 2026KoAGE: Do Large Language Models Know, Learn, and Coin Korean Neologisms?14 Oct 2026
- 2026Detecting and Guiding LLM-Generated Korean Poetry with Interpretable Form-level Features29 Aug 2026
- 2026A Dynamic-Semantics Framework for Grounding Human Referring Expressions in Visual Perceptual Data9 Aug 2026
- 2026Private Etymology: Designing Relational Reuse of Shared Symbols in Long-Term Human-AI Interaction9 Aug 2026
- 2026Model Collapse as Cultural Evolution21 May 2026
- 2026Translating Signals to Languages for sEMG-Based Activity Recognition21 May 2026
- 2026Traces of Social Competence in Large Language Models4 Mar 2026
- 2026Investigating the Development of Task-Oriented Communication in Vision-Language Models28 Jan 2026
- 2025ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipeline8 Aug 2025
- 2025Losing our Tail, Again: (Un)Natural Selection & Multilingual LLMs5 Jul 2025