The Emergence of Compositional Languages for Numeric Concepts Through Iterated Learning in Neural Agents
Not on the map. Why?
Abstract (arXiv)
Since first introduced, computer simulation has been an increasingly important tool in evolutionary linguistics. Recently, with the development of deep learning techniques, research in grounded language learning has also started to focus on facilitating the emergence of compositional languages without pre-defined elementary linguistic knowledge. In this work, we explore the emergence of compositional languages for numeric concepts in multi-agent communication systems. We demonstrate that compositional language for encoding numeric concepts can emerge through iterated learning in populations of deep neural network agents. However, language properties greatly depend on the input representations given to agents. We found that compositional languages only emerge if they require less iterations to be fully learnt than other non-degenerate languages for agents on a given input representation.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 5; 2024: 7; 2025: 3; 2026: 3.
26 papers.
Sort:
By area:
- 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?cited by 23
- 2021Iterated learning for emergent systematicity in VQAcited by 21
- 2021Multi-label Iterated Learning for Image Classification with Label Ambiguitycited by 19
- 2022Linking Emergent and Natural Languages via Corpus Transfercited by 19
- 2024Iterated Learning Improves Compositionality in Large Vision-Language Modelscited by 17
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspectivecited by 17
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 13
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictabilitycited by 11
- 2022Emergent Quantized Communicationcited by 7
- 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communicationcited by 7
- 2024lpNTK: Better Generalisation with Less Data via Sample Interaction During Learningcited by 6
14 more
- 2023Visual Referential Games Further the Emergence of Disentangled Representationscited by 5
- 2023Learning Multi-Object Positional Relationships via Emergent Communicationcited by 4
- 2025Unsupervised Translation of Emergent Communicationcited by 3
- 2022Meta-Referential Games to Learn Compositional Learning Behaviourscited by 2
- 2024ELCC: the Emergent Language Corpus Collectioncited by 2
- 2025Implicit Repair with Reinforcement Learning in Emergent Communicationcited by 2
- 2023Discrete Messages Improve Communication Efficiency among Isolated Intelligent Agentscited by 1
- 2024Learning Efficient Recursive Numeral Systems via Reinforcement Learningcited by 1
- 2026Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systemscited by 1
- 2022Using Representation Expressiveness and Learnability to Evaluate Self-Supervised Learning Methodscited by 0
- 2023ETHER: Aligning Emergent Communication for Hindsight Experience Replaycited by 0
- 2025Cognitively-Inspired Emergent Communication via Knowledge Graphs for Assisting the Visually Impairedcited by 0
- 2026Evaluating the relationship between regularity and learnability in recursive numeral systems using Reinforcement Learningcited by 0
- 2026Math Takes Two: A test for emergent mathematical reasoning in communicationcited by 0
- 2026Math Takes Two: A test for emergent mathematical reasoning in communication30 Mar 2026
- 2026Evaluating the relationship between regularity and learnability in recursive numeral systems using Reinforcement Learning25 Feb 2026
- 2026Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems29 Jan 2026
- 2025Cognitively-Inspired Emergent Communication via Knowledge Graphs for Assisting the Visually Impaired28 May 2025
- 2025Implicit Repair with Reinforcement Learning in Emergent Communication18 Feb 2025
- 2025Unsupervised Translation of Emergent Communication11 Feb 2025
- 2024Learning Efficient Recursive Numeral Systems via Reinforcement Learning11 Sep 2024
- 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communication25 Jul 2024
- 2024ELCC: the Emergent Language Corpus Collection4 Jul 2024
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspective4 Apr 2024
- 2024Iterated Learning Improves Compositionality in Large Vision-Language Models2 Apr 2024
14 more
- 2024lpNTK: Better Generalisation with Less Data via Sample Interaction During Learning16 Jan 2024
- 2023Discrete Messages Improve Communication Efficiency among Isolated Intelligent Agents26 Dec 2023
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Research1 Aug 2023
- 2023ETHER: Aligning Emergent Communication for Hindsight Experience Replay28 Jul 2023
- 2023Visual Referential Games Further the Emergence of Disentangled Representations27 Apr 2023
- 2023Learning Multi-Object Positional Relationships via Emergent Communication16 Feb 2023
- 2022Emergent Quantized Communication4 Nov 2022
- 2022Meta-Referential Games to Learn Compositional Learning Behaviours16 Jul 2022
- 2022Using Representation Expressiveness and Learnability to Evaluate Self-Supervised Learning Methods2 Jun 2022
- 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?22 Apr 2022
- 2022Linking Emergent and Natural Languages via Corpus Transfer24 Mar 2022
- 2021Multi-label Iterated Learning for Image Classification with Label Ambiguity23 Nov 2021
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictability7 Jun 2021
- 2021Iterated learning for emergent systematicity in VQA3 May 2021
- 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
- 2025Implicit Repair with Reinforcement Learning in Emergent Communicationcited by 2
- 2024Learning Efficient Recursive Numeral Systems via Reinforcement Learningcited by 1
- 2026Evaluating the relationship between regularity and learnability in recursive numeral systems using Reinforcement Learningcited by 0
- 2026Evaluating the relationship between regularity and learnability in recursive numeral systems using Reinforcement Learning25 Feb 2026
- 2025Implicit Repair with Reinforcement Learning in Emergent Communication18 Feb 2025
- 2024Learning Efficient Recursive Numeral Systems via Reinforcement Learning11 Sep 2024
- 2024A Review of the Applications of Deep Learning-Based Emergent Communication3 Jul 2024
- 2022Emergent Communication for Understanding Human Language Evolution: What's Missing?cited by 23
- 2021Iterated learning for emergent systematicity in VQAcited by 21
- 2021Multi-label Iterated Learning for Image Classification with Label Ambiguitycited by 19
- 2022Linking Emergent and Natural Languages via Corpus Transfercited by 19
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspectivecited by 17
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 13
- 2021Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictabilitycited by 11
- 2022Emergent Quantized Communicationcited by 7
- 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communicationcited by 7
- 2024lpNTK: Better Generalisation with Less Data via Sample Interaction During Learningcited by 6
- 2023Visual Referential Games Further the Emergence of Disentangled Representationscited by 5
- 2023Learning Multi-Object Positional Relationships via Emergent Communicationcited by 4
12 most cited of 20 All 20 (JSON)
- 2026Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems29 Jan 2026
- 2025Cognitively-Inspired Emergent Communication via Knowledge Graphs for Assisting the Visually Impaired28 May 2025
- 2025Unsupervised Translation of Emergent Communication11 Feb 2025
- 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communication25 Jul 2024
- 2024ELCC: the Emergent Language Corpus Collection4 Jul 2024
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspective4 Apr 2024
- 2024lpNTK: Better Generalisation with Less Data via Sample Interaction During Learning16 Jan 2024
- 2023Discrete Messages Improve Communication Efficiency among Isolated Intelligent Agents26 Dec 2023
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Research1 Aug 2023
- 2023ETHER: Aligning Emergent Communication for Hindsight Experience Replay28 Jul 2023
- 2023Visual Referential Games Further the Emergence of Disentangled Representations27 Apr 2023
- 2023Learning Multi-Object Positional Relationships via Emergent Communication16 Feb 2023
12 newest of 20 All 20 (JSON)