Emergent Communication in Continuous Worlds: Self-Organisation of Conceptually Grounded Vocabularies at Scale
Not on the map. Why?
Abstract (arXiv)
This paper introduces a general methodology through which a population of autonomous agents can converge on a linguistic convention that enables them to refer to arbitrary entities in their environment. The linguistic convention emerges in a decentralised manner through local communicative interactions between pairs of agents drawn from the population. The emergent convention consists of associations between symbolic labels (word forms) and subsymbolic concept representations (word meanings) that are grounded in a continuous feature space. We confirm the generality and scalability of the method through its evaluation on a wide and diverse selection of 37 publicly available datasets. Through a range of experiments, we demonstrate the robustness of the method against perceptual variation, including in heteromorphic populations, as well as the ability of the emergent conventions to self-adapt to changes in the environment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 128 references that are in the map. First posted on arXiv 16 Jan 2024.
Builds on
28 of 128 references.
References · 28
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
- 2016Learning Multiagent Communication with Backpropagationcited by 355
- 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 257
- 2018TarMAC: Targeted Multi-Agent Communicationcited by 201
- 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
- 2017Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbolscited by 123
- 2020Compositionality and Generalization in Emergent Languagescited by 103
- 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
16 more
- 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
- 2020Compositional Languages Emerge in a Neural Iterated Learning Modelcited by 75
- 2018Emergent Communication through Negotiationcited by 62
- 2016Learning Language Games through Interactioncited by 43
- 2019EGG: a toolkit for research on Emergence of lanGuage in Gamescited by 42
- 2019Emergent Linguistic Phenomena in Multi-Agent Communication Gamescited by 36
- 2018Compositional Obverter Communication Learning From Raw Visual Inputcited by 30
- 2021Interpretable agent communication from scratch (with a generic visual processor emerging on the side)cited by 25
- 2022On the role of population heterogeneity in emergent communicationcited by 24
- 2021Emergent Communication under Competitioncited by 17
- 2021The Emergence of the Shape Bias Results from Communicative Efficiencycited by 13
- 2023Referential communication in heterogeneous communities of pre-trained visual deep networkscited by 10
- 2022Emergence of hierarchical reference systems in multi-agent communicationcited by 8
- 2020A Practical Guide to Studying Emergent Communication through Grounded Language Gamescited by 3
- 2023Context-dependent communication under environmental constraintscited by 2
- 2016Referential Uncertainty and Word Learning in High-dimensional, Continuous Meaning Spacescited by 1
Built on by
Not cited yet.