Ad hoc conventions generalize to new referents
Not on the map. Why?
Abstract (arXiv)
How do people talk about things they've never talked about before? One view suggests that a new shared naming system establishes an arbitrary link to a specific target, like proper names that cannot extend beyond their bearers. An alternative view proposes that forming a shared way of describing objects involves broader conceptual alignment, reshaping each individual's semantic space in ways that should generalize to new referents. We test these competing accounts in a dyadic communication study (N=302) leveraging the recently-released KiloGram dataset containing over 1,000 abstract tangram images. After pairs of participants coordinated on referential conventions for one set of images through repeated communication, we measured the extent to which their descriptions aligned for undiscussed images. We found strong evidence for generalization: partners showed increased alignment relative to their pre-test labels. Generalization also decayed nonlinearly with visual similarity (consistent with Shepard's law) and was robust across levels of the images' nameability. These findings suggest that ad hoc conventions are not arbitrary labels but reflect genuine conceptual coordination, with implications for theories of reference and the design of more adaptive language agents.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 75 references that are in the map. First posted on arXiv 6 Sep 2025.
Builds on
18 of 75 references.
References · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Open Problems in Cooperative AIcited by 168
- 2023Latent Space Translation via Semantic Alignmentcited by 52
- 2019The PhotoBook Dataset: Building Common Ground through Visually-Grounded Dialoguecited by 46
- 2022Abstract Visual Reasoning with Tangram Shapescited by 43
- 2019Characterizing the dynamics of learning in repeated reference gamescited by 34
- 2019Continual adaptation for efficient machine communicationcited by 28
- 2021From partners to populations: A hierarchical Bayesian account of coordination and conventioncited by 27
- 2020Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contextscited by 22
- 2022Continual Learning for Instruction Following from Realtime Feedbackcited by 22
- 2020Empirica: a virtual lab for high-throughput macro-level experimentscited by 16
6 more
- 2025Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Modelscited by 14
- 2024Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challengecited by 13
- 2021Maintaining Common Ground in Dynamic Environmentscited by 9
- 2025Language-Informed Synthesis of Rational Agent Models for Grounded Theory-of-Mind Reasoning On-The-Flycited by 6
- 2021Shades of confusion: Lexical uncertainty modulates ad hoc coordination in an interactive communication taskcited by 5
- 2023The Universal Law of Generalization Holds for Naturalistic Stimulicited by 4
Built on by
Not cited yet.