mlsanityData to 7 Oct 2026

Repetition Without Exclusivity: Scale Sensitivity of Referential Mechanisms in Child-Scale Language Models

arXiv 2603.13696 ↗First posted 14 Mar 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present the first systematic evaluation of mutual exclusivity (ME) -- the bias to map novel words to novel referents -- in text-only language models trained on child-directed speech. We operationalise ME as referential suppression: when a familiar object is relabelled in a two-referent discourse context, ME predicts decreased probability of the labelled noun at a subsequent completion position. Three pilot findings motivate a pre-registered scale-sensitivity experiment: (1) a masked language model (BabyBERTa) is entirely insensitive to multi-sentence referential context; (2) autoregressive models show robust repetition priming -- the opposite of ME -- when familiar nouns are re-labelled; and (3) a novel context-dependence diagnostic reveals that apparent ME-like patterns with nonce tokens are fully explained by embedding similarity, not referential disambiguation. In the confirmatory experiment, we train 45 GPT-2-architecture models (2.9M, 8.9M, and 33.5M parameters; 5, 10, and 20 epochs on AO-CHILDES; 5 seeds each) and evaluate on a pre-registered ME battery. Anti-ME repetition priming is significant in all 9 cells (85-100% of items; all p < 2.4 x 10^-13). Priming attenuates with improved language modelling (Spearman rho = -0.533, p = 0.0002) but never crosses zero across a 3.8x perplexity range. The context-dependence diagnostic replicates in all 9 cells, and dose-response priming increases with repetitions in 8/9 cells (all trend p < 0.002). These findings indicate that distributional learning on child-directed speech produces repetition-based reference tracking rather than lexical exclusivity. We connect this to the grounded cognition literature and argue that referential grounding may be a necessary ingredient for ME -- an empirical claim about required input structure, not a nativist one.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

5 of 19 references.

References · 5

  1. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
  2. 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 86
  3. 2024Visually Grounded Speech Models have a Mutual Exclusivity Biascited by 3
  4. 2025MEBench: A Novel Benchmark for Understanding Mutual Exclusivity Bias in Vision-Language Modelscited by 1
  5. 2025The mutual exclusivity bias of bilingual visually grounded speech modelscited by 1

Built on by

Not cited yet.