Do Language Models Know What Not to Say? Causal Evidence for Statistical Preemption in LLMs
Not on the map. Why?
Abstract (arXiv)
How do learners acquire knowledge of what is unacceptable without negative evidence? Construction Grammar proposes statistical preemption: exposure to a conventional form (e.g., "donated the books to the library") preempts structurally possible but unattested alternatives ("*donated the library the books"). We present a computational study that, for the first time, directly dissociates statistical preemption from the competing entrenchment hypothesis in large language models within a single converging design. Across four experiments spanning 120 English verb-construction pairings (dative, causative, locative), we show that (1) LLM surprisal patterns correlate strongly with human acceptability judgments (r = 0.79), validated against three independent behavioral datasets; (2) these patterns are driven by competing-form frequency rather than overall verb frequency, confirmed by non-circular partial correlations; (3) preemption sensitivity scales as a power law with model size; and (4) a controlled fine-tuning intervention causally demonstrates that manipulating competing-form frequencies shifts preemption behavior in the predicted direction, with reverse-direction controls ruling out frequency-sensitivity confounds. These results provide converging evidence that neural language models acquire negative linguistic knowledge through distributional competition, the core mechanism posited by Construction Grammar.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 87 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
24 of 87 references.
References · 24
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2018Neural Network Acceptability Judgmentscited by 952
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
- 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 512
- 2016Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependenciescited by 350
- 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
- 2018Targeted Syntactic Evaluation of Language Modelscited by 239
- 2018Colorless green recurrent networks dream hierarchicallycited by 210
- 2020A Systematic Assessment of Syntactic Generalization in Neural Language Modelscited by 163
- 2019Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic Statecited by 137
12 more
- 2020Syntactic Structure from Deep Learningcited by 99
- 2022What Artificial Neural Networks Can Tell Us About Human Language Acquisitioncited by 97
- 2023Testing the Predictions of Surprisal Theory in 11 Languagescited by 75
- 2024Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNscited by 65
- 2024Language models align with human judgments on key grammatical constructionscited by 49
- 2023Dissociating language and thought in large language modelscited by 27
- 2022Neural reality of argument structure constructionscited by 25
- 2020Investigating representations of verb bias in neural language modelscited by 22
- 2024Missed Causes and Ambiguous Effects: Counterfactuals Pose Challenges for Interpreting Neural Networkscited by 21
- 2025Both Direct and Indirect Evidence Contribute to Dative Alternation Preferences in Language Modelscited by 18
- 2025Construction Identification and Disambiguation Using BERT: A Case Study of NPNcited by 4
- 2025Performance and competence intertwined: A computational model of the Null Subject stage in English-speaking childrencited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.