Instruction-Tuned Models Locally Reuse Human Syntax More Than Humans Do
Not on the map. Why?
Abstract (arXiv)
Syntactic convergence (the tendency of speakers to adapt in language towards the grammatical profiles of their interlocutors) is a well-documented feature of human dialogue widely considered to operate below conscious awareness. Whether large language models exhibit analogous syntactic convergence toward human users relative to human baselines and across a broad range of syntactic constructions remains an open question. Using substitution-paradigm data in which model generations replace one speaker's turns in pre-existing human dialogues, this study measures turn-adjacent reuse of context-free grammar (CFG) rules across sixteen open-weight Llama and Gemma models (1B-70B, pretrained and instruction-tuned) at 1,901 matched positions per model. Every model showed greater CFG-rule overlap with the preceding human turn than with a sampled unrelated human prime, and in every model this actual-versus-random difference was larger for lower-frequency rules. Each instruction-tuned model also showed greater natural-output overlap with the actual prime than the human response it replaced, and all eight matched architecture pairs exhibited greater actual-prime overlap after instruction tuning. However, relative to pretrained variants, instruction-tuned outputs overlapped more with unrelated primes, showed a smaller actual-versus-random increment, and had lower conditional rule-reuse odds once target rule-set size was held constant. In exploratory analyses, each model exhibited greater mean lexical and semantic similarity to the preceding turn than the matched human responses did. Instruction-tuned models additionally produced responses with greater mean semantic similarity than their pretrained counterparts in all eight architecture pairs, whereas the lexical similarity results were more heterogeneous.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
12 of 31 references.
References · 12
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2018Constituency Parsing with a Self-Attentive Encodercited by 196
- 2018Multilingual Constituency Parsing with Self-Attention and Pre-Trainingcited by 117
- 2021Structural Persistence in Language Models: Priming as a Window into Abstract Language Representationscited by 44
- 2023Do large language models resemble humans in language use?cited by 34
- 2024Do Language Models Exhibit Human-like Structural Priming Effects?cited by 21
- 2023Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Modelscited by 16
- 2025LLMs syntactically adapt their language use to their conversational partnercited by 15
- 2025Do language models accommodate their users? A study of linguistic convergencecited by 7
- 2026Accommodation Goes Both Ways: Studying Linguistic Convergence Between Humans and Language Modelscited by 2
Built on by
Not cited yet.