mlsanityData to 14 Oct 2026

Automatic or Controlled? Repetition Priming Reveals Divergent Processing in Base LLMs, Instruct LLMs, and Humans

arXiv 2608.14681 ↗First posted 5 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Words recur constantly in natural language use, yet it remains unclear whether language models reactivate prior representations or re-evaluate repeated words afresh, and whether post-training changes this default behavior. We apply repetition priming (Shiffrin and Schneider, 1977) to 15 models across five model families (1.5B-14B parameters) in two tasks, semantic categorization and cloze completion, with matched human experiments using identical stimuli. We find that base models exhibit automatic processing: they show immediate facilitation that remains stable across lags, partially survives context removal, and correlates with attention to prior occurrences. Instruct models exhibit controlled processing: their facilitation decays with lag, collapses without expected context, and reverses to interference at larger scales. Within the Qwen 2.5 family, this dissociation increases monotonically with model scale, suggesting that post-training progressively alters repetition processing. Humans show a hybrid profile, with lag-sensitive facilitation resembling instruct models but without interference, suggesting that neither model type fully captures human cognition. Our findings reveal a qualitative shift in how language models process repeated information after post-training and provide mechanistic evidence for the divergence between model behaviors.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

16 of 35 references.

References · 16

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Language Models as Knowledge Bases?cited by 1,936
  4. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
  5. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  6. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  7. 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 684
  8. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  9. 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
  10. 2024Instruction-tuned Language Models are Better Knowledge Learnerscited by 55
  11. 2021Structural Persistence in Language Models: Priming as a Window into Abstract Language Representationscited by 44
  12. 2020Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Primingcited by 41
4 more
  1. 2023Humans and language models diverge when predicting repeating textcited by 13
  2. 2025Repetitions are not all alike: distinct mechanisms sustain repetition in language modelscited by 10
  3. 2024HLB: Benchmarking LLMs' Humanlikeness in Language Usecited by 8
  4. 2024A Tale of Trust and Accuracy: Base vs. Instruct LLMs in RAG Systemscited by 3

Built on by

Not cited yet.