Pseudowords as probes: Large Language Models show little of the sublexical sensitivity that governs human pseudoword processing
Not on the map. Why?
Abstract (arXiv)
Systematicity, the probabilistic mapping of form to meaning, permeates language at all levels, and sublexical cues have been shown to govern human pseudoword processing. Yet whether LLMs exhibit comparable sensitivity to these cues remains unclear. We tested five LLMs on two Italian two-alternative forced-choice pseudoword experiments and compared their responses with a human behavioural baseline. LLMs aligned more reliably with humans when real-word options provided a lexical familiarity cue than in the pseudoword-only condition, where they fell substantially below fastText, a character-n-gram model. In addition, the sublexical cosine-similarity cue that reliably drove human--fastText agreement did not consistently transfer to human--LLM alignment, and reasoning-token expenditure bore no consistent relation to human processing difficulty. These findings suggest that LLMs do not necessarily share the sublexical cues that govern human pseudoword processing; we discuss tokenization and training-data coverage as candidate explanations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Language Statistics and False Belief Reasoning: Evidence from 41 Open-Weight LMs
- 2025Fine-grained Analysis of Brain-LLM Alignment through Input Attribution
- 2025Using Perspectival Words Is Harder Than Vocabulary Words for Humans and Even More So for Multimodal Language Models
- 2022Language models and brains align due to more than next-word prediction and word-level information
- 2025Psycholinguistic Word Features: a New Approach for the Evaluation of LLMs Alignment with Humans
- 2025Word Overuse and Alignment in Large Language Models: The Influence of Learning from Human Feedback
- 2026Dual Alignment Between Language Model Layers and Human Sentence Processing
- 2025The Representational Alignment between Humans and Language Models is implicitly driven by a Concreteness Effect