Transformers over-extend what humans underlearn: the case of Spanish L-shaped morphome
Not on the map. Why?
Abstract (arXiv)
The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical artifacts? A neural network trained on distributional input offers a learnability test: if it recovers the pattern, the pattern is learnable from input statistics alone. We apply this test to the Spanish L-shaped morphome, where the first-person singular indicative stem appears in every present subjunctive cell despite lacking apparent phonological or semantic motivation. We further ask whether the frequency of irregular verbs in the input modulates generalization, evaluating transformers under three frequency conditions (10%, 50%, 90% irregular) and comparing them to human behavioral data. On full-form production from pseudoword inputs all models performed poorly, but all three conditions produced the correct stem more often than humans (43--49% vs. 33%). Response preferences revealed a clear divergence: humans consistently favored regular inflections, whereas models preferred irregular forms more as their proportion in training grew. Models in the naturalistic and balanced conditions were also sensitive to phonological similarity between pseudowords and real Spanish irregular verbs, an effect absent in humans. The L-shaped morphome is thus learnable from distributional input alone, but models generalize it qualitatively differently from humans.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 29 Jul 2025.
Builds on
14 of 52 references.
References · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 88
- 2016Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learnercited by 68
- 2019The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflectioncited by 43
- 2018The CoNLL--SIGMORPHON 2018 Shared Task: Universal Morphological Reinflectioncited by 41
- 2023Language acquisition: do children and language models follow similar learning stages?cited by 41
- 2017CoNLL-SIGMORPHON 2017 Shared Task: Universal Morphological Reinflection in 52 Languagescited by 40
- 2020SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflectioncited by 39
- 2018Recurrent Neural Networks in Linguistic Theory: Revisiting Pinker and Prince (1988) and the Past Tense Debatecited by 27
- 2021(Un)solving Morphological Inflection: Lemma Overlap Artificially Inflates Models' Performancecited by 20
- 2020Inflecting when there's no majority: Limitations of encoder-decoder neural networks as cognitive models for German pluralscited by 13
- 2021Can a Transformer Pass the Wug Test? Tuning Copying Bias in Neural Morphological Inflection Modelscited by 13
Built on by
Not cited yet.