mlsanityData to 14 Oct 2026

Transformers over-extend what humans underlearn: the case of Spanish L-shaped morphome

arXiv 2507.21556 ↗First posted 29 Jul 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical artifacts? A neural network trained on distributional input offers a learnability test: if it recovers the pattern, the pattern is learnable from input statistics alone. We apply this test to the Spanish L-shaped morphome, where the first-person singular indicative stem appears in every present subjunctive cell despite lacking apparent phonological or semantic motivation. We further ask whether the frequency of irregular verbs in the input modulates generalization, evaluating transformers under three frequency conditions (10%, 50%, 90% irregular) and comparing them to human behavioral data. On full-form production from pseudoword inputs all models performed poorly, but all three conditions produced the correct stem more often than humans (43--49% vs. 33%). Response preferences revealed a clear divergence: humans consistently favored regular inflections, whereas models preferred irregular forms more as their proportion in training grew. Models in the naturalistic and balanced conditions were also sensitive to phonological similarity between pseudowords and real Spanish irregular verbs, an effect absent in humans. The L-shaped morphome is thus learnable from distributional input alone, but models generalize it qualitatively differently from humans.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

14 of 52 references.

References · 14

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 88
  3. 2016Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learnercited by 68
  4. 2019The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflectioncited by 43
  5. 2018The CoNLL--SIGMORPHON 2018 Shared Task: Universal Morphological Reinflectioncited by 41
  6. 2023Language acquisition: do children and language models follow similar learning stages?cited by 41
  7. 2017CoNLL-SIGMORPHON 2017 Shared Task: Universal Morphological Reinflection in 52 Languagescited by 40
  8. 2020SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflectioncited by 39
  9. 2018Recurrent Neural Networks in Linguistic Theory: Revisiting Pinker and Prince (1988) and the Past Tense Debatecited by 27
  10. 2021(Un)solving Morphological Inflection: Lemma Overlap Artificially Inflates Models' Performancecited by 20
  11. 2020Inflecting when there's no majority: Limitations of encoder-decoder neural networks as cognitive models for German pluralscited by 13
  12. 2021Can a Transformer Pass the Wug Test? Tuning Copying Bias in Neural Morphological Inflection Modelscited by 13
2 more
  1. 2024Frequency matters: Modeling irregular morphological patterns in Spanish with Transformerscited by 5
  2. 2024Is deeper always better? Replacing linear mappings with deep learning networks in the Discriminative Lexicon Modelcited by 4

Built on by

Not cited yet.