A Neural Model for Word Repetition
Not on the map. Why?
Abstract (arXiv)
It takes several years for the developing brain of a baby to fully master word repetition-the task of hearing a word and repeating it aloud. Repeating a new word, such as from a new language, can be a challenging task also for adults. Additionally, brain damage, such as from a stroke, may lead to systematic speech errors with specific characteristics dependent on the location of the brain damage. Cognitive sciences suggest a model with various components for the different processing stages involved in word repetition. While some studies have begun to localize the corresponding regions in the brain, the neural mechanisms and how exactly the brain performs word repetition remain largely unknown. We propose to bridge the gap between the cognitive model of word repetition and neural mechanisms in the human brain by modeling the task using deep neural networks. Neural models are fully observable, allowing us to study the detailed mechanisms in their various substructures and make comparisons with human behavior and, ultimately, the brain. Here, we make first steps in this direction by: (1) training a large set of models to simulate the word repetition task; (2) creating a battery of tests to probe the models for known effects from behavioral studies in humans, and (3) simulating brain damage through ablation studies, where we systematically remove neurons from the model, and repeat the behavioral study to examine the resulting speech errors in the "patient" model. Our results show that neural models can mimic several effects known from human research, but might diverge in other aspects, highlighting both the potential and the challenges for future research aimed at developing human-like neural models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 54 references that are in the map. First posted on arXiv 16 Jun 2025.
Builds on
8 of 54 references.
References · 8
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2019The emergence of number and syntax units in LSTM language modelscited by 94
- 2020Mechanisms for Handling Nested Dependencies in Neural-Network Language Models and Humanscited by 42
- 2024Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representationscited by 3
- 2018Metric Learning for Phoneme Perceptioncited by 2
- 2024What Makes Two Language Models Think Alike?cited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.