A phonetic model of non-native spoken word processing
Not on the map. Why?
Abstract (arXiv)
Non-native speakers show difficulties with spoken word processing. Many studies attribute these difficulties to imprecise phonological encoding of words in the lexical memory. We test an alternative hypothesis: that some of these difficulties can arise from the non-native speakers' phonetic perception. We train a computational model of phonetic learning, which has no access to phonology, on either one or two languages. We first show that the model exhibits predictable behaviors on phone-level and word-level discrimination tasks. We then test the model on a spoken word processing task, showing that phonology may not be necessary to explain some of the word processing effects observed in non-native speakers. We run an additional analysis of the model's lexical representation space, showing that the two training languages are not fully separated in that space, similarly to the languages of a bilingual human speaker.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 51 references that are in the map. First posted on arXiv 27 Jan 2021.
Builds on
13 of 51 references.
References · 13
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
- 2019An Unsupervised Autoregressive Model for Speech Representation Learningcited by 185
- 2020Syntactic Structure from Deep Learningcited by 99
- 2017The Zero Resource Speech Challenge 2017cited by 45
- 2020The Zero Resource Speech Challenge 2020: Discovering discrete subword and word unitscited by 39
- 2018Truly unsupervised acoustic word embeddings using weak top-down constraints in encoder-decoder modelscited by 29
- 2017Encoding of phonology in a recurrent neural model of grounded speechcited by 27
- 2018Phonetic-and-Semantic Embedding of Spoken Words with Applications in Spoken Content Retrievalcited by 11
- 2020Improved acoustic word embeddings for zero-resource languages using multilingual transfercited by 11
- 2020Multilingual acoustic word embedding models for processing zero-resource languagescited by 9
- 2020Analyzing autoencoder-based acoustic word embeddingscited by 7
1 more
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 1; 2024: 0; 2025: 1.
5 papers.
- 2021Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Studycited by 8
- 2021How Familiar Does That Sound? Cross-Lingual Representational Similarity Analysis of Acoustic Word Embeddingscited by 8
- 2022Integrating Form and Meaning: A Multi-Task Learning Model for Acoustic Word Embeddingscited by 2
- 2023Analyzing the Representational Geometry of Acoustic Word Embeddingscited by 2
- 2025Do Self-Supervised Speech Models Exhibit the Critical Period Effects in Language Acquisition?cited by 0
- 2025Do Self-Supervised Speech Models Exhibit the Critical Period Effects in Language Acquisition?28 Aug 2025
- 2023Analyzing the Representational Geometry of Acoustic Word Embeddings8 Jan 2023
- 2022Integrating Form and Meaning: A Multi-Task Learning Model for Acoustic Word Embeddings14 Sep 2022
- 2021How Familiar Does That Sound? Cross-Lingual Representational Similarity Analysis of Acoustic Word Embeddings21 Sep 2021
- 2021Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Study16 Jun 2021