Evaluating the Effect of Linguistic Relatedness on Cross-Lingual Transfer in Large Multilingual Automatic Speech Recognition
Not on the map. Why?
Abstract (arXiv)
Extending automatic speech recognition (ASR) to low-resource African languages is constrained by the prohibitive demands of data collection at scale. A promising direction is to leverage the linguistic relatedness between a low-resource target language and languages previously seen by a model to reduce the volume of target-language data needed for effective adaptation. Although this approach has proven reliable for text-based models, its effectiveness in the speech domain remains contested. We employ a systematic controlled experimental design spanning six factors, two Africa-centric corpora, and four large ASR models, sequentially adapting on a related auxiliary language followed by the target to isolate whether linguistic relatedness reliably predicts cross-lingual transfer gains across these conditions. In every setting, pre-adaptation on related auxiliary languages yields no practically meaningful improvements once as little as one hour of target-language data is available, suggesting that relatedness alone may not reliably predict transfer gains in large multilingual ASR, or constitute an effective strategy for extending such models to low-resource languages.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
21 of 31 references.
References · 21
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
- 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
- 2020Are All Languages Created Equal in Multilingual BERT?cited by 206
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
9 more
- 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
- 2020Masakhane -- Machine Translation For Africacited by 48
- 2024LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASRcited by 35
- 2023Zero-shot cross-lingual transfer language selection using linguistic similaritycited by 28
- 2023Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languagescited by 20
- 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
- 2024Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokenscited by 11
- 2026WAXAL: A Large-Scale Multilingual African Language Speech Corpuscited by 10
- 2025Building low-resource African language corpora: A case study of Kidawida, Kalenjin and Dholuocited by 2
Built on by
Not cited yet.