mlsanityData to 14 Oct 2026

Breaking the Transcription Bottleneck: Fine-tuning ASR Models for Extremely Low-Resource Fieldwork Languages

arXiv 2506.17459 ↗First posted 20 Jun 2025cs.CL cs.SD eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

Automatic Speech Recognition (ASR) has reached impressive accuracy for high-resource languages, yet its utility in linguistic fieldwork remains limited. Recordings collected in fieldwork contexts present unique challenges, including spontaneous speech, environmental noise, and severely constrained datasets from under-documented languages. In this paper, we benchmark the performance of two fine-tuned multilingual ASR models, MMS and XLS-R, on five typologically diverse low-resource languages with control of training data duration. Our findings show that MMS is best suited when extremely small amounts of training data are available, whereas XLS-R shows parity performance once training data exceed one hour. We provide linguistically grounded analysis for further provide insights towards practical guidelines for field linguists, highlighting reproducible ASR adaptation approaches to mitigate the transcription bottleneck in language documentation.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 21 of its 61 references that are in the map. First posted on arXiv 20 Jun 2025.

Builds on

21 of 61 references.

References · 21

  1. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  5. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  7. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  8. 2021Unsupervised Speech Recognitioncited by 148
  9. 2019The Zero Resource Speech Challenge 2019: TTS without Tcited by 38
  10. 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
  11. 2022End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representationcited by 17
  12. 2021Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yolox'ochitl Mixteccited by 15
9 more
  1. 2021BembaSpeech: A Speech Recognition Corpus for the Bemba Languagecited by 14
  2. 2018Open Source Automatic Speech Recognition for Germancited by 8
  3. 2022Investigating data partitioning strategies for crosslinguistic low-resource ASR evaluationcited by 7
  4. 2022Improving Low-Resource Speech Recognition with Pretrained Speech Models: Continued Pretraining vs. Semi-Supervised Trainingcited by 6
  5. 2018Leveraging translations for speech transcription in low-resource settingscited by 5
  6. 2020User-friendly automatic transcription of low-resource languages: Plugging ESPnet into Elpiscited by 5
  7. 2024Efficient Adapter Finetuning for Tail Languages in Streaming Multilingual ASRcited by 4
  8. 2024Continued Pretraining for Domain Adaptation of Wav2vec2.0 in Automatic Speech Recognition for Elementary Math Classroom Settingscited by 4
  9. 2021Semi-supervised transfer learning for language expansion of end-to-end speech recognition models to low-resource languagescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.