Exploring the Impact of Data Quantity on ASR in Extremely Low-resource Languages
Not on the map. Why?
Abstract (arXiv)
This study investigates the efficacy of data augmentation techniques for low-resource automatic speech recognition (ASR), focusing on two endangered Austronesian languages, Amis and Seediq. Recognizing the potential of self-supervised learning (SSL) in low-resource settings, we explore the impact of data volume on the continued pre-training of SSL models. We propose a novel data-selection scheme leveraging a multilingual corpus to augment the limited target language data. This scheme utilizes a language classifier to extract utterance embeddings and employs one-class classifiers to identify utterances phonetically and phonologically proximate to the target languages. Utterances are ranked and selected based on their decision scores, ensuring the inclusion of highly relevant data in the SSL-ASR pipeline. Our experimental results demonstrate the effectiveness of this approach, yielding substantial improvements in ASR performance for both Amis and Seediq. These findings underscore the feasibility and promise of data augmentation through cross-lingual transfer learning for low-resource language ASR.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 13 Sep 2024.
Builds on
21 of 30 references.
References · 21
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
9 more
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
- 2021Textless Speech-to-Speech Translation on Real Datacited by 121
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
- 2023Making More of Little Data: Improving Low-Resource Automatic Speech Recognition Using Data Augmentationcited by 30
- 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
- 2024Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokenscited by 11
- 2022A Compact End-to-End Model with Local and Global Context for Spoken Language Identificationcited by 4
- 2023Leveraging supplementary text data to kick-start automatic speech recognition system development with limited transcriptionscited by 4
Built on by
Not cited yet.