Meta Learning for End-to-End Low-Resource Speech Recognition
Not on the map. Why?
Abstract (arXiv)
In this paper, we proposed to apply meta learning approach for low-resource automatic speech recognition (ASR). We formulated ASR for different languages as different tasks, and meta-learned the initialization parameters from many pretraining languages to achieve fast adaptation on unseen target language, via recently proposed model-agnostic meta learning algorithm (MAML). We evaluated the proposed approach using six languages as pretraining tasks and four languages as target tasks. Preliminary results showed that the proposed method, MetaASR, significantly outperforms the state-of-the-art multitask pretraining approach on all target languages with different combinations of pretraining languages. In addition, since MAML's model-agnostic property, this paper also opens new research direction of applying meta learning to more speech-related applications.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 5; 2024: 3; 2025: 4; 2026: 1.
29 papers.
Sort:
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
- 2021Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptationcited by 50
- 2021Exploiting Adapters for Cross-lingual Low-resource Speech Recognitioncited by 33
- 2023MoLE : Mixture of Language Experts for Multi-Lingual Automatic Speech Recognitioncited by 31
- 2021End-to-End Speech Recognition from Federated Acoustic Modelscited by 30
- 2022Meta Learning for Natural Language Processing: A Surveycited by 26
- 2021Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognitioncited by 16
- 2021On sensitivity of meta-learning to support datacited by 15
- 2023Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular Learningcited by 9
- 2022Improved Meta Learning for Low Resource Speech Recognitioncited by 7
- 2022Text-To-Speech Data Augmentation for Low Resource Speech Recognitioncited by 6
17 more
- 2025Low-Rank and Sparse Model Merging for Multi-Lingual Speech Recognition and Translationcited by 6
- 2024SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognitioncited by 4
- 2021Phoneme Recognition through Fine Tuning of Phonetic Representations: a Case Study on Luhya Language Varietiescited by 2
- 2021Rapid Model Architecture Adaption for Meta-Learningcited by 2
- 2024Meta-Learning in Audio and Speech Processing: An End to End Comprehensive Reviewcited by 2
- 2021Challenges and Opportunities of Speech Recognition for Bengali Languagecited by 1
- 2022Towards Better Meta-Initialization with Task Augmentation for Kindergarten-aged Speech Recognitioncited by 1
- 2023Multilingual Sentence-Level Semantic Search using Meta-Distillation Learningcited by 1
- 2023PhasePerturbation: Speech Data Augmentation via Phase Perturbation for Automatic Speech Recognitioncited by 1
- 2025SpidR-Adapt: A Universal Speech Representation Model for Few-Shot Adaptationcited by 1
- 2022Adaptive Activation Network For Low Resource Multilingual Speech Recognitioncited by 0
- 2022Meta Auxiliary Learning for Low-resource Spoken Language Understandingcited by 0
- 2023A meta learning scheme for fast accent domain expansion in Mandarin speech recognitioncited by 0
- 2024Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learningcited by 0
- 2025Adaptive Clipping for Privacy-Preserving Few-Shot Learning: Enhancing Generalization with Limited Datacited by 0
- 2025Heterogeneous Self-Supervised Acoustic Pre-Training with Local Constraintscited by 0
- 2026Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluationcited by 0
- 2026Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation16 Jun 2026
- 2025SpidR-Adapt: A Universal Speech Representation Model for Few-Shot Adaptation24 Dec 2025
- 2025Heterogeneous Self-Supervised Acoustic Pre-Training with Local Constraints27 Aug 2025
- 2025Adaptive Clipping for Privacy-Preserving Few-Shot Learning: Enhancing Generalization with Limited Data27 Mar 2025
- 2025Low-Rank and Sparse Model Merging for Multi-Lingual Speech Recognition and Translation24 Feb 2025
- 2024Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learning2 Dec 2024
- 2024SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognition16 Sep 2024
- 2024Meta-Learning in Audio and Speech Processing: An End to End Comprehensive Review19 Aug 2024
- 2023PhasePerturbation: Speech Data Augmentation via Phase Perturbation for Automatic Speech Recognition13 Dec 2023
- 2023Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning15 Sep 2023
- 2023A meta learning scheme for fast accent domain expansion in Mandarin speech recognition23 Jul 2023
- 2023Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular Learning23 Jun 2023
17 more
- 2023MoLE : Mixture of Language Experts for Multi-Lingual Automatic Speech Recognition27 Feb 2023
- 2022Meta Auxiliary Learning for Low-resource Spoken Language Understanding26 Jun 2022
- 2022Adaptive Activation Network For Low Resource Multilingual Speech Recognition28 May 2022
- 2022Improved Meta Learning for Low Resource Speech Recognition11 May 2022
- 2022Meta Learning for Natural Language Processing: A Survey3 May 2022
- 2022Text-To-Speech Data Augmentation for Low Resource Speech Recognition1 Apr 2022
- 2022Towards Better Meta-Initialization with Task Augmentation for Kindergarten-aged Speech Recognition24 Feb 2022
- 2021Recent Advances in End-to-End Automatic Speech Recognition2 Nov 2021
- 2021On sensitivity of meta-learning to support data26 Oct 2021
- 2021Challenges and Opportunities of Speech Recognition for Bengali Language27 Sep 2021
- 2021Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognition19 Sep 2021
- 2021Rapid Model Architecture Adaption for Meta-Learning10 Sep 2021
- 2021Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation16 Jun 2021
- 2021Exploiting Adapters for Cross-lingual Low-resource Speech Recognition18 May 2021
- 2021End-to-End Speech Recognition from Federated Acoustic Models29 Apr 2021
- 2021Phoneme Recognition through Fine Tuning of Phonetic Representations: a Case Study on Luhya Language Varieties4 Apr 2021
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond27 Jan 2021
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
- 2021Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptationcited by 50
- 2021Exploiting Adapters for Cross-lingual Low-resource Speech Recognitioncited by 33
- 2023MoLE : Mixture of Language Experts for Multi-Lingual Automatic Speech Recognitioncited by 31
- 2021End-to-End Speech Recognition from Federated Acoustic Modelscited by 30
- 2022Meta Learning for Natural Language Processing: A Surveycited by 26
- 2021Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognitioncited by 16
- 2021On sensitivity of meta-learning to support datacited by 15
- 2023Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular Learningcited by 9
- 2022Improved Meta Learning for Low Resource Speech Recognitioncited by 7
- 2022Text-To-Speech Data Augmentation for Low Resource Speech Recognitioncited by 6
12 most cited of 29 All 29 (JSON)
- 2026Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation16 Jun 2026
- 2025SpidR-Adapt: A Universal Speech Representation Model for Few-Shot Adaptation24 Dec 2025
- 2025Heterogeneous Self-Supervised Acoustic Pre-Training with Local Constraints27 Aug 2025
- 2025Adaptive Clipping for Privacy-Preserving Few-Shot Learning: Enhancing Generalization with Limited Data27 Mar 2025
- 2025Low-Rank and Sparse Model Merging for Multi-Lingual Speech Recognition and Translation24 Feb 2025
- 2024Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learning2 Dec 2024
- 2024SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognition16 Sep 2024
- 2024Meta-Learning in Audio and Speech Processing: An End to End Comprehensive Review19 Aug 2024
- 2023PhasePerturbation: Speech Data Augmentation via Phase Perturbation for Automatic Speech Recognition13 Dec 2023
- 2023Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning15 Sep 2023
- 2023A meta learning scheme for fast accent domain expansion in Mandarin speech recognition23 Jul 2023
- 2023Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular Learning23 Jun 2023
12 newest of 29 All 29 (JSON)