mlsanityData to 7 Oct 2026

Speaker adaptation for Wav2vec2 based dysarthric ASR

arXiv 2204.00770 ↗First posted 2 Apr 2022cs.SD cs.AI cs.LGcited by 21

Not on the map. Why?

Abstract (arXiv)

Dysarthric speech recognition has posed major challenges due to lack of training data and heavy mismatch in speaker characteristics. Recent ASR systems have benefited from readily available pretrained models such as wav2vec2 to improve the recognition performance. Speaker adaptation using fMLLR and xvectors have provided major gains for dysarthric speech with very little adaptation data. However, integration of wav2vec2 with fMLLR features or xvectors during wav2vec2 finetuning is yet to be explored. In this work, we propose a simple adaptation network for fine-tuning wav2vec2 using fMLLR features. The adaptation network is also flexible to handle other speaker adaptive features such as xvectors. Experimental analysis show steady improvements using our proposed approach across all impairment severity levels and attains 57.72% WER for high severity in UASpeech dataset. We also performed experiments on German dataset to substantiate the consistency of our proposed approach across diverse domains.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 2 Apr 2022.

Builds on

11 of 26 references.

References · 11

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  3. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  4. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
  5. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  6. 2022Speaker Adaptation Using Spectro-Temporal Deep Features for Dysarthric and Elderly Speech Recognitioncited by 19
  7. 2021Adversarial Data Augmentation for Disordered Speech Recognitioncited by 18
  8. 2020Improved End-to-End Dysarthric Speech Recognition via Meta-learning Based Model Re-initializationcited by 17
  9. 2022Recent Progress in the CUHK Dysarthric Speech Recognition Systemcited by 17
  10. 2022Variational Auto-Encoder Based Variability Encoding for Dysarthric Speech Recognitioncited by 9
  11. 2021Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimizationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 4; 2025: 8; 2026: 2.

21 papers.

Sort:

By area:

  1. 2023Exploring Self-supervised Pre-trained ASR Models For Dysarthric and Elderly Speech Recognitioncited by 14
  2. 2024Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognitioncited by 9
  3. 2023Use of Speech Impairment Severity for Dysarthric Speech Recognitioncited by 8
  4. 2024Inclusive ASR for Disfluent Speech: Cascaded Large-Scale Self-Supervised Learning with Targeted Fine-Tuning and Data Augmentationcited by 5
  5. 2024Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognitioncited by 4
  6. 2025Adapting Foundation Speech Recognition Models to Impaired Speech: A Semantic Re-chaining Approach for Personalization of German Speechcited by 4
  7. 2023Debiased Automatic Speech Recognition for Dysarthric Speech via Sample Reweighting with Sample Affinity Testcited by 3
  8. 2025Variational Low-Rank Adaptation for Personalized Impaired Speech Recognitioncited by 3
  9. 2023Latent Phrase Matching for Dysarthric Speechcited by 2
  10. 2024Homogeneous Speaker Features for On-the-Fly Dysarthric and Elderly Speaker Adaptationcited by 2
  11. 2025DyPCL: Dynamic Phoneme-level Contrastive Learning for Dysarthric Speech Recognitioncited by 2
  12. 2023Unsupervised speech intelligibility assessment with utterance level alignment distance between teacher and learner Wav2Vec-2.0 representationscited by 1
9 more
  1. 2023Personalizing Keyword Spotting with Speaker Informationcited by 1
  2. 2025Robust Cross-Etiology and Speaker-Independent Dysarthric Speech Recognitioncited by 1
  3. 2025Regularized Federated Learning for Privacy-Preserving Dysarthric and Elderly Speech Recognitioncited by 1
  4. 2025Idiosyncratic Versus Normative Modeling of Atypical Speech Recognition: Dysarthric Case Studiescited by 1
  5. 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognitioncited by 1
  6. 2023Factorised Speaker-environment Adaptive Training of Conformer Speech Recognition Systemscited by 0
  7. 2025On-the-fly Routing for Zero-shot MoE Speaker Adaptation of Speech Foundation Models for Dysarthric Speech Recognitioncited by 0
  8. 2025EvolveCaptions: Empowering DHH Users Through Real-Time Collaborative Captioningcited by 0
  9. 2026Towards Personalized Federated Learning for Dysarthric Speech Recognitioncited by 0