On-the-Fly Feature Based Rapid Speaker Adaptation for Dysarthric and Elderly Speech Recognition
Not on the map. Why?
Abstract (arXiv)
Accurate recognition of dysarthric and elderly speech remain challenging tasks to date. Speaker-level heterogeneity attributed to accent or gender, when aggregated with age and speech impairment, create large diversity among these speakers. Scarcity of speaker-level data limits the practical use of data-intensive model based speaker adaptation methods. To this end, this paper proposes two novel forms of data-efficient, feature-based on-the-fly speaker adaptation methods: variance-regularized spectral basis embedding (SVR) and spectral feature driven f-LHUC transforms. Experiments conducted on UASpeech dysarthric and DementiaBank Pitt elderly speech corpora suggest the proposed on-the-fly speaker adaptation approaches consistently outperform baseline iVector adapted hybrid DNN/TDNN and E2E Conformer systems by statistically significant WER reduction of 2.48%-2.85% absolute (7.92%-8.06% relative), and offline model based LHUC adaptation by 1.82% absolute (5.63% relative) respectively.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 55 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
14 of 55 references.
References · 14
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2019Personalizing ASR for Dysarthric and Accented Speech with Limited Datacited by 45
- 2016Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptationcited by 38
- 2022Investigation of Data Augmentation Techniques for Disordered Speech Recognitioncited by 27
- 2022Speaker Adaptation Using Spectro-Temporal Deep Features for Dysarthric and Elderly Speech Recognitioncited by 19
- 2021Adversarial Data Augmentation for Disordered Speech Recognitioncited by 18
- 2020Improved End-to-End Dysarthric Speech Recognition via Meta-learning Based Model Re-initializationcited by 17
- 2022Recent Progress in the CUHK Dysarthric Speech Recognition Systemcited by 17
- 2022Spectro-Temporal Deep Features for Disordered Speech Assessment and Recognitioncited by 13
- 2020Bayesian Learning for Deep Neural Network Adaptationcited by 9
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 1.
5 papers.
- 2024Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognitioncited by 9
- 2024Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognitioncited by 4
- 2024Homogeneous Speaker Features for On-the-Fly Dysarthric and Elderly Speaker Adaptationcited by 2
- 2025DyPCL: Dynamic Phoneme-level Contrastive Learning for Dysarthric Speech Recognitioncited by 2
- 2026Analyzing Speech Condition Effects in Dysarthric ASR: A Layer-wise Probing Studycited by 0
- 2026Analyzing Speech Condition Effects in Dysarthric ASR: A Layer-wise Probing Study3 Aug 2026
- 2025DyPCL: Dynamic Phoneme-level Contrastive Learning for Dysarthric Speech Recognition31 Jan 2025
- 2024Homogeneous Speaker Features for On-the-Fly Dysarthric and Elderly Speaker Adaptation8 Jul 2024
- 2024Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognition3 Jul 2024
- 2024Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognition14 Jun 2024