Augmenting Dysarthric Speech Severity Assessment with MOS Supervision
Not on the map. Why?
Abstract (arXiv)
Dysarthria is a speech disorder marked by reduced intelligibility and communicative effectiveness. Automatic utterance-level assessment of dysarthric speech can support scalable speech monitoring and therapy-related analysis. Yet training such systems is bottlenecked by the scarcity of clinically annotated dysarthric speech. This work proposes to augment dysarthric speech assessment using data from speech synthesis evaluations, specifically human-annotated utterances with Mean Opinion Score (MOS) labels from the QualiSpeech corpus. Experiments show that fine-tuning on speech synthesis assessment data consistently improves performance on both intelligibility and naturalness prediction, while joint training yields gains primarily on naturalness. These results suggest that synthesis artifacts and dysarthric speech share perceptual commonalities, and speech synthesis evaluation corpora offer a practical augmentation source that reduces reliance on scarce clinical annotations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
37 of 51 references.
References · 37
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 189
- 2019MOSNet: Deep Learning based Objective Assessment for Voice Conversioncited by 126
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2021Generalization Ability of MOS Prediction Networkscited by 69
- 2022The VoiceMOS Challenge 2022cited by 57
25 more
- 2022Investigation of Data Augmentation Techniques for Disordered Speech Recognitioncited by 27
- 2025Audio Large Language Models Can Be Descriptive Speech Quality Evaluatorscited by 25
- 2021How do Voices from Past Speech Synthesis Challenges Compare Today?cited by 21
- 2021Adversarial Data Augmentation for Disordered Speech Recognitioncited by 18
- 2024Enhancing Pre-trained ASR System Fine-tuning for Dysarthric Speech Recognition using Adversarial Data Augmentationcited by 17
- 2022Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognitioncited by 16
- 2024CR-CTC: Consistency regularization on CTC for improved speech recognitioncited by 15
- 2023Wav2vec-based Detection and Severity Level Classification of Dysarthria from Speechcited by 14
- 2024Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesiscited by 14
- 2024Enabling Auditory Large Language Models for Automatic Speech Quality Evaluationcited by 13
- 2025QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptionscited by 13
- 2025The Interspeech 2025 Speech Accessibility Project Challengecited by 9
- 2023Use of Speech Impairment Severity for Dysarthric Speech Recognitioncited by 8
- 2024UNIT-DSR: Dysarthric Speech Reconstruction System Using Speech Unit Normalizationcited by 8
- 2022Adversarial Data Augmentation Using VAE-GAN for Disordered Speech Recognitioncited by 7
- 2025Measuring Prosody Diversity in Zero-Shot TTS: A New Metric, Benchmark, and Explorationcited by 7
- 2022Automatic Severity Classification of Dysarthric speech by using Self-supervised Model with Multi-task Learningcited by 6
- 2023DuTa-VC: A Duration-aware Typical-to-atypical Voice Conversion Approach with Diffusion Probabilistic Modelcited by 6
- 2024k2SSL: A Faster and Better Framework for Self-Supervised Speech Representation Learningcited by 6
- 2023Hyper-parameter Adaptation of Conformer ASR Systems for Elderly and Dysarthric Speech Recognitioncited by 4
- 2025Towards General Auditory Intelligence: Large Multimodal Models for Machine Listening and Speakingcited by 4
- 2026Towards Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-trainingcited by 4
- 2024Exploiting Audio-Visual Features with Pretrained AV-HuBERT for Multi-Modal Dysarthric Speech Reconstructioncited by 3
- 2025Facilitating Personalized TTS for Dysarthric Speakers Using Knowledge Anchoring and Curriculum Learningcited by 2
- 2025Position: Towards Responsible Evaluation for Text-to-Speechcited by 2
Built on by
Not cited yet.