Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology
Not on the map. Why?
Abstract (arXiv)
This study explores voice cloning to generate synthetic speech replicating the unique patterns of individuals with dysarthria. Using the TORGO dataset, we address data scarcity and privacy challenges in speech-language pathology. Our contributions include demonstrating that voice cloning preserves dysarthric speech characteristics, analyzing differences between real and synthetic data, and discussing implications for diagnostics, rehabilitation, and communication. We cloned voices from dysarthric and control speakers using a commercial platform, ensuring gender-matched synthetic voices. A licensed speech-language pathologist (SLP) evaluated a subset for dysarthria, speaker gender, and synthetic indicators. The SLP correctly identified dysarthria in all cases and speaker gender in 95% but misclassified 30% of synthetic samples as real, indicating high realism. Our results suggest synthetic speech effectively captures disordered characteristics and that voice cloning has advanced to produce high-quality data resembling real speech, even to trained professionals. This has critical implications for healthcare, where synthetic data can mitigate data scarcity, protect privacy, and enhance AI-driven diagnostics. By enabling the creation of diverse, high-quality speech datasets, voice cloning can improve generalizable models, personalize therapy, and advance assistive technologies for dysarthria. We publicly release our synthetic dataset to foster further research and collaboration, aiming to develop robust models that improve patient outcomes in speech-language pathology.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 28 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
7 of 28 references.
References · 7
- 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 154
- 2019Synthetic Data for Deep Learningcited by 113
- 2018Neural Voice Cloning with a Few Samplescited by 100
- 2019Generating Synthetic Audio Data for Attention-Based Speech Recognition Systemscited by 47
- 2019Emotional Voice Conversion using Multitask Learning with Text-to-speechcited by 15
- 2018Simulating dysarthric speech for training data augmentation in clinical speech applicationscited by 14
- 2021Artificially Synthesising Data for Audio Classification and Segmentation to Improve Speech and Music Detection in Radio Broadcastcited by 2
Built on by
Not cited yet.