# Investigating the Effects of Diffusion-based Conditional Generative Speech Models Used for Speech Enhancement on Dysarthric Speech

arXiv: https://arxiv.org/abs/2412.13933 · HTML: https://mlsanity.com/paper/2412.13933/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 12 of its 32 references that are in the map.
- First posted on arXiv 18 Dec 2024.

## Builds on (most cited first, 12 of 12)

- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [DiffWave: A Versatile Diffusion Model for Audio Synthesis](https://mlsanity.com/paper/2009.09761/) (2020)
- [SUPERB: Speech processing Universal PERformance Benchmark](https://mlsanity.com/paper/2105.01051/) (2021)
- [Speech Enhancement and Dereverberation with Diffusion-based Generative Models](https://mlsanity.com/paper/2208.05830/) (2022)
- [Conditional Diffusion Probabilistic Model for Speech Enhancement](https://mlsanity.com/paper/2202.05256/) (2022)
- [On using the UA-Speech and TORGO databases to validate automatic dysarthric speech classification approaches](https://mlsanity.com/paper/2211.08833/) (2022)
- [Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditions](https://mlsanity.com/paper/2406.16128/) (2024)
- [Experimental investigation on STFT phase representations for deep learning-based dysarthric speech detection](https://mlsanity.com/paper/2110.03283/) (2021)
- [Supervised Speech Representation Learning for Parkinson's Disease Classification](https://mlsanity.com/paper/2106.00531/) (2021)
- [Automatic dysarthric speech detection exploiting pairwise distance-based convolutional neural networks](https://mlsanity.com/paper/2011.07545/) (2020)
- [Temporal envelope and fine structure cues for dysarthric speech detection using CNNs](https://mlsanity.com/paper/2108.11153/) (2021)
- [Representation Learning Strategies to Model Pathological Speech: Effect of Multiple Spectral Resolutions](https://mlsanity.com/paper/2209.08379/) (2022)

## Abstract (arXiv)

In this study, we aim to explore the effect of pre-trained conditional generative speech models for the first time on dysarthric speech due to Parkinson's disease recorded in an ideal/non-noisy condition. Considering one category of generative models, i.e., diffusion-based speech enhancement, these models are previously trained to learn the distribution of clean (i.e, recorded in a noise-free environment) typical speech signals. Therefore, we hypothesized that when being exposed to dysarthric speech they might remove the unseen atypical paralinguistic cues during the enhancement process. By considering the automatic dysarthric speech detection task, in this study, we experimentally show that during the enhancement process of dysarthric speech data recorded in an ideal non-noisy environment, some of the acoustic dysarthric speech cues are lost. Therefore such pre-trained models are not yet suitable in the context of dysarthric speech enhancement since they manipulate the pathological speech cues when they process clean dysarthric speech. Furthermore, we show that the removed acoustics cues by the enhancement models in the form of residue speech signal can provide complementary dysarthric cues when fused with the original input speech signal in the feature space.
