mlsanityData to 14 Oct 2026

Investigating the Effects of Diffusion-based Conditional Generative Speech Models Used for Speech Enhancement on Dysarthric Speech

arXiv 2412.13933 ↗First posted 18 Dec 2024eess.AS cs.LG cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

In this study, we aim to explore the effect of pre-trained conditional generative speech models for the first time on dysarthric speech due to Parkinson's disease recorded in an ideal/non-noisy condition. Considering one category of generative models, i.e., diffusion-based speech enhancement, these models are previously trained to learn the distribution of clean (i.e, recorded in a noise-free environment) typical speech signals. Therefore, we hypothesized that when being exposed to dysarthric speech they might remove the unseen atypical paralinguistic cues during the enhancement process. By considering the automatic dysarthric speech detection task, in this study, we experimentally show that during the enhancement process of dysarthric speech data recorded in an ideal non-noisy environment, some of the acoustic dysarthric speech cues are lost. Therefore such pre-trained models are not yet suitable in the context of dysarthric speech enhancement since they manipulate the pathological speech cues when they process clean dysarthric speech. Furthermore, we show that the removed acoustics cues by the enhancement models in the form of residue speech signal can provide complementary dysarthric cues when fused with the original input speech signal in the feature space.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 32 references that are in the map. First posted on arXiv 18 Dec 2024.

Builds on

12 of 32 references.

References · 12

  1. 2017Squeeze-and-Excitation Networkscited by 4,789
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  3. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
  4. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 197
  5. 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
  6. 2022On using the UA-Speech and TORGO databases to validate automatic dysarthric speech classification approachescited by 13
  7. 2024Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditionscited by 11
  8. 2021Experimental investigation on STFT phase representations for deep learning-based dysarthric speech detectioncited by 7
  9. 2021Supervised Speech Representation Learning for Parkinson's Disease Classificationcited by 6
  10. 2020Automatic dysarthric speech detection exploiting pairwise distance-based convolutional neural networkscited by 3
  11. 2021Temporal envelope and fine structure cues for dysarthric speech detection using CNNscited by 3
  12. 2022Representation Learning Strategies to Model Pathological Speech: Effect of Multiple Spectral Resolutionscited by 1

Built on by

Not cited yet.