Influence of Clean Speech Characteristics on Speech Enhancement Performance
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
Speech enhancement (SE) performance is known to depend on noise characteristics and signal to noise ratio (SNR), yet intrinsic properties of the clean speech signal itself remain an underexplored factor. In this work, we systematically analyze how clean speech characteristics influence enhancement difficulty across multiple state of the art SE models, languages, and noise conditions. We extract a set of pitch, formant, loudness, and spectral flux features from clean speech and compute correlations with objective SE metrics, including frequency weighted segmental SNR and PESQ. Our results show that formant amplitudes are consistently predictive of SE performance, with higher and more stable formants leading to larger enhancement gains. We further demonstrate that performance varies substantially even within a single speaker's utterances, highlighting the importance of intraspeaker acoustic variability. These findings provide new insights into SE challenges, suggesting that intrinsic speech characteristics should be considered when designing datasets, evaluation protocols, and enhancement models.
Key facts. Cited by 2 papers in the map (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 18 of its 34 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
18 of 34 references.
Closest ancestors · 10
Same direction, newest first
- 2025Lessons Learned from the URGENT 2024 Speech Enhancement Challenge2 Jun
- 2024Schr"odinger Bridge for Generative Speech Enhancement22 Jul
- 2024Personalized Speech Enhancement Without a Separate Speaker Embedding Model14 Jun
- 2023Assessing the Generalization Gap of Learning-Based Speech Enhancement Systems in Noisy and Reverberant Environments12 Sep
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation22 Dec
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancement10 Feb
- 2021Personalized Speech Enhancement: New Models and Comprehensive Evaluation18 Oct
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Model25 Jul
- 2021Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillation8 May
Other references · 8
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,295
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,125
- 2018SDR - half-baked or well done?cited by 626
- 2020Improving noise robust automatic speech recognition with single-channel time-domain enhancement networkcited by 45
- 2023Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesiscited by 37
- 2019Deep-Learning-Based Audio-Visual Speech Enhancement in Presence of Lombard Effectcited by 6
- 2025Variational Autoencoder for Personalized Pathological Speech Enhancementcited by 4
- 2025Navigating PESQ: Up-to-Date Versions and Open Implementationscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Probing Layer-Wise Robustness and Sensitivity of Speech Enhancement Models
- 2026Perceptually Better, Semantically Worse: Measuring Speech Enhancement Impact on LLM-Based Voice Systems
- 2024Scale This, Not That: Investigating Key Dataset Attributes for Efficient Speech Enhancement Scaling
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement
- 2025Evaluating Multichannel Speech Enhancement Algorithms at the Phoneme Scale Across Genders
- 2022Improving Speech Enhancement through Fine-Grained Speech Characteristics
- 2026Too Good to Be True: A Study on Modern Automatic Speech Recognition for the Evaluation of Speech Enhancement
- 2023On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settings