Towards Robust Assessment of Pathological Voices via Combined Low-Level Descriptors and Foundation Model Representations
Not on the map. Why?
Abstract (arXiv)
Perceptual voice quality assessment plays a vital role in diagnosing and monitoring voice disorders. Traditional methods, such as the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) and the Grade, Roughness, Breathiness, Asthenia, and Strain (GRBAS) scales, rely on expert raters and are prone to inter-rater variability, emphasizing the need for objective solutions. This study introduces the Voice Quality Assessment Network (VOQANet), a deep learning framework that employs an attention mechanism and Speech Foundation Model (SFM) embeddings to extract high-level features. To further enhance performance, we propose VOQANet+, which integrates self-supervised SFM embeddings with low-level acoustic descriptors-namely jitter, shimmer, and harmonics-to-noise ratio (HNR). Unlike previous approaches that focus solely on vowel-based phonation (PVQD-A), our models are evaluated on both vowel-level and sentence-level speech (PVQD-S) to assess generalizability. Experimental results demonstrate that sentence-based inputs yield higher accuracy, particularly at the patient level. Overall, VOQANet consistently outperforms baseline models in terms of root mean squared error (RMSE) and Pearson correlation coefficient across CAPE-V and GRBAS dimensions, with VOQANet+ achieving even greater performance gains. Additionally, VOQANet+ maintains consistent performance under noisy conditions, suggesting enhanced robustness for real-world and telehealth applications. This work highlights the value of combining SFM embeddings with low-level features for accurate and robust pathological voice assessment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 50 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
18 of 50 references.
References · 18
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2022Audio Self-supervised Learning: A Surveycited by 65
- 2021Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Featurescited by 33
- 2022Boosting Self-Supervised Embeddings for Speech Enhancementcited by 24
- 2022Hybrid Handcrafted and Learnable Audio Representation for Analysis of Speech Under Cognitive and Physical Loadcited by 6
- 2024Voice Disorder Analysis: a Transformer-based Approachcited by 5
- 2022Continuous Speech for Improved Learning Pathological Voice Disorderscited by 4
- 2024Whisper-SV: Adapting Whisper for Low-data-resource Speaker Verificationcited by 4
- 2022Robust Vocal Quality Feature Embeddings for Dysphonic Voice Detectioncited by 3
6 more
- 2024HAAQI-Net: A Non-intrusive Neural Music Audio Quality Assessment Model for Hearing Aidscited by 3
- 2020Perceptually inspired weighted MSE optimization using irregularity-aware graph Fourier transformcited by 2
- 2024Predicting Heart Activity from Speech using Data-driven and Knowledge-based featurescited by 2
- 2021Toward Real-World Voice Disorder Classificationcited by 1
- 2023Multi-objective Non-intrusive Hearing-aid Speech Assessment Modelcited by 1
- 2023Lightly Weighted Automatic Audio Parameter Extraction for the Quality Assessment of Consensus Auditory-Perceptual Evaluation of Voicecited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.