mlsanityData to 14 Oct 2026

Leveraging Multiple Speech Enhancers for Non-Intrusive Intelligibility Prediction for Hearing-Impaired Listeners

arXiv 2509.16979 ↗First posted 21 Sep 2025cs.SD cs.AI eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Speech intelligibility evaluation for hearing-impaired (HI) listeners is essential for assessing hearing aid performance, traditionally relying on listening tests or intrusive methods like HASPI. However, these methods require clean reference signals, which are often unavailable in real-world conditions, creating a gap between lab-based and real-world assessments. To address this, we propose a non-intrusive intelligibility prediction framework that leverages speech enhancers to provide a parallel enhanced-signal pathway, enabling robust predictions without reference signals. We evaluate three state-of-the-art enhancers and demonstrate that prediction performance depends on the choice of enhancer, with ensembles of strong enhancers yielding the best results. To improve cross-dataset generalization, we introduce a 2-clips augmentation strategy that enhances listener-specific variability, boosting robustness on unseen datasets. Our approach consistently outperforms the non-intrusive baseline, CPC2 Champion across multiple datasets, highlighting the potential of enhancer-guided non-intrusive intelligibility prediction for real-world applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 21 Sep 2025.

Builds on

13 of 19 references.

References · 13

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  4. 2020The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Resultscited by 133
  5. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 124
  6. 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 58
  7. 2023MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectracited by 52
  8. 2022FRCRN: Boosting Feature Representation using Frequency Recurrence for Monaural Speech Enhancementcited by 26
  9. 2025Granary: Speech Recognition and Translation Dataset in 25 European Languagescited by 22
  10. 2024Speech foundation models on intelligibility prediction for hearing-impaired listenerscited by 6
  11. 2025ZipEnhancer: Dual-Path Down-Up Sampling-based Zipformer for Monaural Speech Enhancementcited by 5
  12. 2025Unveiling the Best Practices for Applying Speech Foundation Models to Speech Intelligibility Prediction for Hearing-Impaired Peoplecited by 3
1 more
  1. 2025Non-Intrusive Intelligibility Prediction for Hearing Aids: Recent Advances, Trends, and Challengescited by 1

Built on by

Not cited yet.