How to train your ears: Auditory-model emulation for large-dynamic-range inputs and mild-to-severe hearing losses
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
Advanced auditory models are useful in designing signal-processing algorithms for hearing-loss compensation or speech enhancement. Such auditory models provide rich and detailed descriptions of the auditory pathway, and might allow for individualization of signal-processing strategies, based on physiological measurements. However, these auditory models are often computationally demanding, requiring significant time to compute. To address this issue, previous studies have explored the use of deep neural networks to emulate auditory models and reduce inference time. While these deep neural networks offer impressive efficiency gains in terms of computational time, they may suffer from uneven emulation performance as a function of auditory-model frequency-channels and input sound pressure level, making them unsuitable for many tasks. In this study, we demonstrate that the conventional machine-learning optimization objective used in existing state-of-the-art methods is the primary source of this limitation. Specifically, the optimization objective fails to account for the frequency- and level-dependencies of the auditory model, caused by a large input dynamic range and different types of hearing losses emulated by the auditory model. To overcome this limitation, we propose a new optimization objective that explicitly embeds the frequency- and level-dependencies of the auditory model. Our results show that this new optimization objective significantly improves the emulation performance of deep neural networks across relevant input sound levels and auditory-model frequency channels, without increasing the computational load during inference. Addressing these limitations is essential for advancing the application of auditory models in signal-processing tasks, ensuring their efficacy in diverse scenarios.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 6 of its 28 references that are in the map. First posted on arXiv 15 Mar 2024.
Builds on
6 of 28 references.
References · 6
- 2014Adam: A Method for Stochastic Optimizationcited by 38,210
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 864
- 2018Wave-U-Net: A Multi-Scale Neural Network for End-to-End Audio Source Separationcited by 153
- 2020A convolutional neural-network model of human cochlear mechanics and filter tuning for real-time applicationscited by 6
- 2022A Neural-Network Framework for the Design of Individualised Hearing-Loss Compensationcited by 6
- 2021A comparative study of eight human auditory models of monaural processingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Hearing-Loss Compensation Using Deep Neural Networks: A Framework and Results From a Listening Test
- 2025dCoNNear: An Artifact-Free Neural Network Architecture for Closed-loop Audio Signal Processing
- 2026Directivity-Conditioned Low-Latency Neural Filtering for Speech Enhancement in Hearing Aids
- 2021A Deep Learning Loss Function based on Auditory Power Compression for Speech Enhancement
- 2024A Survey of Deep Learning Audio Generation Methods
- 2026Addressing Limited Data in Auditory Attention Decoding with Diffusion Generative Models
- 2026ABSE-NET: A Lightweight Neural Model for Active Binaural Speech Enhancement in Open-Fit Hearing Aids
- 2022Low-Level Physiological Implications of End-to-End Learning of Speech Recognition