DeepFilterGAN: A Full-band Real-time Speech Enhancement System with GAN-based Stochastic Regeneration
Not on the map. Why?
Abstract (arXiv)
In this work, we propose a full-band real-time speech enhancement system with GAN-based stochastic regeneration. Predictive models focus on estimating the mean of the target distribution, whereas generative models aim to learn the full distribution. This behavior of predictive models may lead to over-suppression, i.e. the removal of speech content. In the literature, it was shown that combining a predictive model with a generative one within the stochastic regeneration framework can reduce the distortion in the output. We use this framework to obtain a real-time speech enhancement system. With 3.58M parameters and a low latency, our system is designed for real-time streaming with a lightweight architecture. Experiments show that our system improves over the first stage in terms of NISQA-MOS metric. Finally, through an ablation study, we show the importance of noisy conditioning in our system. We participated in 2025 Urgent Challenge with our model and later made further improvements.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
16 of 24 references.
References · 16
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 354
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 197
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 192
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2022ICASSP 2022 Deep Noise Suppression Challengecited by 60
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2024Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakerscited by 28
- 2024Schr"odinger Bridge for Generative Speech Enhancementcited by 27
- 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audiocited by 24
- 2024Universal Score-based Speech Enhancement with High Content Preservationcited by 23
- 2024URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancementcited by 17
4 more
- 2022High Fidelity Speech Enhancement with Band-split RNNcited by 16
- 2023D2Former: A Fully Complex Dual-Path Dual-Decoder Conformer Network using Joint Complex Masking and Complex Spectral Mapping for Monaural Speech Enhancementcited by 2
- 2024Combined Generative and Predictive Modeling for Speech Super-resolutioncited by 1
- 2024Spectral oversubtraction? An approach for speech enhancement after robot ego speech filtering in semi-real-timecited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.