A Hybrid Discriminative and Generative System for Universal Speech Enhancement
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
Universal speech enhancement aims at handling inputs with various speech distortions and recording conditions. In this work, we propose a novel hybrid architecture that synergizes the signal fidelity of discriminative modeling with the reconstruction capabilities of generative modeling. Our system utilizes the discriminative TF-GridNet model with the Sampling-Frequency-Independent strategy to handle variable sampling rates universally. In parallel, an autoregressive model combined with spectral mapping modeling generates detail-rich speech while effectively suppressing generative artifacts. Finally, a fusion network learns adaptive weights of the two outputs under the optimization of signal-level losses and the comprehensive Speech Quality Assessment (SQA) loss. Our proposed system is evaluated in the ICASSP 2026 URGENT Challenge (Track 1) and ranks the third place.
Key facts. Cited by 1 paper in the map (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 14 of its 20 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
14 of 20 references.
Closest ancestors · 2
Same direction, newest first
- 2025Improving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment13 Jun
- 2023Toward Universal Speech Enhancement for Diverse Input Conditions29 Sep
Other references · 12
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,599
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,135
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 988
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 552
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 425
- 2021DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressorscited by 292
- 2019Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separationcited by 275
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 270
- 2022TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separationcited by 121
- 2024Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Modelcited by 109
- 2024SCOREQ: Speech Quality Assessment with Contrastive Regressioncited by 49
- 2026ICASSP 2026 URGENT Speech Enhancement Challengecited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement
- 2025FUSE: Universal Speech Enhancement using Multi-Stage Fusion of Sparse Compression and Token Generation Models for the URGENT 2025 Challenge
- 2026GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement
- 2022Universal Speech Enhancement with Score-based Diffusion
- 2026Rethinking Training Targets, Architectures and Data Quality for Universal Speech Enhancement
- 2024Universal Score-based Speech Enhancement with High Content Preservation
- 2025Interspeech 2025 URGENT Speech Enhancement Challenge
- 2024Diffusion-based Generative Modeling with Discriminative Guidance for Streamable Speech Enhancement