TripleC Learning and Lightweight Speech Enhancement for Multi-Condition Target Speech Extraction
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
In our recent work, we proposed Lightweight Speech Enhancement Guided Target Speech Extraction (LGTSE) and demonstrated its effectiveness in multi-speaker-plus-noise scenarios. However, real-world applications often involve more diverse and complex conditions, such as one-speaker-plus-noise or two-speaker-without-noise. To address this challenge, we extend LGTSE with a Cross-Condition Consistency learning strategy, termed TripleC Learning. This strategy is first validated under multi-speaker-plus-noise condition and then evaluated for its generalization across diverse scenarios. Moreover, building upon the lightweight front-end denoiser in LGTSE, which can flexibly process both noisy and clean mixtures and shows strong generalization to unseen conditions, we integrate TripleC learning with a proposed parallel universal training scheme that organizes batches containing multiple scenarios for the same target speaker. By enforcing consistent extraction across different conditions, easier cases can assist harder ones, thereby fully exploiting diverse training data and fostering a robust universal model. Experimental results on the Libri2Mix three-condition tasks demonstrate that the proposed LGTSE with TripleC learning achieves superior performance over condition-specific models, highlighting its strong potential for universal deployment in real-world speech applications.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 22 of its 32 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
22 of 32 references.
Closest ancestors · 9
Same direction, newest first
- 2025Lightweight speech enhancement guided target speech extraction in noisy multi-speaker scenarios27 Aug
- 2025Unified Architecture and Unsupervised Speech Disentanglement for Speaker Embedding-Free Enrollment in Personalized Speech Enhancement18 May
- 2025SEF-PNet: Speaker Encoder-Free Personalized Speech Enhancement with Local and Global Contexts Aggregation20 Jan
- 2024Personalized Speech Enhancement Without a Separate Speaker Embedding Model14 Jun
- 2023DDTSE: Discriminative Diffusion Model for Target Speech Extraction25 Sep
- 2023The NPU-Elevoc Personalized Speech Enhancement System for ICASSP2023 DNS Challenge13 Mar
- 2023A Framework for Unified Real-time Personalized and Non-Personalized Speech Enhancement23 Feb
- 2022High Fidelity Speech Enhancement with Band-split RNN1 Dec
- 2022Dynamic Acoustic Compensation and Adaptive Focal Training for Personalized Speech Enhancement22 Nov
Other references · 13
- 2018SDR - half-baked or well done?cited by 626
- 2020LibriMix: An Open-Source Dataset for Generalizable Speech Separationcited by 219
- 2022ICASSP 2022 Deep Noise Suppression Challengecited by 107
- 2023ICASSP 2023 Deep Noise Suppression Challengecited by 101
- 2020ICASSP 2021 Deep Noise Suppression Challengecited by 57
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 35
- 2025Metis: A Foundation Speech Generation Model with Masked Generative Pre-trainingcited by 17
- 2023X-SepFormer: End-to-end Speaker Extraction Network with Explicit Optimization on Speaker Confusioncited by 16
- 2021DPCCN: Densely-Connected Pyramid Complex Convolutional Network for Robust Speech Separation And Extractioncited by 12
- 2024Target Speaker Extraction by Directly Exploiting Contextual Information in the Time-Frequency Domaincited by 11
- 2024USEF-TSE: Universal Speaker Embedding Free Target Speaker Extractioncited by 10
- 2024Multi-Level Speaker Representation for Target Speaker Extractioncited by 7
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2021Incorporating Multi-Target in Multi-Stage Speech Enhancement Model for Better Generalization
- 2023Toward Universal Speech Enhancement for Diverse Input Conditions
- 2023Unifying Speech Enhancement and Separation with Gradient Modulation for End-to-End Noise-Robust Speech Separation
- 2026Challenges of Multi-Speaker Extraction for Real Conversational Speech Enhancement
- 2023Multi-Channel Target Speaker Extraction with Refinement: The WavLab Submission to the Second Clarity Enhancement Challenge
- 2025FUSE: Universal Speech Enhancement using Multi-Stage Fusion of Sparse Compression and Token Generation Models for the URGENT 2025 Challenge
- 2023Gradient Remedy for Multi-Task Learning in End-to-End Noise-Robust Speech Recognition
- 2023A Single Speech Enhancement Model Unifying Dereverberation, Denoising, Speaker Counting, Separation, and Extraction