SLICE: Speech Enhancement via Layer-wise Injection of Conditioning Embeddings
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
Real-world speech is often corrupted by multiple degradations simultaneously, including additive noise, reverberation, and nonlinear distortion. Diffusion-based enhancement methods perform well on single degradations but struggle with compound corruptions. Prior noise-aware approaches inject conditioning at the input layer only, which can degrade performance below that of an unconditioned model. To address this, we propose injecting degradation conditioning, derived from a pretrained encoder with multi-task heads for noise type, reverberation, and distortion, into the timestep embedding so that it propagates through all residual blocks without architectural changes. In controlled experiments where only the injection method varies, input-level conditioning performs worse than no encoder at all on compound degradations, while layer-wise injection achieves the best results. The method also generalizes to diverse real-world recordings.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 23 of its 32 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
23 of 32 references.
Closest ancestors · 12
Same direction, newest first
- 2025Diffusion Buffer: Online Diffusion-based Speech Enhancement with Sub-Second Latency3 Jun
- 2025Lessons Learned from the URGENT 2024 Speech Enhancement Challenge2 Jun
- 2025Few-step Adversarial Schr"odinger Bridge for Generative Speech Enhancement2 Jun
- 2025Interspeech 2025 URGENT Speech Enhancement Challenge29 May
- 2025Universal Speech Enhancement with Regression and Generative Mamba27 May
- 2025TS-URGENet: A Three-stage Universal Robust and Generalizable Speech Enhancement Network24 May
- 2023NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement3 Sep
- 2023Noise-aware Speech Enhancement using Diffusion Probabilistic Model16 Jul
- 2023MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra23 May
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancement10 Feb
- 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancement8 Apr
Other references · 11
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,295
- 2022Classifier-Free Diffusion Guidancecited by 5,991
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,135
- 2018SDR - half-baked or well done?cited by 626
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 552
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 422
- 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 175
- 2020HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networkscited by 58
- 2022VoiceFixer: A Unified Framework for High-Fidelity Speech Restorationcited by 57
- 2018Voices Obscured in Complex Environmental Settings (VOICES) corpuscited by 47
- 2024Non-intrusive Speech Quality Assessment with Diffusion Models Trained on Clean Speechcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Probing Layer-Wise Robustness and Sensitivity of Speech Enhancement Models
- 2025Test-Time Adaptation for Speech Enhancement via Domain Invariant Embedding Transformation
- 2026Unsupervised Speech Enhancement via Drifting
- 2025EDNet: A Versatile Speech Enhancement Framework with Gating Mamba Mechanism and Phase Shift-Invariant Training
- 2026Mitigating Over-Suppression in Speech Enhancement via Inference-Time Rethink-and-Refine Correction Module
- 2022Universal Speech Enhancement with Score-based Diffusion
- 2025ArtiFree: Detecting and Reducing Generative Artifacts in Diffusion-based Speech Enhancement
- 2025Do We Need EMA for Diffusion-Based Speech Enhancement? Toward a Magnitude-Preserving Network Architecture