Posterior Transition Modeling for Unsupervised Diffusion-Based Speech Enhancement
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
We explore unsupervised speech enhancement using diffusion models as expressive generative priors for clean speech. Existing approaches guide the reverse diffusion process using noisy speech through an approximate, noise-perturbed likelihood score, combined with the unconditional score via a trade-off hyperparameter. In this work, we propose two alternative algorithms that directly model the conditional reverse transition distribution of diffusion states. The first method integrates the diffusion prior with the observation model in a principled way, removing the need for hyperparameter tuning. The second defines a diffusion process over the noisy speech itself, yielding a fully tractable and exact likelihood score. Experiments on the WSJ0-QUT and VoiceBank-DEMAND datasets demonstrate improved enhancement metrics and greater robustness to domain shifts compared to both supervised and unsupervised baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 22 of its 38 references that are in the map. First posted on arXiv 3 Jul 2025.
Builds on
22 of 38 references.
Closest ancestors · 9
Same direction, newest first
- 2024BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Models7 May
- 2024Diffusion Models for Audio Restoration15 Feb
- 2023Diffusion-Based Speech Enhancement in Matched and Mismatched Conditions Using a Heun-Based Sampler5 Dec
- 2023Unsupervised speech enhancement with diffusion-based generative models19 Sep
- 2023UnDiff: Unsupervised Voice Restoration with Unconditional Diffusion Model1 Jun
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation22 Dec
- 2022Cold Diffusion for Speech Enhancement4 Nov
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancement10 Feb
Other references · 13
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 2018SDR - half-baked or well done?cited by 423
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
- 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 216
- 2024A Survey on Diffusion Models for Inverse Problemscited by 180
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2022Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problemscited by 60
- 2019A Recurrent Variational Autoencoder for Speech Enhancementcited by 38
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Single and Few-step Diffusion for Generative Speech Enhancement
- 2023Diffusion-based speech enhancement with a weighted generative-supervised learning loss
- 2026Diffusion-based Frameworks for Unsupervised Speech Enhancement
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement
- 2025ProSE: Diffusion Priors for Speech Enhancement
- 2023Investigating the Design Space of Diffusion Models for Speech Enhancement
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Model
- 2023NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement