mlsanityData to 14 Oct 2026

Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement

arXiv 2306.08527 ↗First posted 14 Jun 2023eess.AS cs.AI cs.SDcited by 5

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

The goal of this study is to implement diffusion models for speech enhancement (SE). The first step is to emphasize the theoretical foundation of variance-preserving (VP)-based interpolation diffusion under continuous conditions. Subsequently, we present a more concise framework that encapsulates both the VP- and variance-exploding (VE)-based interpolation diffusion methods. We demonstrate that these two methods are special cases of the proposed framework. Additionally, we provide a practical example of VP-based interpolation diffusion for the SE task. To improve performance and ease model training, we analyze the common difficulties encountered in diffusion models and suggest amenable hyper-parameters. Finally, we evaluate our model against several methods using a public benchmark to showcase the effectiveness of our approach

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 19 of its 40 references that are in the map. First posted on arXiv 14 Jun 2023.

Builds on

19 of 40 references.

Closest ancestors · 6

Same direction, newest first

  1. 2022Cold Diffusion for Speech Enhancement4 Nov
  2. 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement30 Oct
  3. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
  4. 2022Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain31 Mar
  5. 2022Conditional Diffusion Probabilistic Model for Speech Enhancement10 Feb
  6. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesis21 Sep

Other references · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  4. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  5. 2021Variational Diffusion Modelscited by 1,153
  6. 2018SDR - half-baked or well done?cited by 423
  7. 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 166
  8. 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
  9. 2019MetricGAN: Generative Adversarial Networks based Black-box Metric Scores Optimization for Speech Enhancementcited by 104
  10. 2019Phase-aware Speech Enhancement with Deep Complex U-Netcited by 73
  11. 2021Variational Autoencoder for Speech Enhancement with a Noise-Aware Encodercited by 28
  12. 2017End-to-End Waveform Utterance Enhancement for Direct Evaluation Metrics Optimization by Fully Convolutional Neural Networkscited by 26
1 more
  1. 2021A Flow-Based Neural Network for Time Domain Speech Enhancementcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 2; 2025: 0; 2026: 1.

5 papers.

  1. 2023Investigating the Design Space of Diffusion Models for Speech Enhancementcited by 10
  2. 2024An Analysis of the Variance of Diffusion-based Speech Enhancementcited by 5
  3. 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
  4. 2023Continuous Modeling of the Denoising Process for Speech Enhancement Based on Deep Learningcited by 0
  5. 2026A Fast Solver for Interpolating Stochastic Differential Equation Diffusion Models for Speech Restorationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ProSE: Diffusion Priors for Speech Enhancement
  2. 2024Complex-Cycle-Consistent Diffusion Model for Monaural Speech Enhancement
  3. 2023Unsupervised speech enhancement with diffusion-based generative models
  4. 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation
  5. 2023Diffusion-Based Speech Enhancement in Matched and Mismatched Conditions Using a Heun-Based Sampler
  6. 2023NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement
  7. 2025Combining Deterministic Enhanced Conditions with Dual-Streaming Encoding for Diffusion-Based Speech Enhancement
  8. 2025Posterior Transition Modeling for Unsupervised Diffusion-Based Speech Enhancement