SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Diffusion model, as a new generative model which is very popular in image generation and audio synthesis, is rarely used in speech enhancement. In this paper, we use the diffusion model as a module for stochastic refinement. We propose SRTNet, a novel method for speech enhancement via Stochastic Refinement in complete Time domain. Specifically, we design a joint network consisting of a deterministic module and a stochastic module, which makes up the ``enhance-and-refine'' paradigm. We theoretically demonstrate the feasibility of our method and experimentally prove that our method achieves faster training, faster sampling and higher quality. Our code and enhanced samples are available at https://github.com/zhibinQiu/SRTNet.git.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 22 of its 35 references that are in the map. First posted on arXiv 30 Oct 2022.
Builds on
22 of 35 references.
Closest ancestors · 3
Same direction, newest first
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancement10 Feb
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Model25 Jul
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesis21 Sep
Other references · 19
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
- 2021Deblurring via Stochastic Refinementcited by 249
- 2020Real Time Speech Enhancement in the Waveform Domaincited by 186
- 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 166
- 2019MetricGAN: Generative Adversarial Networks based Black-box Metric Scores Optimization for Speech Enhancementcited by 104
- 2019A Recurrent Variational Autoencoder for Speech Enhancementcited by 38
- 2017Statistical Speech Enhancement Based on Probabilistic Integration of Variational Autoencoder and Non-Negative Matrix Factorizationcited by 33
- 2019A variance modeling framework based on variational autoencoders for speech enhancementcited by 33
7 more
- 2020Improving GANs for Speech Enhancementcited by 22
- 2017Exploring Speech Enhancement with Generative Adversarial Networks for Robust Speech Recognitioncited by 19
- 2021A Flow-Based Neural Network for Time Domain Speech Enhancementcited by 16
- 2018Semi-supervised multichannel speech enhancement with variational autoencoders and non-negative matrix factorizationcited by 14
- 2020WaveCRN: An Efficient Convolutional Recurrent Neural Network for End-to-end Speech Enhancementcited by 12
- 2019Mixture of Inference Networks for VAE-based Audio-visual Speech Enhancementcited by 11
- 2019Speech enhancement with variational autoencoders and alpha-stable distributionscited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2; 2025: 4; 2026: 2.
12 papers.
- 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Modelcited by 145
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2023Investigating the Design Space of Diffusion Models for Speech Enhancementcited by 10
- 2025Modality-Invariant Bidirectional Temporal Representation Distillation Network for Missing Multimodal Sentiment Analysiscited by 8
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancementcited by 5
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognitioncited by 5
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2024The Effect of Training Dataset Size on Discriminative and Diffusion-Based Speech Enhancement Systemscited by 3
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancementcited by 1
- 2025Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boostingcited by 0
- 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergycited by 0
- 2026DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancementcited by 0
- 2026DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancement4 Jun 2026
- 2026Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy31 Jan 2026
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancement12 Nov 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
- 2025Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boosting27 Mar 2025
- 2025Modality-Invariant Bidirectional Temporal Representation Distillation Network for Missing Multimodal Sentiment Analysis7 Jan 2025
- 2024The Effect of Training Dataset Size on Discriminative and Diffusion-Based Speech Enhancement Systems10 Jun 2024
- 2024A Variance-Preserving Interpolation Approach for Diffusion Models with Applications to Single Channel Speech Enhancement and Recognition27 May 2024
- 2023Investigating the Design Space of Diffusion Models for Speech Enhancement7 Dec 2023
- 2023Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement14 Jun 2023
- 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model24 Apr 2023
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation22 Dec 2022
Similar, not cited
Close in wording, no citation either way
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement
- 2024An Analysis of the Variance of Diffusion-based Speech Enhancement
- 2024Diffusion-based Generative Modeling with Discriminative Guidance for Streamable Speech Enhancement
- 2023Single and Few-step Diffusion for Generative Speech Enhancement
- 2025Posterior Transition Modeling for Unsupervised Diffusion-Based Speech Enhancement
- 2023Unsupervised speech enhancement with diffusion-based generative models
- 2025Diffusion Buffer for Online Generative Speech Enhancement