Investigating Training Objectives for Generative Speech Enhancement
Not on the map. Why?
Abstract (arXiv)
Generative speech enhancement has recently shown promising advancements in improving speech quality in noisy environments. Multiple diffusion-based frameworks exist, each employing distinct training objectives and learning techniques. This paper aims to explain the differences between these frameworks by focusing our investigation on score-based generative models and the Schr"odinger bridge. We conduct a series of comprehensive experiments to compare their performance and highlight differing training behaviors. Furthermore, we propose a novel perceptual loss function tailored for the Schr"odinger bridge framework, demonstrating enhanced performance and improved perceptual quality of the enhanced speech signals. All experimental code and pre-trained models are publicly available to facilitate further research and development in this domain.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Sep 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 15; 2026: 5.
20 papers.
Sort:
By area:
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2025Robust One-step Speech Enhancement via Consistency Distillationcited by 4
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancementcited by 4
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matchingcited by 4
- 2025Flowing Straighter with Conditional Flow Matching for Accurate Speech Enhancementcited by 3
- 2025Schr"odinger Bridge Mamba for One-Step Speech Enhancementcited by 3
- 2025LipDiffuser: Lip-to-Speech Generation with Conditional Diffusion Modelscited by 2
- 2025ArtiFree: Detecting and Reducing Generative Artifacts in Diffusion-based Speech Enhancementcited by 2
- 2025Dale meets Langevin: A Multiplicative Denoising Diffusion Modelcited by 2
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementationcited by 1
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancementcited by 1
8 more
- 2025Investigating training objective for flow matching-based speech enhancementcited by 1
- 2026Time-Unconditional Generative Speech Enhancement via Autonomous Rectified Flowcited by 1
- 2025Combining Deterministic Enhanced Conditions with Dual-Streaming Encoding for Diffusion-Based Speech Enhancementcited by 0
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restorationcited by 0
- 2026A Fast Solver for Interpolating Stochastic Differential Equation Diffusion Models for Speech Restorationcited by 0
- 2026Diff-VS: Efficient Audio-Aware Diffusion U-Net for Vocals Separationcited by 0
- 2026Predictive-Generative Drift Decomposition for Speech Enhancement and Separationcited by 0
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?cited by 0
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?28 Sep 2026
- 2026Time-Unconditional Generative Speech Enhancement via Autonomous Rectified Flow18 Jun 2026
- 2026Predictive-Generative Drift Decomposition for Speech Enhancement and Separation7 May 2026
- 2026Diff-VS: Efficient Audio-Aware Diffusion U-Net for Vocals Separation1 Apr 2026
- 2026A Fast Solver for Interpolating Stochastic Differential Equation Diffusion Models for Speech Restoration10 Mar 2026
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matching22 Dec 2025
- 2025Investigating training objective for flow matching-based speech enhancement11 Dec 2025
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancement12 Nov 2025
- 2025Schr"odinger Bridge Mamba for One-Step Speech Enhancement19 Oct 2025
- 2025Dale meets Langevin: A Multiplicative Denoising Diffusion Model3 Oct 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025ArtiFree: Detecting and Reducing Generative Artifacts in Diffusion-based Speech Enhancement23 Sep 2025
8 more
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restoration28 Aug 2025
- 2025Flowing Straighter with Conditional Flow Matching for Accurate Speech Enhancement28 Aug 2025
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancement16 Jul 2025
- 2025Robust One-step Speech Enhancement via Consistency Distillation8 Jul 2025
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation10 Jun 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
- 2025Combining Deterministic Enhanced Conditions with Dual-Streaming Encoding for Diffusion-Based Speech Enhancement20 May 2025
- 2025LipDiffuser: Lip-to-Speech Generation with Conditional Diffusion Models16 May 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2025Robust One-step Speech Enhancement via Consistency Distillationcited by 4
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancementcited by 4
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matchingcited by 4
- 2025Flowing Straighter with Conditional Flow Matching for Accurate Speech Enhancementcited by 3
- 2025LipDiffuser: Lip-to-Speech Generation with Conditional Diffusion Modelscited by 2
- 2025Dale meets Langevin: A Multiplicative Denoising Diffusion Modelcited by 2
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementationcited by 1
- 2025Investigating training objective for flow matching-based speech enhancementcited by 1
- 2026Time-Unconditional Generative Speech Enhancement via Autonomous Rectified Flowcited by 1
- 2025Combining Deterministic Enhanced Conditions with Dual-Streaming Encoding for Diffusion-Based Speech Enhancementcited by 0
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restorationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Time-Unconditional Generative Speech Enhancement via Autonomous Rectified Flow18 Jun 2026
- 2026Diff-VS: Efficient Audio-Aware Diffusion U-Net for Vocals Separation1 Apr 2026
- 2026A Fast Solver for Interpolating Stochastic Differential Equation Diffusion Models for Speech Restoration10 Mar 2026
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matching22 Dec 2025
- 2025Investigating training objective for flow matching-based speech enhancement11 Dec 2025
- 2025Dale meets Langevin: A Multiplicative Denoising Diffusion Model3 Oct 2025
- 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restoration28 Aug 2025
- 2025Flowing Straighter with Conditional Flow Matching for Accurate Speech Enhancement28 Aug 2025
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancement16 Jul 2025
- 2025Robust One-step Speech Enhancement via Consistency Distillation8 Jul 2025
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation10 Jun 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
12 newest of 14 All 14 (JSON)
- 2025Schr"odinger Bridge Mamba for One-Step Speech Enhancement19 Oct 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2025ArtiFree: Detecting and Reducing Generative Artifacts in Diffusion-based Speech Enhancementcited by 2
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancementcited by 1
- 2026Predictive-Generative Drift Decomposition for Speech Enhancement and Separationcited by 0
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?cited by 0
- 2026Perceptual Quality Loss or Loss of Perceptual Quality?28 Sep 2026
- 2026Predictive-Generative Drift Decomposition for Speech Enhancement and Separation7 May 2026
- 2025Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancement12 Nov 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025ArtiFree: Detecting and Reducing Generative Artifacts in Diffusion-based Speech Enhancement23 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion-based Speech Enhancement with Schr"odinger Bridge and Symmetric Noise Schedule
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement
- 2025Few-step Adversarial Schr"odinger Bridge for Generative Speech Enhancement
- 2026HybridSB-MoE: Dual-Domain Schr"odinger Bridges with Scene-Adaptive Expert Routing for Speech Enhancement
- 2026Rethinking Flow and Diffusion Bridge Models for Speech Enhancement
- 2026SE-MSB: End-to-End Unpaired Speech Enhancement using Mamba Schr"odinger Bridges
- 2022Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement