Investigating training objective for flow matching-based speech enhancement
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Speech enhancement(SE) aims to recover clean speech from noisy recordings. Although generative approaches such as score matching and Schrodinger bridge have shown strong effectiveness, they are often computationally expensive. Flow matching offers a more efficient alternative by directly learning a velocity field that maps noise to data. In this work, we present a systematic study of flow matching for SE under three training objectives: velocity prediction, x1 prediction, and preconditioned x1 prediction. We analyze their impact on training dynamics and overall performance. Moreover, by introducing perceptual(PESQ) and signal-based(SI-SDR) objectives, we further enhance convergence efficiency and speech quality, yielding substantial improvements across evaluation metrics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 17 of its 21 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
17 of 21 references.
Closest ancestors · 5
Same direction, newest first
- 2025FlowSE: Flow Matching-based Speech Enhancement9 Aug
- 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching26 May
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement28 Feb
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation22 Dec
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
Other references · 12
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
- 2024Flow Matching Guide and Codecited by 301
- 2020Real Time Speech Enhancement in the Waveform Domaincited by 186
- 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
- 2019MetricGAN: Generative Adversarial Networks based Black-box Metric Scores Optimization for Speech Enhancementcited by 104
- 2024Schr"odinger Bridge for Generative Speech Enhancementcited by 27
- 2022FRCRN: Boosting Feature Representation using Frequency Recurrence for Monaural Speech Enhancementcited by 26
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 23
- 2024Investigating Training Objectives for Generative Speech Enhancementcited by 20
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancementcited by 12
- 2025Multi-Metric Preference Alignment for Generative Speech Restorationcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Shortcut Flow Matching for Speech Enhancement: Step-Invariant flows via single stage training
- 2025Compose Yourself: Average-Velocity Flow Matching for One-Step Speech Enhancement
- 2026Rethinking Flow and Diffusion Bridge Models for Speech Enhancement
- 2025Flowing Straighter with Conditional Flow Matching for Accurate Speech Enhancement
- 2025Speech Enhancement based on cascaded two flows
- 2026PhASE-Flow: Phonetic-Conditioned Acoustic Flow Matching in SSL Representation Domain for Speech Enhancement
- 2026Beyond U-Net: A Latent-Representation-Aligned Skip-Free Backbone for Flow-Matching Speech Enhancement
- 2025MeanSE: Efficient Generative Speech Enhancement with Mean Flows