mlsanityData to 14 Oct 2026

Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis

arXiv 2607.00363 ↗First posted 1 Jul 2026cs.SD cs.AIcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Flow Matching (FM) has emerged as a powerful paradigm for speech generation but remains constrained by high inference latency and timbre leakage. To address these bottlenecks, we propose a unified guidance framework that enhances generation efficiency and robustness through two complementary strategies. On the data front, we introduce Data-guidance via heterogeneous augmentation, encouraging the model to disentangle linguistic content from acoustic residue. In parallel, we propose an enhanced Model-guidance mechanism that synergizes trajectory rectification with a novel intrinsic guidance objective. This approach distills conditional knowledge into network weights and straightens inference trajectory path, thereby eliminating Classifier-Free Guidance (CFG) overhead. Experiments demonstrate that our framework accelerates inference by nearly three times while effectively improving speaker similarity compared to state-of-the-art baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

30 of 32 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training23 May
  2. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models13 Dec
  3. 2024StableVC: Style Controllable Zero-Shot Voice Conversion with Conditional Flow Matching6 Dec
  4. 2024Zero-shot Voice Conversion with Diffusion Transformers15 Nov
  5. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
  6. 2023Matcha-TTS: A fast TTS architecture with conditional flow matching6 Sep
  7. 2023CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model11 May
  8. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech13 Jul
  9. 2022FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis21 Apr

Other references · 21

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2023Consistency Modelscited by 1,822
  7. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  8. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  9. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  10. 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 241
  11. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 224
  12. 2025Kimi-Audio Technical Reportcited by 222
9 more
  1. 2019Understanding and Improving Layer Normalizationcited by 217
  2. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
  3. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
  4. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 102
  5. 2025Step-Audio: Unified Understanding and Generation in Intelligent Speech Interactioncited by 83
  6. 2024FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applicationscited by 68
  7. 2020Data Augmenting Contrastive Learning of Speech Representations in the Time Domaincited by 63
  8. 2025Diffusion Models without Classifier-free Guidancecited by 33
  9. 2023HiFTNet: A Fast High-Quality Neural Vocoder with Harmonic-plus-Noise Filter and Inverse Short Time Fourier Transformcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis
  2. 2025Towards Flow-Matching-based TTS without Classifier-Free Guidance
  3. 2026ReaFlow-TTS: Realization-Conditioned Flow Matching for High-Quality and Controllable Speech Synthesis
  4. 2025RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
  5. 2026Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech
  6. 2026RobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matching
  7. 2023Guided Flows for Generative Modeling and Decision Making
  8. 2023VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching