mlsanityData to 14 Oct 2026

Towards Flow-Matching-based TTS without Classifier-Free Guidance

arXiv 2504.20334 ↗First posted 29 Apr 2025eess.AScited by 2

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the inference of flow-matching-based TTS models. However, CFG incurs substantial computational cost as it requires two forward passes, which hinders its applicability in real-time scenarios. In this paper, we explore removing CFG from flow-matching-based TTS models to improve inference efficiency, while maintaining performance. Specifically, we reformulated the flow matching training target to directly approximate the CFG optimization trajectory. This training method eliminates the need for unconditional model evaluation and guided tuning during inference, effectively cutting the computational overhead in half. Furthermore, It can be seamlessly integrated with existing optimized sampling strategies. We validate our approach using the F5-TTS model on the LibriTTS dataset. Experimental results show that our method achieves a 9× inference speed-up compared to the baseline F5-TTS, while preserving comparable speech quality. We will release the code and models to support reproducibility and foster further research in this area.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 36 of its 36 references that are in the map. First posted on arXiv 29 Apr 2025.

Builds on

36 of 36 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation6 Feb
  2. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models13 Dec
  3. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
  4. 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesis8 Jun
  5. 2024Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching1 Jun
  6. 2024FlashSpeech: Efficient Zero-Shot Speech Synthesis23 Apr
  7. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models5 Mar
  8. 2023ReFlow-TTS: A Rectified Flow Model for High-fidelity Text-to-Speech29 Sep
  9. 2023Matcha-TTS: A fast TTS architecture with conditional flow matching6 Sep
  10. 2023CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model11 May
  11. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech13 Jul
  12. 2022FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis21 Apr
1 more
  1. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speech3 Apr

Other references · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  10. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  11. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
  12. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
11 more
  1. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  2. 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 192
  3. 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 152
  4. 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 149
  5. 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 122
  6. 2023VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translationcited by 87
  7. 2024Classifier-Free Guidance is a Predictor-Correctorcited by 84
  8. 2021Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verificationcited by 78
  9. 2024FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applicationscited by 68
  10. 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Modelscited by 52
  11. 2025Diffusion Models without Classifier-free Guidancecited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Accelerating Flow-Matching-Based Text-to-Speech via Empirically Pruned Step Sampling
  2. 2026Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis
  3. 2026Joint Residual Reweighting for Classifier Free Guidance in Flow-Matching Zero-Shot TTS
  4. 2025OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching
  5. 2025RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
  6. 2025Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis
  7. 2026ReaFlow-TTS: Realization-Conditioned Flow Matching for High-Quality and Controllable Speech Synthesis
  8. 2026DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis