mlsanityData to 14 Oct 2026

ReFlow-TTS: A Rectified Flow Model for High-fidelity Text-to-Speech

arXiv 2309.17056 ↗First posted 29 Sep 2023cs.SD eess.AScited by 22

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous sampling steps, resulting in prolonged sampling time required to synthesize high-quality speech. This drawback hinders its practical applicability in real-world scenarios. In this paper, we introduce ReFlow-TTS, a novel rectified flow based method for speech synthesis with high-fidelity. Specifically, our ReFlow-TTS is simply an Ordinary Differential Equation (ODE) model that transports Gaussian distribution to the ground-truth Mel-spectrogram distribution by straight line paths as much as possible. Furthermore, our proposed approach enables high-quality speech synthesis with a single sampling step and eliminates the need for training a teacher model. Our experiments on LJSpeech Dataset show that our ReFlow-TTS method achieves the best performance compared with other diffusion based models. And the ReFlow-TTS with one step sampling achieves competitive performance compared with existing one-step TTS models.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 22 of its 25 references that are in the map. First posted on arXiv 29 Sep 2023.

Builds on

22 of 25 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model11 May
  2. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan
  3. 2022ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speech30 Dec
  4. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech13 Jul
  5. 2022DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs28 Jan
  6. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech13 May
  7. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speech3 Apr
  8. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesis21 Sep

Other references · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  8. 2023Consistency Modelscited by 1,822
  9. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  10. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
  11. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  12. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
2 more
  1. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  2. 2023Interpretable Style Transfer for Text-to-Speech with ControlVAE and Diffusion Bridgecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 8; 2025: 12; 2026: 1.

22 papers.

Sort:

By area:

  1. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  2. 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesiscited by 34
  3. 2023Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesiscited by 30
  4. 2025ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matchingcited by 30
  5. 2024FlashSpeech: Efficient Zero-Shot Speech Synthesiscited by 24
  6. 2024LAFMA: A Latent Flow Matching Model for Text-to-Audio Generationcited by 24
  7. 2024FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generationcited by 19
  8. 2024E1 TTS: Simple and Fast Non-Autoregressive TTScited by 7
  9. 2024StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusioncited by 7
  10. 2025Flow Straight and Fast in Hilbert Space: Functional Rectified Flowcited by 6
  11. 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesiscited by 5
  12. 2025Discl-VC: Disentangled Discrete Tokens and In-Context Learning for Controllable Zero-Shot Voice Conversioncited by 5
10 more
  1. 2025ReFlow-VC: Zero-shot Voice Conversion Based on Rectified Flow and Speaker Feature Optimizationcited by 4
  2. 2025SlimSpeech: Lightweight and Efficient Text-to-Speech with Slim Rectified Flowcited by 3
  3. 2025Towards Flow-Matching-based TTS without Classifier-Free Guidancecited by 2
  4. 2025Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesiscited by 2
  5. 2025DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibrationcited by 1
  6. 2025UniVoice: Unifying Autoregressive ASR and Flow-Matching based TTS with Large Language Modelscited by 1
  7. 2025Curved Worlds, Clear Boundaries: Generalizing Speech Deepfake Detection using Hyperbolic and Spherical Geometry Spacescited by 1
  8. 2025RingFormer: A Neural Vocoder with Ring Attention and Convolution-Augmented Transformercited by 0
  9. 2025DiFlow-TTS: Compact and Low-Latency Zero-Shot Text-to-Speech with Discrete Flow Matchingcited by 0
  10. 2026HoliDubber: Holistic Video Dubbing for Complex Acoustic Scenes via Text-Guided Audio Synthesiscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching
  2. 2025AudioTurbo: Fast Text-to-Audio Generation with Rectified Diffusion
  3. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching
  4. 2022FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis
  5. 2024Boosting Diffusion Model for Spectrogram Up-sampling in Text-to-speech: An Empirical Study
  6. 2025RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
  7. 2026Revise-TTS: A Non-Masking Refinement Framework for Masked Diffusion Models in Text-to-Speech
  8. 2024Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generation