mlsanityData to 7 Oct 2026

DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis

arXiv 2602.09041 ↗First posted 3 Feb 2026cs.SD cs.AI eess.AScited by 1

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference steps, existing methods often suffer from process variance due to endpoint error accumulation. Moreover, directly reusing continuous-time architectures for discrete, fixed-step generation introduces structural parameter inefficiencies. To address these challenges, we introduce DSFlow, a modular distillation framework for few-step and one-step synthesis. DSFlow reformulates generation as a discrete prediction task and explicitly adapts the student model to the target inference regime. It improves training stability through a dual supervision strategy that combines endpoint matching with deterministic mean-velocity alignment, enforcing consistent generation trajectories across inference steps. In addition, DSFlow improves parameter efficiency by replacing continuous-time timestep conditioning with lightweight step-aware tokens, aligning model capacity with the significantly reduced timestep space of the discrete task. Extensive experiments across diverse flow-based text-to-speech architectures demonstrate that DSFlow consistently outperforms standard distillation approaches, achieving strong few-step and one-step synthesis quality while reducing model parameters and inference cost.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 35 of its 38 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

35 of 38 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis14 Oct
  2. 2024AudioLCM: Text-to-Audio Generation with Latent Consistency Models1 Jun
  3. 2023Matcha-TTS: A fast TTS architecture with conditional flow matching6 Sep

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  10. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
20 more
  1. 2023Consistency Modelscited by 1,778
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  5. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  6. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  7. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  8. 2025Mean Flows for One-step Generative Modelingcited by 524
  9. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  10. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  11. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  12. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 323
  13. 2024Discrete Flow Matchingcited by 301
  14. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
  15. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
  16. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
  17. 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 149
  18. 2020DiDiSpeech: A Large Scale Mandarin Speech Corpuscited by 33
  19. 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modelingcited by 26
  20. 2025IntMeanFlow: Few-step Speech Generation with Integral Velocity Distillationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis
  2. 2026Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech
  3. 2026Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation
  4. 2026Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech
  5. 2023VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching
  6. 2025Towards Flow-Matching-based TTS without Classifier-Free Guidance
  7. 2026ReaFlow-TTS: Realization-Conditioned Flow Matching for High-Quality and Controllable Speech Synthesis
  8. 2025Accelerating Flow-Matching-Based Text-to-Speech via Empirically Pruned Step Sampling