mlsanityData to 7 Oct 2026

FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation

arXiv 2606.09141 ↗First posted 8 Jun 2026eess.AS cs.SDcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Recent progress in speech dialogue systems requires Text-to-Speech (TTS) models to be faster and more responsive. Modern speech dialogue systems impose two primary requirements on TTS models: low latency and support for streaming inputs and outputs. However, most existing single-codebook LLM-based TTS methods rely on multi-stage pipelines that lack native streaming capabilities. These systems typically suffer from high end-to-end latency due to slow autoregressive prediction and multi-step flow matching. To address these limitations, we propose FlashTTS, an open-source and low-latency streaming TTS framework. FlashTTS introduces a lagged multi-track architecture that natively processes streaming text and speech inputs, thereby eliminating the need for sentence-level buffering. To accelerate acoustic generation, we integrate parallel Multi-Token Prediction (MTP) with an X-pred mean flow matching decoder. This configuration achieves high-fidelity token-to-mel generation in exactly two function evaluations (2-NFE). By jointly optimizing input processing and decoding efficiency, FlashTTS offers a practical foundation for real-time speech dialogue systems. Experiments show that FlashTTS substantially reduces First-Packet Latency to 325ms compared to robust streaming baselines, all while preserving strong zero-shot voice cloning and cross-lingual intelligibility. Speech samples are available. The model code and checkpoints will be released as open source.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 31 of its 34 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

31 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025StreamFlow: Streaming Flow Matching with Block-wise Guided Attention Mask for Speech Token Decoding30 Jun
  2. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models13 Dec
  3. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
  4. 2023Better speech synthesis through scaling12 May

Other references · 27

  1. 2017Neural Discrete Representation Learningcited by 4,650
  2. 2023Qwen Technical Reportcited by 3,273
  3. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  4. 2022High Fidelity Neural Audio Compressioncited by 673
  5. 2025Mean Flows for One-step Generative Modelingcited by 524
  6. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
  7. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 323
  8. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
  9. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
  10. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  11. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 159
  12. 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 118
15 more
  1. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
  2. 2026Qwen3-TTS Technical Reportcited by 106
  3. 2023Libriheavy: a 50,000 hours ASR corpus with punctuation casing and contextcited by 84
  4. 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesiscited by 69
  5. 2024FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applicationscited by 68
  6. 2024Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesiscited by 45
  7. 2024WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmarkcited by 39
  8. 2025FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbotcited by 34
  9. 2025X-Talk: On the Underestimated Potential of Modular Speech-to-Speech Dialogue Systemcited by 9
  10. 2025SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantizationcited by 8
  11. 2025GLM-TTS Technical Reportcited by 8
  12. 2025SoulX-Podcast: Towards Realistic Long-form Podcasts with Dialectal and Paralinguistic Diversitycited by 6
  13. 2025MeanVC: Lightweight and Streaming Zero-Shot Voice Conversion via Mean Flowscited by 5
  14. 2025Llasa+: Free Lunch for Accelerated and Streaming Llama-Based Speech Synthesiscited by 1
  15. 2025QuarkAudio Technical Reportcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026X-Pred MeanFlow for Streaming Token-to-Mel Speech Decoding ↗
  2. 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs
  3. 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents
  4. 2025Stream RAG: Instant and Accurate Spoken Dialogue Systems with Streaming Tool Usage
  5. 2025SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech System
  6. 2025Accelerating Flow-Matching-Based Text-to-Speech via Empirically Pruned Step Sampling
  7. 2025PredGen: Accelerated Inference of Large Language Models through Input-Time Speculation for Real-Time Speech Interaction
  8. 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model