dots.tts Technical Report
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
We present dots.tts, a 2B-parameter continuous autoregressive text-to-speech (TTS) foundation model that models speech in a continuous latent space. Compared with existing continuous autoregressive models, our key innovations are threefold. First, we train an AudioVAE with multiple objectives to build a semantically structured and prediction-friendly continuous speech space. Second, we use full-history conditioning in the flow-matching head to preserve long-range consistency and reduce drift during generation. Third, we apply reward-free self-corrective post-training to the flow-matching head to further improve robustness and acoustic quality. After being trained on a large-scale multilingual corpus, dots.tts achieves the best average performance on Seed-TTS-Eval, with WERs of 0.94%/1.30%/6.60% and SIM scores of 81.0/77.1/79.5 on the zh/en/zh-hard test sets, respectively. Across other benchmarks, dots.tts also consistently demonstrates open-source state-of-the-art performance, exhibiting strong generation stability, voice cloning ability, and emotional expressiveness. For efficient inference, we further apply CFG-aware MeanFlow distillation, enabling low-latency speech generation with first-packet latencies of 85/54 ms in output streaming and dual-streaming modes, respectively. To facilitate reproducible research and practical deployment, we release the training and inference code, together with the pretrained, post-trained, and MeanFlow-distilled checkpoints, under the Apache 2.0 license.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 40 of its 43 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
40 of 43 references.
Closest ancestors · 8
Same direction, newest first
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models1 Apr
- 2026LongCat-AudioDiT: High-Fidelity Diffusion Text-to-Speech in the Waveform Latent Space31 Mar
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training23 May
- 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis26 Feb
- 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation6 Feb
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models13 Dec
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
- 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesis8 Jun
Other references · 32
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 139
20 more
- 2024WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modelingcited by 124
- 2026Qwen3-TTS Technical Reportcited by 106
- 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
- 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesiscited by 69
- 2025MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encodercited by 44
- 2025VoxCPM: Tokenizer-Free TTS for Context-Aware Speech Generation and True-to-Life Voice Cloningcited by 39
- 2025FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbotcited by 34
- 2023Auto-ACD: A Large-scale Dataset for Audio-Language Representation Learningcited by 32
- 2025VibeVoice Technical Reportcited by 28
- 2025IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech Systemcited by 27
- 2025EmergentTTS-Eval: Evaluating TTS Models on Complex Prosodic, Expressiveness, and Linguistic Challenges Using Model-as-a-Judgecited by 24
- 2025XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecscited by 21
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 15
- 2026vLLM-Omni: Fully Disaggregated Serving for Any-to-Any Multimodal Modelscited by 15
- 2025Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesiscited by 12
- 2025SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantizationcited by 8
- 2026Fish Audio S2 Technical Reportcited by 7
- 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Modelscited by 6
- 2024KALL-E:Autoregressive Speech Synthesis with Next-Distribution Predictioncited by 5
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understandingcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech
- 2025CLEAR: Continuous Latent Autoregressive Modeling for High-quality and Low-latency Speech Synthesis
- 2026Raon-OpenTTS: Open Models and Data for Robust Text-to-Speech ↗
- 2024E1 TTS: Simple and Fast Non-Autoregressive TTS
- 2026DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents
- 2024Speech Synthesis From Continuous Features Using Per-Token Latent Diffusion
- 2026End-to-End Training for Discrete Token LLM based TTS System