mlsanityData to 14 Oct 2026

IndexTTS 2.5 Technical Report

arXiv 2601.03888 ↗First posted 7 Jan 2026cs.SD cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

In prior work, we introduced IndexTTS 2, a zero-shot neural text-to-speech foundation model comprising two core components: a transformer-based Text-to-Semantic (T2S) module and a non-autoregressive Semantic-to-Mel (S2M) module, which together enable faithful emotion replication and establish the first autoregressive duration-controllable generative paradigm. Building upon this, we present IndexTTS 2.5, which significantly enhances multilingual coverage, inference speed, and overall synthesis quality through four key improvements: 1) Semantic Codec Compression: we reduce the semantic codec frame rate from 50 Hz to 25 Hz, halving sequence length and substantially lowering both training and inference costs; 2) Architectural Upgrade: we replace the U-DiT-based backbone of the S2M module with a more efficient Zipformer-based modeling architecture, achieving notable parameter reduction and faster mel-spectrogram generation; 3) Multilingual Extension: We propose three explicit cross-lingual modeling strategies, boundary-aware alignment, token-level concatenation, and instruction-guided generation, establishing practical design principles for zero-shot multilingual emotional TTS that supports Chinese, English, Japanese, and Spanish, and enables robust emotion transfer even without target-language emotional training data; 4) Reinforcement Learning Optimization: we apply GRPO in post-training of the T2S module, improving pronunciation accuracy and natrualness. Experiments show that IndexTTS 2.5 not only supports broader language coverage but also replicates emotional prosody in unseen languages under the same zero-shot setting. IndexTTS 2.5 achieves a 2.28 times improvement in RTF while maintaining comparable WER and speaker similarity to IndexTTS 2.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 7 Jan 2026.

Builds on

40 of 47 references.

References · 40

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  5. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  6. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  7. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
  8. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  9. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  10. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  11. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  12. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
28 more
  1. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  2. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
  3. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
  4. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
  5. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
  6. 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 152
  7. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
  8. 2022Hybrid Transformers for Music Source Separationcited by 134
  9. 2020Seen and Unseen emotional style transfer for voice conversion with a new emotional speech datasetcited by 121
  10. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 113
  11. 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 95
  12. 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 90
  13. 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 80
  14. 2024FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applicationscited by 68
  15. 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generationcited by 57
  16. 2024Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesiscited by 48
  17. 2025MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encodercited by 48
  18. 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 43
  19. 2025VoxCPM: Tokenizer-Free TTS for Context-Aware Speech Generation and True-to-Life Voice Cloningcited by 42
  20. 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 35
  21. 2020DiDiSpeech: A Large Scale Mandarin Speech Corpuscited by 33
  22. 2025ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matchingcited by 30
  23. 2025IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech Systemcited by 28
  24. 2020fugashi, a Tool for Tokenizing Japanese in Pythoncited by 17
  25. 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
  26. 2026LEMAS: Large A 150K-Hour Large-scale Extensible Multilingual Audio Suite with Generative Speech Modelscited by 7
  27. 2025CLEAR: Continuous Latent Autoregressive Modeling for High-quality and Low-latency Speech Synthesiscited by 6
  28. 2025MELA-TTS: Joint transformer-diffusion model with representation alignment for speech synthesiscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs
  2. 2023Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23
  3. 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis
  4. 2024SeamlessExpressiveLM: Speech Language Model for Expressive Speech-to-Speech Translation with Chain-of-Thought
  5. 2025DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration
  6. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model
  7. 2025DeCoT: Decomposing Complex Instructions for Enhanced Text-to-Image Generation with Large Language Models
  8. 2025MCAT: Scaling Many-to-Many Speech-to-Text Translation with MLLMs to 70 Languages