IndexTTS 2.5 Technical Report
Not on the map. Why?
Abstract (arXiv)
In prior work, we introduced IndexTTS 2, a zero-shot neural text-to-speech foundation model comprising two core components: a transformer-based Text-to-Semantic (T2S) module and a non-autoregressive Semantic-to-Mel (S2M) module, which together enable faithful emotion replication and establish the first autoregressive duration-controllable generative paradigm. Building upon this, we present IndexTTS 2.5, which significantly enhances multilingual coverage, inference speed, and overall synthesis quality through four key improvements: 1) Semantic Codec Compression: we reduce the semantic codec frame rate from 50 Hz to 25 Hz, halving sequence length and substantially lowering both training and inference costs; 2) Architectural Upgrade: we replace the U-DiT-based backbone of the S2M module with a more efficient Zipformer-based modeling architecture, achieving notable parameter reduction and faster mel-spectrogram generation; 3) Multilingual Extension: We propose three explicit cross-lingual modeling strategies, boundary-aware alignment, token-level concatenation, and instruction-guided generation, establishing practical design principles for zero-shot multilingual emotional TTS that supports Chinese, English, Japanese, and Spanish, and enables robust emotion transfer even without target-language emotional training data; 4) Reinforcement Learning Optimization: we apply GRPO in post-training of the T2S module, improving pronunciation accuracy and natrualness. Experiments show that IndexTTS 2.5 not only supports broader language coverage but also replicates emotional prosody in unseen languages under the same zero-shot setting. IndexTTS 2.5 achieves a 2.28 times improvement in RTF while maintaining comparable WER and speaker similarity to IndexTTS 2.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
40 of 47 references.
References · 40
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
- 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
- 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
28 more
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
- 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 152
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
- 2022Hybrid Transformers for Music Source Separationcited by 134
- 2020Seen and Unseen emotional style transfer for voice conversion with a new emotional speech datasetcited by 121
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 113
- 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 95
- 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 90
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 80
- 2024FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applicationscited by 68
- 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generationcited by 57
- 2024Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesiscited by 48
- 2025MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encodercited by 48
- 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 43
- 2025VoxCPM: Tokenizer-Free TTS for Context-Aware Speech Generation and True-to-Life Voice Cloningcited by 42
- 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 35
- 2020DiDiSpeech: A Large Scale Mandarin Speech Corpuscited by 33
- 2025ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matchingcited by 30
- 2025IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech Systemcited by 28
- 2020fugashi, a Tool for Tokenizing Japanese in Pythoncited by 17
- 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
- 2026LEMAS: Large A 150K-Hour Large-scale Extensible Multilingual Audio Suite with Generative Speech Modelscited by 7
- 2025CLEAR: Continuous Latent Autoregressive Modeling for High-quality and Low-latency Speech Synthesiscited by 6
- 2025MELA-TTS: Joint transformer-diffusion model with representation alignment for speech synthesiscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 25
- 2026AgentSteerTTS: A Multi-Agent Closed-Loop Framework for Composite-Instruction Text-to-Speechcited by 1
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encodercited by 0
- 2026Learnable Classifier-Free Guidance Null Embeddings for Enhanced Controllable Speech Synthesiscited by 0
- 2026NVAlign: Direct-Gradient Optimization for Non-Verbal Control in Continuous Autoregressive Flow Matching Text-to-Speechcited by 0
- 2026Training a Compact, Strong, and Realistic Text-to-Speech Modelcited by 0
- 2026Training a Compact, Strong, and Realistic Text-to-Speech Model10 Oct 2026
- 2026NVAlign: Direct-Gradient Optimization for Non-Verbal Control in Continuous Autoregressive Flow Matching Text-to-Speech25 Sep 2026
- 2026Learnable Classifier-Free Guidance Null Embeddings for Enhanced Controllable Speech Synthesis21 Sep 2026
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder12 Aug 2026
- 2026AgentSteerTTS: A Multi-Agent Closed-Loop Framework for Composite-Instruction Text-to-Speech14 May 2026
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models1 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs
- 2023Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23
- 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis
- 2024SeamlessExpressiveLM: Speech Language Model for Expressive Speech-to-Speech Translation with Chain-of-Thought
- 2025DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration
- 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model
- 2025DeCoT: Decomposing Complex Instructions for Enhanced Text-to-Image Generation with Large Language Models
- 2025MCAT: Scaling Many-to-Many Speech-to-Text Translation with MLLMs to 70 Languages