FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbot
Not on the map. Why?
Abstract (arXiv)
Current dialogue generation approaches typically require the complete dialogue text before synthesis and produce a single, inseparable speech containing all voices, making them unsuitable for interactive chat; moreover, they suffer from unstable synthesis, inaccurate speaker transitions, and incoherent prosody. In this work, we present FireRedTTS-2, a long-form streaming TTS system for multi-speaker dialogue generation, delivering stable, natural speech with reliable speaker switching and context-aware prosody. A new 12.5Hz streaming speech tokenizer accelerates training and inference, extends maximum dialogue length, encodes richer semantics to stabilize text-to-token modeling and supports high-fidelity streaming generation for real-time applications. We adopt a text-speech interleaved format, concatenating speaker-labeled text with aligned speech tokens in chronological order, and model it with a dual-transformer: a large decoder-only transformer predicts tokens at the first layer, and a smaller one completes subsequent layers. Experimental results show that FireRedTTS-2 integrates seamlessly with chat frameworks and, with minimal fine-tuning, produces emotionally expressive speech guided by implicit contextual cues. In podcast generation, it surpasses existing systems including MoonCast, Zipvoice-Dialogue, and MOSS-TTSD in objective intelligibility, speaker-turn reliability, and perceived naturalness with context-consistent prosody. Our demos are available at https://fireredteam.github.io/demos/firered_tts_2.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Sep 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 4; 2026: 31.
35 papers.
Sort:
By area:
- 2026Qwen3-TTS Technical Reportcited by 118
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 22
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 17
- 2026MOSS-TTS Technical Reportcited by 14
- 2026Fish Audio S2 Technical Reportcited by 9
- 2025Step-Audio-EditX Technical Reportcited by 7
- 2026dots.tts Technical Reportcited by 4
- 2026FunCineForge: A Unified Dataset Toolkit and Model for Zero-Shot Movie Dubbing in Diverse Cinematic Scenescited by 3
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesiscited by 3
- 2026Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesiscited by 3
- 2026MOSS-TTSD: Text to Spoken Dialogue Generationcited by 2
- 2026TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosiscited by 2
23 more
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 2
- 2026MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corporacited by 1
- 2026Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speechcited by 1
- 2026WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modelingcited by 1
- 2026FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillationcited by 1
- 2026HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speechcited by 1
- 2026DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speechcited by 1
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
- 2025Fed-PISA: Federated Voice Cloning via Personalized Identity-Style Adaptationcited by 0
- 2026What Counts as Real? Speech Restoration and Voice Quality Conversion Pose New Challenges to Deepfake Detectioncited by 0
- 2026SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialnesscited by 0
- 2026Conditioned in Training, Dispensable at Inference: Typological Conditioning for Multilingual Speech Translationcited by 0
- 2026PilotTTS: A Disciplined Modular Recipe for Competitive Speech Synthesiscited by 0
- 2026Efficient ASR Training with Conversations that Never Happenedcited by 0
- 2026TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speechcited by 0
- 2026Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speechcited by 0
- 2026EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesiscited by 0
- 2026ZipL-Dialog: Memory-Efficient Long-Form Spoken Dialog Synthesis via Latent Flow Matchingcited by 0
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokenscited by 0
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latentscited by 0
- 2026X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritancecited by 0
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesiscited by 0
- 2026Training a Compact, Strong, and Realistic Text-to-Speech Modelcited by 0
- 2026Training a Compact, Strong, and Realistic Text-to-Speech Model10 Oct 2026
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing8 Sep 2026
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis3 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance19 Aug 2026
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents9 Aug 2026
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens31 Jul 2026
- 2026ZipL-Dialog: Memory-Efficient Long-Form Spoken Dialog Synthesis via Latent Flow Matching14 Jul 2026
- 2026DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech5 Jul 2026
- 2026HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech26 Jun 2026
- 2026Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis24 Jun 2026
- 2026Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech12 Jun 2026
23 more
- 2026EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis8 Jun 2026
- 2026FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation8 Jun 2026
- 2026TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech8 Jun 2026
- 2026dots.tts Technical Report5 Jun 2026
- 2026Efficient ASR Training with Conversations that Never Happened2 Jun 2026
- 2026WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling2 Jun 2026
- 2026PilotTTS: A Disciplined Modular Recipe for Competitive Speech Synthesis26 May 2026
- 2026Conditioned in Training, Dispensable at Inference: Typological Conditioning for Multilingual Speech Translation15 May 2026
- 2026Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech10 May 2026
- 2026TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis24 Apr 2026
- 2026MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corpora13 Apr 2026
- 2026MOSS-TTSD: Text to Spoken Dialogue Generation20 Mar 2026
- 2026MOSS-TTS Technical Report18 Mar 2026
- 2026SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness16 Mar 2026
- 2026What Counts as Real? Speech Restoration and Voice Quality Conversion Pose New Challenges to Deepfake Detection14 Mar 2026
- 2026Fish Audio S2 Technical Report9 Mar 2026
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesis8 Feb 2026
- 2026Qwen3-TTS Technical Report22 Jan 2026
- 2026FunCineForge: A Unified Dataset Toolkit and Model for Zero-Shot Movie Dubbing in Diverse Cinematic Scenes21 Jan 2026
- 2025Step-Audio-EditX Technical Report5 Nov 2025
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generation28 Oct 2025
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation26 Oct 2025
- 2025Fed-PISA: Federated Voice Cloning via Personalized Identity-Style Adaptation19 Sep 2025
- 2026dots.tts Technical Reportcited by 4
- 2026Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speechcited by 1
- 2026WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modelingcited by 1
- 2026FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillationcited by 1
- 2026DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speechcited by 1
- 2026Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speechcited by 0
- 2026ZipL-Dialog: Memory-Efficient Long-Form Spoken Dialog Synthesis via Latent Flow Matchingcited by 0
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latentscited by 0
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesiscited by 0
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis3 Sep 2026
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents9 Aug 2026
- 2026ZipL-Dialog: Memory-Efficient Long-Form Spoken Dialog Synthesis via Latent Flow Matching14 Jul 2026
- 2026DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech5 Jul 2026
- 2026Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech12 Jun 2026
- 2026FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation8 Jun 2026
- 2026dots.tts Technical Report5 Jun 2026
- 2026WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling2 Jun 2026
- 2026Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech10 May 2026
- 2026Qwen3-TTS Technical Reportcited by 118
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 17
- 2026MOSS-TTS Technical Reportcited by 14
- 2026Fish Audio S2 Technical Reportcited by 9
- 2025Step-Audio-EditX Technical Reportcited by 7
- 2026FunCineForge: A Unified Dataset Toolkit and Model for Zero-Shot Movie Dubbing in Diverse Cinematic Scenescited by 3
- 2026SoulX-Singer: Towards High-Quality Zero-Shot Singing Voice Synthesiscited by 3
- 2026MOSS-TTSD: Text to Spoken Dialogue Generationcited by 2
- 2026TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosiscited by 2
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 2
- 2026MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corporacited by 1
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
12 most cited of 21 All 21 (JSON)
- 2026Training a Compact, Strong, and Realistic Text-to-Speech Model10 Oct 2026
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing8 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance19 Aug 2026
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens31 Jul 2026
- 2026EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis8 Jun 2026
- 2026Efficient ASR Training with Conversations that Never Happened2 Jun 2026
- 2026PilotTTS: A Disciplined Modular Recipe for Competitive Speech Synthesis26 May 2026
- 2026Conditioned in Training, Dispensable at Inference: Typological Conditioning for Multilingual Speech Translation15 May 2026
- 2026TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis24 Apr 2026
- 2026MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corpora13 Apr 2026
- 2026MOSS-TTSD: Text to Spoken Dialogue Generation20 Mar 2026
12 newest of 21 All 21 (JSON)