GLM-TTS Technical Report
Not on the map. Why?
Abstract (arXiv)
This work proposes GLM-TTS, a production-level TTS system designed for efficiency, controllability, and high-fidelity speech generation. GLM-TTS follows a two-stage architecture, consisting of a text-to-token autoregressive model and a token-to-waveform diffusion model. With only 100k hours of training data, GLM-TTS achieves state-of-the-art performance on multiple open-source benchmarks. To meet production requirements, GLM-TTS improves speech quality through an optimized speech tokenizer with fundamental frequency constraints and a GRPO-based multi-reward reinforcement learning framework that jointly optimizes pronunciation, speaker similarity, and expressive prosody. In parallel, the system enables efficient and controllable deployment via parameter-efficient LoRA-based voice customization and a hybrid phoneme-text input scheme that provides precise pronunciation control. Our code is available at https://github.com/zai-org/GLM-TTS. Real-time speech synthesis demos are provided via Z.ai (audio.z.ai), the Zhipu Qingyan app/web (chatglm.cn).
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 22
- 2026MM-Sonate: Multimodal Controllable Audio-Video Generation with Zero-Shot Voice Cloningcited by 7
- 2026UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructionscited by 2
- 2026Joint Residual Reweighting for Classifier Free Guidance in Flow-Matching Zero-Shot TTScited by 1
- 2026HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speechcited by 1
- 2026FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillationcited by 0
- 2026VoxENES 2026: Benchmarking Generalization of Speech Spoofing Detectors Against LLM-Era TTS and Voice Conversioncited by 0
- 2026Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialoguecited by 0
- 2026Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue28 Aug 2026
- 2026VoxENES 2026: Benchmarking Generalization of Speech Spoofing Detectors Against LLM-Era TTS and Voice Conversion13 Jul 2026
- 2026HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech26 Jun 2026
- 2026Joint Residual Reweighting for Classifier Free Guidance in Flow-Matching Zero-Shot TTS24 Jun 2026
- 2026FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation8 Jun 2026
- 2026UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions24 Apr 2026
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models1 Apr 2026
- 2026MM-Sonate: Multimodal Controllable Audio-Video Generation with Zero-Shot Voice Cloning4 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization
- 2025Explore the Reinforcement Learning for the LLM based ASR and TTS system
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization
- 2025Multi-Reward GRPO for Stable and Prosodic Single-Codebook TTS LLMs at Scale
- 2026VoiceTTA: Enhancing Zero-Shot Text-to-Speech via Reinforcement Learning-Based Test-Time Adaptation
- 2026Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidance
- 2025Differentiable Reward Optimization for LLM based TTS system