ECTSpeech: Enhancing Efficient Speech Synthesis via Easy Consistency Tuning
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Diffusion models have demonstrated remarkable performance in speech synthesis, but typically require multi-step sampling, resulting in low inference efficiency. Recent studies address this issue by distilling diffusion models into consistency models, enabling efficient one-step generation. However, these approaches introduce additional training costs and rely heavily on the performance of pre-trained teacher models. In this paper, we propose ECTSpeech, a simple and effective one-step speech synthesis framework that, for the first time, incorporates the Easy Consistency Tuning (ECT) strategy into speech synthesis. By progressively tightening consistency constraints on a pre-trained diffusion model, ECTSpeech achieves high-quality one-step generation while significantly reducing training complexity. In addition, we design a multi-scale gate module (MSGate) to enhance the denoiser's ability to fuse features at different scales. Experimental results on the LJSpeech dataset demonstrate that ECTSpeech achieves audio quality comparable to state-of-the-art methods under single-step sampling, while substantially reducing the model's training cost and complexity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 3 of its 4 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
3 of 4 references.
Closest ancestors · 2
Same direction, newest first
- 2023CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model11 May
- 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech13 Jul
Other references · 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Models
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis
- 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesis
- 2023Boosting Fast and High-Quality Speech Synthesis with Linear Diffusion
- 2022FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis
- 2023ReFlow-TTS: A Rectified Flow Model for High-fidelity Text-to-Speech
- 2024FlashSpeech: Efficient Zero-Shot Speech Synthesis
- 2023ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation