Data to 7 Oct 2026

SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Model

arXiv 2104.05557 ↗First posted 2 Apr 2021eess.AS cs.SDcited by 56

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose SC-GlowTTS: an efficient zero-shot multi-speaker text-to-speech model that improves similarity for speakers unseen during training. We propose a speaker-conditional architecture that explores a flow-based decoder that works in a zero-shot scenario. As text encoders, we explore a dilated residual convolutional-based encoder, gated convolutional-based encoder, and transformer-based encoder. Additionally, we have shown that adjusting a GAN-based vocoder for the spectrograms predicted by the TTS model on the training dataset can significantly improve the similarity and speech quality for new speakers. Our model converges using only 11 speakers, reaching state-of-the-art results for similarity with new speakers, as well as high speech quality.

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 10; 2023: 10; 2024: 16; 2025: 14; 2026: 1.

56 papers.

Sort:

By area:

2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
2021A Survey on Neural Speech Synthesiscited by 182
2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
2023SpeechX: Neural Codec Language Model as a Versatile Speech Transformercited by 64
2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 42
2022Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Datacited by 35
2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22
2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 22
2022GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speechcited by 21
2023StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesiscited by 21

38 more

2024StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbingcited by 20
2024SpeechCraft: A Fine-grained Expressive Speech Dataset with Natural Language Descriptioncited by 20
2023SEF-VC: Speaker Embedding Free Zero-Shot Voice Conversion with Cross Attentioncited by 19
2021AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Personcited by 17
2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
2021Speaker Generationcited by 13
2022Exact Prosody Cloning in Zero-Shot Multispeaker Text-to-Speechcited by 13
2022Transfer Learning Framework for Low-Resource Text-to-Speech using a Large-Scale Unlabeled Speech Corpuscited by 10
2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detectioncited by 9
2025Prosody-Enhanced Acoustic Pre-training and Acoustic-Disentangled Prosody Adapting for Movie Dubbingcited by 9
2025DMOSpeech 2: Reinforcement Learning for Duration Prediction in Metric-Optimized Speech Synthesiscited by 7
2024StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusioncited by 6
2025STOPA: A Database of Systematic VariaTion Of DeePfake Audio for Open-Set Source Tracing and Attributioncited by 6
2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesiscited by 5
2025An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASRcited by 5
2025Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulationscited by 5
2024TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizerscited by 4
2025Voice Cloning: Comprehensive Surveycited by 4
2024Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Modelcited by 3
2024Towards Zero-Shot Text-To-Speech for Arabic Dialectscited by 3
2022Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attentioncited by 2
2022GlowVC: Mel-spectrogram space disentangling model for language-independent text-free voice conversioncited by 2
2022Controllable Accented Text-to-Speech Synthesiscited by 2
2023Residual Information in Deep Speaker Embedding Architecturescited by 2
2023AE-Flow: AutoEncoder Normalizing Flowcited by 2
2024PolySpeech: Exploring Unified Multitask Speech Models for Competitiveness with Single-task Modelscited by 2
2024The NPU-HWC System for the ISCSLP 2024 Inspirational and Convincing Audio Generation Challengecited by 2
2023Creating New Voices using Normalizing Flowscited by 1
2024HyperTTS: Parameter Efficient Adaptation in Text to Speech using Hypernetworkscited by 1
2024Text-to-Speech for Unseen Speakers via Low-Complexity Discrete Unit-Based Frame Selectioncited by 1
2024MultiVerse: Efficient and Expressive Zero-Shot Multi-Task Text-to-Speechcited by 1
2025Exploiting Vulnerabilities in Speech Translation Systems through Targeted Adversarial Attackscited by 1
2025ILT-Iterative LoRA Training through Focus-Feedback-Fix for Multilingual Speech Recognitioncited by 1
2022Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localizationcited by 0
2023Automatic Tuning of Loss Trade-offs without Hyper-parameter Search in End-to-End Zero-Shot Speech Synthesiscited by 0
2024Phonetically rich corpus construction for a low-resourced languagecited by 0
2024Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generationcited by 0
2025Towards Lightweight and Stable Zero-shot TTS with Self-distilled Representation Disentanglementcited by 0

50 most cited of 56 All 56 (JSON)