Data to 7 Oct 2026

Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis

arXiv 2005.05957 ↗First posted 12 May 2020cs.SD cs.CL cs.LGcited by 54

Not on the map. Why?

Abstract (arXiv)

In this paper we propose Flowtron: an autoregressive flow-based generative network for text-to-speech synthesis with control over speech variation and style transfer. Flowtron borrows insights from IAF and revamps Tacotron in order to provide high-quality and expressive mel-spectrogram synthesis. Flowtron is optimized by maximizing the likelihood of the training data, which makes training simple and stable. Flowtron learns an invertible mapping of data to a latent space that can be manipulated to control many aspects of speech synthesis (pitch, tone, speech rate, cadence, accent). Our mean opinion scores (MOS) show that Flowtron matches state-of-the-art TTS models in terms of speech quality. In addition, we provide results on control of speech variation, interpolation between samples and style transfer between speakers seen and unseen during training. Code and pre-trained models will be made publicly available at https://github.com/NVIDIA/flowtron

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2020: 1; 2021: 10; 2022: 11; 2023: 17; 2024: 9; 2025: 6.

54 papers.

Sort:

By area:

2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
2021A Survey on Neural Speech Synthesiscited by 182
2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 156
2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 73
2023Generative Pre-training for Speech with Flow Matchingcited by 55
2023VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matchingcited by 49
2021One TTS Alignment To Rule Them Allcited by 47
2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesiscited by 34
2022StyleTTS: A Style-Based Generative Model for Natural and Diverse Text-to-Speech Synthesiscited by 32
2022BibleTTS: a large, high-fidelity, multilingual, and uniquely African speech corpuscited by 31
2023VITS2: Improving Quality and Efficiency of Single-Stage Text-to-Speech with Adversarial Learning and Architecture Designcited by 25
2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 22

38 more

2024Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignmentcited by 21
2021Integrated Speech and Gesture Synthesiscited by 16
2022StyleTalker: One-shot Style-based Audio-driven Talking Head Video Generationcited by 14
2024CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Modelscited by 13
2021VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attentioncited by 12
2023Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translationcited by 11
2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversioncited by 10
2023U-DiT TTS: U-Diffusion Vision Transformer for Text-to-Speechcited by 9
2022OverFlow: Putting flows on top of neural transducers for better TTScited by 8
2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
2021Exploring emotional prototypes in a high dimensional TTS latent spacecited by 6
2021Giving Commands to a Self-Driving Car: How to Deal with Uncertain Situations?cited by 6
2022Text-driven Emotional Style Control and Cross-speaker Style Transfer in Neural TTScited by 6
2024Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Modelcited by 6
2022Distribution augmentation for low-resource expressive text-to-speechcited by 5
2025UniWav: Towards Unified Pre-training for Speech Representation Learning and Generationcited by 5
2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyondcited by 5
2022Vis2Mus: Exploring Multimodal Representation Mapping for Controllable Music Generationcited by 4
2023ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representationscited by 4
2023Do Prosody Transfer Models Transfer Prosody?cited by 4
2023IMAD: IMage-Augmented multi-modal Dialoguecited by 4
2022Regotron: Regularizing the Tacotron2 architecture via monotonic alignment losscited by 3
2022Adversarial Audio Synthesis with Complex-valued Polynomial Networkscited by 3
2024Data-driven grapheme-to-phoneme representations for a lexicon-free text-to-speechcited by 3
2024Disentangling segmental and prosodic factors to non-native speech comprehensibilitycited by 3
2021GANtron: Emotional Speech Synthesis with Generative Adversarial Networkscited by 2
2022Bridging the prosody GAP: Genetic Algorithm with People to efficiently sample emotional prosodycited by 2
2023Multilingual Multiaccented Multispeaker TTS with RADTTScited by 2
2023VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservationcited by 2
2023AE-Flow: AutoEncoder Normalizing Flowcited by 2
2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systemscited by 2
2023Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech Recognitioncited by 1
2023Affective social anthropomorphic intelligent systemcited by 1
2023Creating New Voices using Normalizing Flowscited by 1
2024HyperTTS: Parameter Efficient Adaptation in Text to Speech using Hypernetworkscited by 1
2024Cognitively Inspired Energy-Based World Modelscited by 1
2025When Humans Growl and Birds Speak: High-Fidelity Voice Conversion from Human to Animal and Designed Soundscited by 1
2021Sprachsynthese -- State-of-the-Art in englischer und deutscher Sprachecited by 0

50 most cited of 54 All 54 (JSON)