mlsanityData to 7 Oct 2026

Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning

arXiv 1710.07654 ↗First posted 20 Oct 2017cs.SD cs.AI cs.CLcited by 67

Not on the map. Why?

Abstract (arXiv)

We present Deep Voice 3, a fully-convolutional attention-based neural text-to-speech (TTS) system. Deep Voice 3 matches state-of-the-art neural speech synthesis systems in naturalness while training ten times faster. We scale Deep Voice 3 to data set sizes unprecedented for TTS, training on more than eight hundred hours of audio from over two thousand speakers. In addition, we identify common error modes of attention-based speech synthesis networks, demonstrate how to mitigate them, and compare several different waveform synthesis methods. We also describe how to scale inference to ten million queries per day on one single-GPU server.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 26; 2022: 20; 2023: 9; 2024: 7; 2025: 5.

67 papers.

Sort:

By area:

  1. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 282
  2. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
  3. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 222
  4. 2021A Survey on Neural Speech Synthesiscited by 182
  5. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  6. 2022NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Qualitycited by 151
  7. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 142
  8. 2025Step-Audio 2 Technical Reportcited by 101
  9. 2021AdaSpeech: Adaptive Text to Speech for Custom Voicecited by 98
  10. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  11. 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
  12. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
38 more
  1. 2022AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarioscited by 41
  2. 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
  3. 2023Transformers in Speech Processing: A Surveycited by 38
  4. 2022Speech Synthesis with Mixed Emotionscited by 28
  5. 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
  6. 2021Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speechcited by 22
  7. 2022ProsoSpeech: Enhancing Prosody With Quantized Vector Pre-training in Text-to-Speechcited by 22
  8. 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
  9. 2023Generative Spoken Language Model based on continuous word-sized audio tokenscited by 19
  10. 2021GANSpeech: Adversarial Training for High-Fidelity Multi-Speaker Speech Synthesiscited by 18
  11. 2022Detecting Individual Decision-Making Style: Exploring Behavioral Stylometry in Chesscited by 18
  12. 2022WavThruVec: Latent speech representation as intermediate features for neural speech synthesiscited by 17
  13. 2022A survey on attention mechanisms for medical applications: are we moving towards better algorithms?cited by 15
  14. 2022Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech Recognitioncited by 14
  15. 2022SoundChoice: Grapheme-to-Phoneme Models with Semantic Disambiguationcited by 14
  16. 2022Heterogeneous Target Speech Separationcited by 13
  17. 2024CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Modelscited by 13
  18. 2021VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attentioncited by 12
  19. 2021Adapting TTS models For New Speakers using Transfer Learningcited by 12
  20. 2021Emotional Prosody Control for Speech Generationcited by 12
  21. 2021Expressive Neural Voice Cloningcited by 11
  22. 2021AdaSpeech 3: Adaptive Text to Speech for Spontaneous Stylecited by 11
  23. 2022Synthesizing Dysarthric Speech Using Multi-talker TTS for Dysarthric Speech Recognitioncited by 10
  24. 2022Residual-guided Personalized Speech Synthesis based on Face Imagecited by 10
  25. 2021On-device neural speech synthesiscited by 9
  26. 2021Hierarchical prosody modeling and control in non-autoregressive parallel neural TTScited by 9
  27. 2022Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New Speakerscited by 9
  28. 2021Ctrl-P: Temporal Control of Prosodic Variation for Speech Synthesiscited by 8
  29. 2021TalkNet 2: Non-Autoregressive Depth-Wise Separable Convolutional Model for Speech Synthesis with Explicit Pitch and Duration Predictioncited by 7
  30. 2023Accurate synthesis of Dysarthric Speech for ASR data augmentationcited by 7
  31. 2024Towards Accurate Lip-to-Speech Synthesis in-the-Wildcited by 7
  32. 2021Whispered and Lombard Neural Speech Synthesiscited by 6
  33. 2021Interpreting intermediate convolutional layers of generative CNNs trained on waveformscited by 6
  34. 2021Continual Speaker Adaptation for Text-to-Speech Synthesiscited by 5
  35. 2021Interactive Storytelling for Children: A Case-study of Design and Development Considerations for Ethical Conversational AIcited by 5
  36. 2022The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio Detectioncited by 5
  37. 2021Distilling the Knowledge from Conditional Normalizing Flowscited by 4
  38. 2021Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representationscited by 4

50 most cited of 67 All 67 (JSON)