mlsanityData to 7 Oct 2026

Efficiently Trainable Text-to-Speech System Based on Deep Convolutional Networks with Guided Attention

arXiv 1710.08969 ↗First posted 24 Oct 2017cs.SD cs.AI cs.LGcited by 57

Not on the map. Why?

Abstract (arXiv)

This paper describes a novel text-to-speech (TTS) technique based on deep convolutional neural networks (CNN), without use of any recurrent units. Recurrent neural networks (RNN) have become a standard technique to model sequential data recently, and this technique has been used in some cutting-edge neural TTS techniques. However, training RNN components often requires a very powerful computer, or a very long time, typically several days or weeks. Recent other studies, on the other hand, have shown that CNN-based sequence synthesis can be much faster than RNN-based techniques, because of high parallelizability. The objective of this paper is to show that an alternative neural TTS based only on CNN alleviate these economic costs of training. In our experiment, the proposed Deep Convolutional TTS was sufficiently trained overnight (15 hours), using an ordinary gaming PC equipped with two GPUs, while the quality of the synthesized speech was almost acceptable.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 15; 2023: 6; 2024: 8; 2025: 3; 2026: 2.

57 papers.

Sort:

By area:

  1. 2021A Survey on Neural Speech Synthesiscited by 182
  2. 2021SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processingcited by 177
  3. 2022NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Qualitycited by 151
  4. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
  5. 2021One TTS Alignment To Rule Them Allcited by 47
  6. 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
  7. 2024VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignmentcited by 37
  8. 2024DASB - Discrete Audio and Speech Benchmarkcited by 32
  9. 2021Phone-to-audio alignment without text: A Semi-supervised Approachcited by 25
  10. 2024How Should We Extract Discrete Audio Tokens from Self-Supervised Models?cited by 24
  11. 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
  12. 2024Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignmentcited by 21
38 more
  1. 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
  2. 2022Learning Audio-Text Agreement for Open-vocabulary Keyword Spottingcited by 20
  3. 2025PresentAgent: Multimodal Agent for Presentation Video Generationcited by 20
  4. 2021High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latencycited by 19
  5. 2022Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech Recognitioncited by 14
  6. 2021VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attentioncited by 12
  7. 2022Simple and Effective Unsupervised Speech Synthesiscited by 12
  8. 2023Learning to Speak from Text: Zero-Shot Multilingual Text-to-Speech with Unsupervised Text Pretrainingcited by 10
  9. 2021Emphasis control for parallel neural TTScited by 9
  10. 2021Neural HMMs are all you need (for high-quality attention-free TTS)cited by 8
  11. 2021A Melody-Unsupervision Model for Singing Voice Synthesiscited by 8
  12. 2024Mitigating Unauthorized Speech Synthesis for Voice Protectioncited by 8
  13. 2022Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Losscited by 7
  14. 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
  15. 2021A study of latent monotonic attention variantscited by 5
  16. 2021Analysis and Assessment of Controllability of an Expressive Deep Learning-based TTS systemcited by 4
  17. 2021Fast DCTTS: Efficient Deep Convolutional Text-to-Speechcited by 4
  18. 2021Exploring Machine Speech Chain for Domain Adaptation and Few-Shot Speaker Adaptationcited by 4
  19. 2023Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Studycited by 4
  20. 2023ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representationscited by 4
  21. 2022Regotron: Regularizing the Tacotron2 architecture via monotonic alignment losscited by 3
  22. 2024A Statistical Analysis of Wasserstein Autoencoders for Intrinsically Low-dimensional Datacited by 3
  23. 2024A multilingual training strategy for low resource Text to Speechcited by 3
  24. 2022A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesiscited by 2
  25. 2022Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent languagecited by 2
  26. 2023AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignmentcited by 2
  27. 2025Length-Aware Rotary Position Embedding for Text-Speech Alignmentcited by 2
  28. 2021Fake Visual Content Detection Using Two-Stream Convolutional Neural Networkscited by 1
  29. 2021A Neural Text-to-Speech Model Utilizing Broadcast Data Mixed with Background Musiccited by 1
  30. 2021UniTTS: Residual Learning of Unified Embedding Space for Speech Style Controlcited by 1
  31. 2022Karaoker: Alignment-free singing voice synthesis with speech training datacited by 1
  32. 2022Enhancement of Pitch Controllability using Timbre-Preserving Pitch Augmentation in FastPitchcited by 1
  33. 2022AutoLV: Automatic Lecture Video Generatorcited by 1
  34. 2022Predicting pairwise preferences between TTS audio stimuli using parallel ratings data and anti-symmetric twin neural networkscited by 1
  35. 2023Looking and Listening: Audio Guided Text Recognitioncited by 1
  36. 2024Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Predictioncited by 1
  37. 2025Eliminating stability hallucinations in llm-based tts models via attention guidancecited by 1
  38. 2021Byakto Speech: Real-time long speech synthesis with convolutional neural network: Transfer learning from English to Banglacited by 0

50 most cited of 57 All 57 (JSON)