mlsanityData to 7 Oct 2026

Into-TTS : Intonation Template Based Prosody Control System

arXiv 2204.01271 ↗First posted 4 Apr 2022eess.AS cs.LG cs.SDcited by 2

Not on the map. Why?

Abstract (arXiv)

Intonations play an important role in delivering the intention of a speaker. However, current end-to-end TTS systems often fail to model proper intonations. To alleviate this problem, we propose a novel, intuitive method to synthesize speech in different intonations using predefined intonation templates. Prior to TTS model training, speech data are grouped into intonation templates in an unsupervised manner. Two proposed modules are added to the end-to-end TTS framework: an intonation predictor and an intonation encoder. The intonation predictor recommends a suitable intonation template to the given text. The intonation encoder, attached to the text encoder output, synthesizes speech abiding the requested intonation template. Main contributions of our paper are: (a) an easy-to-use intonation control system covering a wide range of users; (b) better performance in wrapping speech in a requested intonation with improved objective and subjective evaluation; and (c) incorporating a pre-trained language model for intonation modelling. Audio samples are available at https://srtts.github.io/IntoTTS.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 4 Apr 2022.

Builds on

13 of 26 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  3. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  4. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 257
  5. 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 171
  6. 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 109
  7. 2018Hierarchical Generative Modeling for Controllable Speech Synthesiscited by 93
  8. 2018Robust and fine-grained prosody control of end-to-end speech synthesiscited by 48
  9. 2022MsEmoTTS: Multi-scale emotion transfer, prediction, and control for emotional speech synthesiscited by 29
  10. 2021High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latencycited by 19
  11. 2020Bunched LPCNet : Vocoder for Low-cost Neural Text-To-Speech Systemscited by 16
  12. 2019Effective Use of Variational Embedding Capacity in Expressive End-to-End Speech Synthesiscited by 15
1 more
  1. 2021Prosodic Clustering for Phoneme-level Prosody Control in End-to-End Speech Synthesiscited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.

  1. 2023QI-TTS: Questioning Intonation Control for Emotional Speech Synthesiscited by 8
  2. 2024PRESENT: Zero-Shot Text-to-Prosody Controlcited by 0