mlsanityData to 7 Oct 2026

Controllable Emphasis with zero data for text-to-speech

arXiv 2307.07062 ↗First posted 13 Jul 2023eess.AS cs.LG cs.SDcited by 4

Not on the map. Why?

Abstract (arXiv)

We present a scalable method to produce high quality emphasis for text-to-speech (TTS) that does not require recordings or annotations. Many TTS models include a phoneme duration model. A simple but effective method to achieve emphasized speech consists in increasing the predicted duration of the emphasised word. We show that this is significantly better than spectrogram modification techniques improving naturalness by 7.3% and correct testers' identification of the emphasized word in a sentence by 40% on a reference female en-US voice. We show that this technique significantly closes the gap to methods that require explicit recordings. The method proved to be scalable and preferred in all four languages tested (English, Spanish, Italian, German), for different voices and multiple speaking styles.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 9 of its 36 references that are in the map. First posted on arXiv 13 Jul 2023.

Builds on

9 of 36 references.

References · 9

  1. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  2. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  3. 2017Deep Voice: Real-time Neural Text-to-Speechcited by 83
  4. 2021Universal Neural Vocoding with Parallel WaveNetcited by 25
  5. 2020CAMP: a Two-Stage Approach to Modelling Prosody in Contextcited by 12
  6. 2022CopyCat2: A Single Model for Multi-Speaker TTS and Many-to-Many Fine-Grained Prosody Transfercited by 7
  7. 2022Expressive, Variable, and Controllable Duration Modelling in TTScited by 7
  8. 2022Distribution augmentation for low-resource expressive text-to-speechcited by 5
  9. 2022Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosodycited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.