In Other News: A Bi-style Text-to-speech Model for Synthesizing Newscaster Voice with Limited Data
Not on the map. Why?
Abstract (arXiv)
Neural text-to-speech synthesis (NTTS) models have shown significant progress in generating high-quality speech, however they require a large quantity of training data. This makes creating models for multiple styles expensive and time-consuming. In this paper different styles of speech are analysed based on prosodic variations, from this a model is proposed to synthesise speech in the style of a newscaster, with just a few hours of supplementary data. We pose the problem of synthesising in a target style using limited data as that of creating a bi-style model that can synthesise both neutral-style and newscaster-style speech via a one-hot vector which factorises the two styles. We also propose conditioning the model on contextual word embeddings, and extensively evaluate it against neutral NTTS, and neutral concatenative-based synthesis. This model closes the gap in perceived style-appropriateness between natural recordings for newscaster-style of speech, and neutral speech synthesis by approximately two-thirds.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 2; 2023: 0; 2024: 1.
7 papers.
- 2024BASE TTS: Lessons from building a billion-parameter Text-to-Speech model on 100K hours of datacited by 74
- 2021SynthASR: Unlocking Synthetic Data for Speech Recognitioncited by 34
- 2021Machine Translation Verbosity Control for Automatic Dubbingcited by 18
- 2022Prosodic Alignment for off-screen automatic dubbingcited by 6
- 2022Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosodycited by 5
- 2021Discrete Acoustic Space for an Efficient Sampling in Neural Text-To-Speechcited by 3
- 2021Enhancing audio quality for expressive Neural Text-to-Speechcited by 2
- 2024BASE TTS: Lessons from building a billion-parameter Text-to-Speech model on 100K hours of data12 Feb 2024
- 2022Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosody29 Jun 2022
- 2022Prosodic Alignment for off-screen automatic dubbing6 Apr 2022
- 2021Discrete Acoustic Space for an Efficient Sampling in Neural Text-To-Speech24 Oct 2021
- 2021Machine Translation Verbosity Control for Automatic Dubbing8 Oct 2021
- 2021Enhancing audio quality for expressive Neural Text-to-Speech13 Aug 2021
- 2021SynthASR: Unlocking Synthetic Data for Speech Recognition14 Jun 2021