Explicit Intensity Control for Accented Text-to-speech
Not on the map. Why?
Abstract (arXiv)
Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). How to control the intensity of accent in the process of TTS is a very interesting research direction, and has attracted more and more attention. Recent work design a speaker-adversarial loss to disentangle the speaker and accent information, and then adjust the loss weight to control the accent intensity. However, such a control method lacks interpretability, and there is no direct correlation between the controlling factor and natural accent intensity. To this end, this paper propose a new intuitive and explicit accent intensity control scheme for accented TTS. Specifically, we first extract the posterior probability, called as ``goodness of pronunciation (GoP)'' from the L1 speech recognition model to quantify the phoneme accent intensity for accented speech, then design a FastSpeech2 based TTS model, named Ai-TTS, to take the accent intensity expression into account during speech generation. Experiments show that the our method outperforms the baseline model in terms of accent rendering and intensity control.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 11 of its 39 references that are in the map. First posted on arXiv 27 Oct 2022.
Builds on
11 of 39 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
- 2019Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloningcited by 66
- 2020Expressive TTS Training with Frame and Style Reconstruction Losscited by 30
- 2020L-Vector: Neural Label Embedding for Domain Adaptationcited by 9
- 2020GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesiscited by 9
- 2022Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on Data-Driven Deep Learningcited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 2.
5 papers.
- 2024EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speechcited by 23
- 2024AccentBox: Towards High-Fidelity Zero-Shot Accent Generationcited by 9
- 2025Retrieval-Augmented Dialogue Knowledge Aggregation for Expressive Conversational Speech Synthesiscited by 4
- 2022MnTTS2: An Open-Source Multi-Speaker Mongolian Text-to-Speech Synthesis Datasetcited by 0
- 2025Optimizing Multilingual Text-To-Speech with Accents & Emotionscited by 0
- 2025Optimizing Multilingual Text-To-Speech with Accents & Emotions19 Jun 2025
- 2025Retrieval-Augmented Dialogue Knowledge Aggregation for Expressive Conversational Speech Synthesis11 Jan 2025
- 2024AccentBox: Towards High-Fidelity Zero-Shot Accent Generation13 Sep 2024
- 2024EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speech12 Jun 2024
- 2022MnTTS2: An Open-Source Multi-Speaker Mongolian Text-to-Speech Synthesis Dataset11 Dec 2022