mlsanityData to 7 Oct 2026

Emotion controllable speech synthesis using emotion-unlabeled dataset with the assistance of cross-domain speech emotion recognition

arXiv 2010.13350 ↗First posted 26 Oct 2020eess.AS cs.SDcited by 19

Not on the map. Why?

Abstract (arXiv)

Neural text-to-speech (TTS) approaches generally require a huge number of high quality speech data, which makes it difficult to obtain such a dataset with extra emotion labels. In this paper, we propose a novel approach for emotional TTS synthesis on a TTS dataset without emotion labels. Specifically, our proposed method consists of a cross-domain speech emotion recognition (SER) model and an emotional TTS model. Firstly, we train the cross-domain SER model on both SER and TTS datasets. Then, we use emotion labels on the TTS dataset predicted by the trained SER model to build an auxiliary SER task and jointly train it with the TTS model. Experimental results show that our proposed method can generate speech with the specified emotional expressiveness and nearly no hindering on the speech quality.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 5; 2023: 3; 2024: 5; 2025: 1.

19 papers.

Sort:

By area:

  1. 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
  2. 2022Emotion Intensity and its Control for Emotional Voice Conversioncited by 35
  3. 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
  4. 2022Speech Synthesis with Mixed Emotionscited by 28
  5. 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
  6. 2021Reinforcement Learning for Emotional Text-to-Speech Synthesis with Improved Emotion Discriminabilitycited by 19
  7. 2023EmoMix: Emotion Mixing via Diffusion Models for Emotional Speech Synthesiscited by 19
  8. 2024Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speechcited by 19
  9. 2021EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Modelcited by 18
  10. 2021Fine-grained style control in Transformer-based Text-to-speech Synthesiscited by 15
  11. 2023EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speechcited by 14
  12. 2024ED-TTS: Multi-Scale Emotion Modeling using Cross-Domain Emotion Diarization for Emotional Speech Synthesiscited by 9
7 more
  1. 2024A Review of Human Emotion Synthesis Based on Generative Technologycited by 7
  2. 2024Exploring speech style spaces with language models: Emotional TTS without emotion labelscited by 4
  3. 2025Prompt-Unseen-Emotion: Zero-shot Expressive Speech Synthesis with Prompt-LLM Contextual Knowledge for Mixed Emotionscited by 4
  4. 2022Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representationscited by 2
  5. 2023Cross-speaker Emotion Transfer by Manipulating Speech Style Latentscited by 2
  6. 2021StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesiscited by 1
  7. 2024A Human-in-the-Loop Approach to Improving Cross-Text Prosody Transfercited by 0