mlsanityData to 7 Oct 2026

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model

arXiv 2106.09317 ↗First posted 17 Jun 2021cs.CL cs.SD eess.AScited by 18

Not on the map. Why?

Abstract (arXiv)

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to generate a more emotional and more expressive speech is becoming a new challenge to researchers due to the scarcity of high-quality emotion speech dataset and the lack of advanced emotional TTS model. In this paper, we first briefly introduce and publicly release a Mandarin emotion speech dataset including 9,724 samples with audio files and its emotion human-labeled annotation. After that, we propose a simple but efficient architecture for emotional speech synthesis called EMSpeech. Unlike those models which need additional reference audio as input, our model could predict emotion labels just from the input text and generate more expressive speech conditioned on the emotion embedding. In the experiment phase, we first validate the effectiveness of our dataset by an emotion classification task. Then we train our model on the proposed dataset and conduct a series of subjective evaluations. Finally, by showing a comparable performance in the emotional speech synthesis task, we successfully demonstrate the ability of the proposed model.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 17 Jun 2021.

Builds on

25 of 37 references.

References · 25

  1. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  2. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  3. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  4. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  5. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
  6. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
  7. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 257
  8. 2020Seen and Unseen emotional style transfer for voice conversion with a new emotional speech datasetcited by 119
  9. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
  10. 2018The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methodscited by 68
  11. 2018The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systemscited by 61
  12. 2020LRSpeech: Extremely Low-Resource Speech Synthesis and Recognitioncited by 43
13 more
  1. 2020MultiSpeech: Multi-Speaker Text to Speech with Transformercited by 42
  2. 2019Almost Unsupervised Text to Speech and Automatic Speech Recognitioncited by 41
  3. 2020DiDiSpeech: A Large Scale Mandarin Speech Corpuscited by 33
  4. 2020DeepSinger: Singing Voice Synthesis with Data Mined From the Webcited by 32
  5. 2020Controllable Emotion Transfer For End-to-End Speech Synthesiscited by 32
  6. 2018Predicting Expressive Speaking Style From Text In End-To-End Speech Synthesiscited by 31
  7. 2020Fine-grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesiscited by 29
  8. 2019End-to-End Emotional Speech Synthesis Using Style Tokens and Semi-Supervised Trainingcited by 19
  9. 2020Emotion controllable speech synthesis using emotion-unlabeled dataset with the assistance of cross-domain speech emotion recognitioncited by 19
  10. 2021LSSED: a large-scale dataset and benchmark for speech emotion recognitioncited by 17
  11. 2020AdaDurIAN: Few-shot Adaptation for Neural Text-to-Speech with DurIANcited by 14
  12. 2019Using VAEs and Normalizing Flows for One-shot Text-To-Speech Synthesis of Expressive Speechcited by 8
  13. 2018The PRIORI Emotion Dataset: Linking Mood to Emotion Detected In-the-Wildcited by 5

Built on by

Cited by year

Citing papers per year: 2022: 8; 2023: 2; 2024: 6; 2025: 2.

18 papers.

Sort:

By area:

  1. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 147
  2. 2022TranSpeech: Speech-to-Speech Translation With Bilateral Perturbationcited by 34
  3. 2022GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speechcited by 21
  4. 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
  5. 2024FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generationcited by 19
  6. 2022VarietySound: Timbre-Controllable Video to Sound Generation via Unsupervised Information Disentanglementcited by 11
  7. 2023QI-TTS: Questioning Intonation Control for Emotional Speech Synthesiscited by 8
  8. 2024Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settingscited by 6
  9. 2022Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on Data-Driven Deep Learningcited by 5
  10. 2024UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Promptscited by 4
  11. 2024Exploring speech style spaces with language models: Emotional TTS without emotion labelscited by 4
  12. 2022Emotion Selectable End-to-End Text-based Speech Editingcited by 3
6 more
  1. 2023Cross-speaker Emotion Transfer by Manipulating Speech Style Latentscited by 2
  2. 2025Inclusivity of AI Speech in Healthcare: A Decade Look Backcited by 2
  3. 2025Beyond Global Emotion: Fine-Grained Emotional Speech Synthesis with Dynamic Word-Level Modulationcited by 2
  4. 2022A Dataset for Speech Emotion Recognition in Greek Theatrical Playscited by 0
  5. 2024Construction and Evaluation of Mandarin Multimodal Emotional Speech Databasecited by 0
  6. 2024Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysiscited by 0