mlsanityData to 7 Oct 2026

The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systems

arXiv 1806.09514 ↗First posted 25 Jun 2018cs.CL cs.AI eess.AScited by 61

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a database of emotional speech intended to be open-sourced and used for synthesis and generation purpose. It contains data for male and female actors in English and a male actor in French. The database covers 5 emotion classes so it could be suitable to build synthesis and voice transformation systems with the potential to control the emotional dimension in a continuous way. We show the data's efficiency by building a simple MLP system converting neutral to angry speech style and evaluate it via a CMOS perception test. Even though the system is a very simple one, the test show the efficiency of the data which is promising for future work.

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jun 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 2; 2023: 11; 2024: 17; 2025: 13; 2026: 12.

61 papers.

Sort:

By area:

  1. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  2. 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 183
  3. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
  4. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
  5. 2021Text-Free Prosody-Aware Generative Spoken Language Modelingcited by 119
  6. 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
  7. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
  8. 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 93
  9. 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
  10. 2024SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Wordscited by 67
  11. 2025DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignmentcited by 47
  12. 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkcited by 39
38 more
  1. 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
  2. 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representationscited by 29
  3. 2024LLM-based Conversational AI Therapist for Daily Functioning Screening and Psychotherapeutic Intervention via Everyday Smart Devicescited by 21
  4. 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
  5. 2021EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Modelcited by 18
  6. 2024Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Datasetcited by 15
  7. 2023Speech Emotion Diarization: Which Emotion Appears When?cited by 13
  8. 2024ED-TTS: Multi-Scale Emotion Modeling using Cross-Domain Emotion Diarization for Emotional Speech Synthesiscited by 9
  9. 2023EMNS /Imz/ Corpus: An emotive single-speaker dataset for narrative storytelling in games, television and graphic novelscited by 7
  10. 2024Audio Dialogues: Dialogues dataset for audio and music understandingcited by 7
  11. 2024A Review of Human Emotion Synthesis Based on Generative Technologycited by 7
  12. 2026Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadoxcited by 7
  13. 2021Global Rhythm Style Transfer Without Text Transcriptionscited by 6
  14. 2022An Overview & Analysis of Sequence-to-Sequence Emotional Voice Conversioncited by 6
  15. 2023Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensitiescited by 5
  16. 2025Steering Language Model to Stable Speech Emotion Recognition via Contextual Perception and Chain of Thoughtcited by 5
  17. 2023Learning Emotional Representations from Imbalanced Speech Data for Speech Emotion Recognition and Emotional Text-to-Speechcited by 4
  18. 2025The First VoicePrivacy Attacker Challengecited by 4
  19. 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMscited by 4
  20. 2021Cognitive Coding of Speechcited by 2
  21. 2023Active Learning Based Fine-Tuning Framework for Speech Emotion Recognitioncited by 2
  22. 2023CLARA: Multilingual Contrastive Learning for Audio Representation Acquisitioncited by 2
  23. 2023Towards Generalizable SER: Soft Labeling and Data Augmentation for Modeling Temporal Emotion Shifts in Large-Scale Multilingual Speechcited by 2
  24. 2024MAD Speech: Measures of Acoustic Diversity of Speechcited by 2
  25. 2025UDDETTS: Unifying Discrete and Dimensional Emotions for Controllable Emotional Text-to-Speechcited by 2
  26. 2026AEQ-Bench: Measuring Empathy of Omni-Modal Large Modelscited by 2
  27. 2026DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understandingcited by 2
  28. 2026VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMscited by 2
  29. 2022Contextual Expressive Text-to-Speechcited by 1
  30. 2023MUST&P-SRL: Multi-lingual and Unified Syllabification in Text and Phonetic Domains for Speech Representation Learningcited by 1
  31. 2024Llama-VITS: Enhancing TTS Synthesis with Semantic Awarenesscited by 1
  32. 2024What Does it Take to Generalize SER Model Across Datasets? A Comprehensive Benchmarkcited by 1
  33. 2025Unsupervised Speech Segmentation: A General Approach Using Speech Language Modelscited by 1
  34. 2025JELLY: Joint Emotion Recognition and Context Reasoning with LLMs for Conversational Speech Synthesiscited by 1
  35. 2025A Variational Framework for Improving Naturalness in Generative Spoken Language Modelscited by 1
  36. 2026Residual Tokens Enhance Masked Autoencoders for Speech Modelingcited by 1
  37. 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognitioncited by 0
  38. 2024The First VoicePrivacy Attacker Challenge Evaluation Plancited by 0

50 most cited of 61 All 61 (JSON)