LSSED: a large-scale dataset and benchmark for speech emotion recognition
Not on the map. Why?
Abstract (arXiv)
Speech emotion recognition is a vital contributor to the next generation of human-computer interaction (HCI). However, current existing small-scale databases have limited the development of related research. In this paper, we present LSSED, a challenging large-scale english speech emotion dataset, which has data collected from 820 subjects to simulate real-world distribution. In addition, we release some pre-trained models based on LSSED, which can not only promote the development of speech emotion recognition, but can also be transferred to related downstream tasks such as mental health analysis where data is extremely difficult to collect. Finally, our experiments show the necessity of large-scale datasets and the effectiveness of pre-trained models. The dateset will be released on https://github.com/tobefans/LSSED.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 30 Jan 2021.
Builds on
9 of 27 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2018Domain Adversarial for Acoustic Emotion Recognitioncited by 25
- 2020Pyramidal Convolution: Rethinking Convolutional Neural Networks for Visual Recognitioncited by 25
- 2018Attention Based Fully Convolutional Network for Speech Emotion Recognitioncited by 23
- 2020Recognizing More Emotions with Less Data Using Self-supervised Transfer Learningcited by 7
- 2020Multi-Time-Scale Convolution for Emotion Recognition from Speech Audio Signalscited by 2
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 3; 2024: 4; 2025: 2; 2026: 3.
17 papers.
Sort:
By area:
- 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 117
- 2021SERAB: A multi-lingual benchmark for speech emotion recognitioncited by 22
- 2021EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Modelcited by 18
- 2023Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognitioncited by 16
- 2026Emotion-LLaMAv2 and MMEVerse: A New Framework and Benchmark for Multimodal Emotion Understandingcited by 5
- 2023Active Learning Based Fine-Tuning Framework for Speech Emotion Recognitioncited by 2
- 2024Facial Expression-Enhanced TTS: Combining Face Representation and Emotion Intensity for Adaptive Speechcited by 2
- 2021Automatic Analysis of the Emotional Content of Speech in Daylong Child-Centered Recordings from a Neonatal Intensive Care Unitcited by 1
- 2022Emotional Speech Recognition with Pre-trained Deep Visual Modelscited by 1
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech datasetcited by 1
- 2025Investigating Affect Mining Techniques for Annotation Sample Selection in the Creation of Finnish Affective Speech Corpuscited by 1
- 2026HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speechcited by 1
5 more
- 2023SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adultscited by 0
- 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognitioncited by 0
- 2024Can We Estimate Purchase Intention Based on Zero-shot Speech Emotion Recognition?cited by 0
- 2025Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Rolescited by 0
- 2026Watching Movies Like a Human: Egocentric Emotion Understanding for Embodied Companionscited by 0
- 2026HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech26 Jun 2026
- 2026Watching Movies Like a Human: Egocentric Emotion Understanding for Embodied Companions17 Apr 2026
- 2026Emotion-LLaMAv2 and MMEVerse: A New Framework and Benchmark for Multimodal Emotion Understanding23 Jan 2026
- 2025Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles3 Oct 2025
- 2025Investigating Affect Mining Techniques for Annotation Sample Selection in the Creation of Finnish Affective Speech Corpus23 May 2025
- 2024Can We Estimate Purchase Intention Based on Zero-shot Speech Emotion Recognition?12 Oct 2024
- 2024Facial Expression-Enhanced TTS: Combining Face Representation and Emotion Intensity for Adaptive Speech24 Sep 2024
- 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning17 Jun 2024
- 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition1 May 2024
- 2023SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adults24 Nov 2023
- 2023Active Learning Based Fine-Tuning Framework for Speech Emotion Recognition30 Sep 2023
- 2023Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition20 Jul 2023
5 more
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech dataset14 Nov 2022
- 2022Emotional Speech Recognition with Pre-trained Deep Visual Models6 Apr 2022
- 2021SERAB: A multi-lingual benchmark for speech emotion recognition7 Oct 2021
- 2021EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model17 Jun 2021
- 2021Automatic Analysis of the Emotional Content of Speech in Daylong Child-Centered Recordings from a Neonatal Intensive Care Unit14 Jun 2021
- 2021SERAB: A multi-lingual benchmark for speech emotion recognitioncited by 22
- 2021EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Modelcited by 18
- 2023Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognitioncited by 16
- 2026Emotion-LLaMAv2 and MMEVerse: A New Framework and Benchmark for Multimodal Emotion Understandingcited by 5
- 2023Active Learning Based Fine-Tuning Framework for Speech Emotion Recognitioncited by 2
- 2024Facial Expression-Enhanced TTS: Combining Face Representation and Emotion Intensity for Adaptive Speechcited by 2
- 2021Automatic Analysis of the Emotional Content of Speech in Daylong Child-Centered Recordings from a Neonatal Intensive Care Unitcited by 1
- 2022Emotional Speech Recognition with Pre-trained Deep Visual Modelscited by 1
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech datasetcited by 1
- 2025Investigating Affect Mining Techniques for Annotation Sample Selection in the Creation of Finnish Affective Speech Corpuscited by 1
- 2023SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adultscited by 0
- 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognitioncited by 0
12 most cited of 15 All 15 (JSON)
- 2026Watching Movies Like a Human: Egocentric Emotion Understanding for Embodied Companions17 Apr 2026
- 2026Emotion-LLaMAv2 and MMEVerse: A New Framework and Benchmark for Multimodal Emotion Understanding23 Jan 2026
- 2025Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles3 Oct 2025
- 2025Investigating Affect Mining Techniques for Annotation Sample Selection in the Creation of Finnish Affective Speech Corpus23 May 2025
- 2024Can We Estimate Purchase Intention Based on Zero-shot Speech Emotion Recognition?12 Oct 2024
- 2024Facial Expression-Enhanced TTS: Combining Face Representation and Emotion Intensity for Adaptive Speech24 Sep 2024
- 2024Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition1 May 2024
- 2023SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adults24 Nov 2023
- 2023Active Learning Based Fine-Tuning Framework for Speech Emotion Recognition30 Sep 2023
- 2023Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition20 Jul 2023
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech dataset14 Nov 2022
- 2022Emotional Speech Recognition with Pre-trained Deep Visual Models6 Apr 2022
12 newest of 15 All 15 (JSON)