mlsanityData to 14 Oct 2026

Emotion4MIDI: a Lyrics-based Emotion-Labeled Symbolic Music Dataset

arXiv 2307.14783 ↗First posted 27 Jul 2023eess.AS cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We present a new large-scale emotion-labeled symbolic music dataset consisting of 12k MIDI songs. To create this dataset, we first trained emotion classification models on the GoEmotions dataset, achieving state-of-the-art results with a model half the size of the baseline. We then applied these models to lyrics from two large-scale MIDI datasets. Our dataset covers a wide range of fine-grained emotions, providing a valuable resource to explore the connection between music and emotions and, especially, to develop models that can generate music based on specific emotions. Our code for inference, trained models, and datasets are available online.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 14 of its 39 references that are in the map. First posted on arXiv 27 Jul 2023.

Builds on

14 of 39 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  7. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
  8. 2018Music Transformercited by 211
  9. 2017Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answeringcited by 117
  10. 2021EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generationcited by 53
  11. 2019Counterpoint by Convolutioncited by 43
  12. 2021Learning to Generate Music With Sentimentcited by 29
2 more
  1. 2022Symbolic music generation conditioned on continuous-valued emotionscited by 13
  2. 2022A Review on Text-Based Emotion Detection -- Techniques, Applications, Datasets, and Future Directionscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Video Soundtrack Generation by Aligning Emotions and Temporal Boundariescited by 2
  2. 2026A Hybrid Framework for Song Lyric Annotation Based on Human-LLM Alignmentcited by 0