mlsanityData to 14 Oct 2026

Learning to Generate Music With Sentiment

arXiv 2103.06125 ↗First posted 9 Mar 2021cs.LG cs.IR cs.SDcited by 29

Not on the map. Why?

Abstract (arXiv)

Deep Learning models have shown very promising results in automatically composing polyphonic music pieces. However, it is very hard to control such models in order to guide the compositions towards a desired goal. We are interested in controlling a model to automatically generate music with a given sentiment. This paper presents a generative Deep Learning model that can be directed to compose music with a given sentiment. Besides music generation, the same model can be used for sentiment analysis of symbolic music. We evaluate the accuracy of the model in classifying sentiment of symbolic music using a new dataset of video game soundtracks. Results show that our model is able to obtain good prediction accuracy. A user study shows that human subjects agreed that the generated music has the intended sentiment, however negative pieces can be ambiguous.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 9 Mar 2021.

Builds on

6 of 20 references.

References · 6

  1. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
  2. 2017Learning to Generate Reviews and Discovering Sentimentcited by 148
  3. 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 91
  4. 2017Deep Learning Techniques for Music Generation -- A Surveycited by 49
  5. 2016Multiplicative LSTM for sequence modellingcited by 27
  6. 2014Generating Music from Literaturecited by 6

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 6; 2023: 8; 2024: 8; 2025: 5.

29 papers.

Sort:

By area:

  1. 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
  2. 2022Symbolic music generation conditioned on continuous-valued emotionscited by 13
  3. 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
  4. 2022Controlling Perceived Emotion in Symbolic Music Generation with Monte Carlo Tree Searchcited by 11
  5. 2022Generating music with sentiment using Transformer-GANscited by 11
  6. 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challengescited by 9
  7. 2023A Survey of AI Music Generation Tools and Modelscited by 9
  8. 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performancecited by 9
  9. 2022YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotationscited by 7
  10. 2024Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challengescited by 7
  11. 2025Towards Unified Music Emotion Recognition across Dimensional and Categorical Modelscited by 7
  12. 2023REMAST: Real-time Emotion-based Music Arrangement with Soft Transitioncited by 5
17 more
  1. 2023EmoGen: Eliminating Subjective Bias in Emotional Music Generationcited by 5
  2. 2024Emotion-driven Piano Music Generation via Two-stage Disentanglement and Functional Representationcited by 5
  3. 2024The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videoscited by 4
  4. 2024Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representationcited by 4
  5. 2022A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognitioncited by 3
  6. 2023Fast Diffusion GAN Model for Symbolic Music Generation Controlled by Emotionscited by 3
  7. 2023Emotion-Conditioned Melody Harmonization with Hierarchical Variational Autoencodercited by 2
  8. 2023Emotion4MIDI: a Lyrics-based Emotion-Labeled Symbolic Music Datasetcited by 2
  9. 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Textcited by 2
  10. 2021Music Sentiment Transfercited by 1
  11. 2022FIGARO: Generating Symbolic Music with Fine-Grained Artistic Controlcited by 1
  12. 2023EMelodyGen: Emotion-Conditioned Melody Generation in ABC Notation with the Musical Feature Templatecited by 1
  13. 2024Agent-Driven Large Language Models for Mandarin Lyric Generationcited by 1
  14. 2024Emotion Manipulation Through Music -- A Deep Learning Interactive Visual Approachcited by 0
  15. 2025AImoclips: A Benchmark for Evaluating Emotion Conveyance in Text-to-Music Generationcited by 0
  16. 2025Story2MIDI: Emotionally Aligned Music Generation from Textcited by 0
  17. 2025Memo2496: Expert-Annotated Dataset and Dual-view Adaptive Framework for Music Emotion Recognitioncited by 0