Learning to Generate Music With Sentiment
Not on the map. Why?
Abstract (arXiv)
Deep Learning models have shown very promising results in automatically composing polyphonic music pieces. However, it is very hard to control such models in order to guide the compositions towards a desired goal. We are interested in controlling a model to automatically generate music with a given sentiment. This paper presents a generative Deep Learning model that can be directed to compose music with a given sentiment. Besides music generation, the same model can be used for sentiment analysis of symbolic music. We evaluate the accuracy of the model in classifying sentiment of symbolic music using a new dataset of video game soundtracks. Results show that our model is able to obtain good prediction accuracy. A user study shows that human subjects agreed that the generated music has the intended sentiment, however negative pieces can be ambiguous.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 9 Mar 2021.
Builds on
6 of 20 references.
References · 6
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
- 2017Learning to Generate Reviews and Discovering Sentimentcited by 148
- 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 91
- 2017Deep Learning Techniques for Music Generation -- A Surveycited by 49
- 2016Multiplicative LSTM for sequence modellingcited by 27
- 2014Generating Music from Literaturecited by 6
Built on by
Citing papers per year: 2021: 2; 2022: 6; 2023: 8; 2024: 8; 2025: 5.
29 papers.
Sort:
By area:
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
- 2022Symbolic music generation conditioned on continuous-valued emotionscited by 13
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
- 2022Controlling Perceived Emotion in Symbolic Music Generation with Monte Carlo Tree Searchcited by 11
- 2022Generating music with sentiment using Transformer-GANscited by 11
- 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challengescited by 9
- 2023A Survey of AI Music Generation Tools and Modelscited by 9
- 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performancecited by 9
- 2022YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotationscited by 7
- 2024Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challengescited by 7
- 2025Towards Unified Music Emotion Recognition across Dimensional and Categorical Modelscited by 7
- 2023REMAST: Real-time Emotion-based Music Arrangement with Soft Transitioncited by 5
17 more
- 2023EmoGen: Eliminating Subjective Bias in Emotional Music Generationcited by 5
- 2024Emotion-driven Piano Music Generation via Two-stage Disentanglement and Functional Representationcited by 5
- 2024The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videoscited by 4
- 2024Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representationcited by 4
- 2022A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognitioncited by 3
- 2023Fast Diffusion GAN Model for Symbolic Music Generation Controlled by Emotionscited by 3
- 2023Emotion-Conditioned Melody Harmonization with Hierarchical Variational Autoencodercited by 2
- 2023Emotion4MIDI: a Lyrics-based Emotion-Labeled Symbolic Music Datasetcited by 2
- 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Textcited by 2
- 2021Music Sentiment Transfercited by 1
- 2022FIGARO: Generating Symbolic Music with Fine-Grained Artistic Controlcited by 1
- 2023EMelodyGen: Emotion-Conditioned Melody Generation in ABC Notation with the Musical Feature Templatecited by 1
- 2024Agent-Driven Large Language Models for Mandarin Lyric Generationcited by 1
- 2024Emotion Manipulation Through Music -- A Deep Learning Interactive Visual Approachcited by 0
- 2025AImoclips: A Benchmark for Evaluating Emotion Conveyance in Text-to-Music Generationcited by 0
- 2025Story2MIDI: Emotionally Aligned Music Generation from Textcited by 0
- 2025Memo2496: Expert-Annotated Dataset and Dual-view Adaptive Framework for Music Emotion Recognitioncited by 0
- 2025Memo2496: Expert-Annotated Dataset and Dual-view Adaptive Framework for Music Emotion Recognition16 Dec 2025
- 2025Story2MIDI: Emotionally Aligned Music Generation from Text1 Dec 2025
- 2025AImoclips: A Benchmark for Evaluating Emotion Conveyance in Text-to-Music Generation31 Aug 2025
- 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performance30 Jun 2025
- 2025Towards Unified Music Emotion Recognition across Dimensional and Categorical Models6 Feb 2025
- 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text4 Nov 2024
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models17 Oct 2024
- 2024Agent-Driven Large Language Models for Mandarin Lyric Generation2 Oct 2024
- 2024Emotion-driven Piano Music Generation via Two-stage Disentanglement and Functional Representation30 Jul 2024
- 2024Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representation29 Jul 2024
- 2024Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challenges13 Jun 2024
- 2024Emotion Manipulation Through Music -- A Deep Learning Interactive Visual Approach12 Jun 2024
17 more
- 2024The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos5 Apr 2024
- 2023Fast Diffusion GAN Model for Symbolic Music Generation Controlled by Emotions21 Oct 2023
- 2023EMelodyGen: Emotion-Conditioned Melody Generation in ABC Notation with the Musical Feature Template23 Sep 2023
- 2023A Survey of AI Music Generation Tools and Models24 Aug 2023
- 2023Emotion4MIDI: a Lyrics-based Emotion-Labeled Symbolic Music Dataset27 Jul 2023
- 2023EmoGen: Eliminating Subjective Bias in Emotional Music Generation3 Jul 2023
- 2023Emotion-Conditioned Melody Harmonization with Hierarchical Variational Autoencoder6 Jun 2023
- 2023REMAST: Real-time Emotion-based Music Arrangement with Soft Transition14 May 2023
- 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challenges10 Jan 2023
- 2022Generating music with sentiment using Transformer-GANs21 Dec 2022
- 2022YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotations14 Nov 2022
- 2022Controlling Perceived Emotion in Symbolic Music Generation with Monte Carlo Tree Search10 Aug 2022
- 2022Symbolic music generation conditioned on continuous-valued emotions30 Mar 2022
- 2022FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control26 Jan 2022
- 2022A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognition15 Jan 2022
- 2021Music Sentiment Transfer12 Oct 2021
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Framework27 Apr 2021
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
- 2022Symbolic music generation conditioned on continuous-valued emotionscited by 13
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
- 2022Controlling Perceived Emotion in Symbolic Music Generation with Monte Carlo Tree Searchcited by 11
- 2022Generating music with sentiment using Transformer-GANscited by 11
- 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challengescited by 9
- 2023A Survey of AI Music Generation Tools and Modelscited by 9
- 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performancecited by 9
- 2022YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotationscited by 7
- 2024Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challengescited by 7
- 2025Towards Unified Music Emotion Recognition across Dimensional and Categorical Modelscited by 7
- 2023REMAST: Real-time Emotion-based Music Arrangement with Soft Transitioncited by 5
12 most cited of 27 All 27 (JSON)
- 2025Memo2496: Expert-Annotated Dataset and Dual-view Adaptive Framework for Music Emotion Recognition16 Dec 2025
- 2025Story2MIDI: Emotionally Aligned Music Generation from Text1 Dec 2025
- 2025AImoclips: A Benchmark for Evaluating Emotion Conveyance in Text-to-Music Generation31 Aug 2025
- 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performance30 Jun 2025
- 2025Towards Unified Music Emotion Recognition across Dimensional and Categorical Models6 Feb 2025
- 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text4 Nov 2024
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models17 Oct 2024
- 2024Emotion-driven Piano Music Generation via Two-stage Disentanglement and Functional Representation30 Jul 2024
- 2024Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representation29 Jul 2024
- 2024Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challenges13 Jun 2024
- 2024Emotion Manipulation Through Music -- A Deep Learning Interactive Visual Approach12 Jun 2024
- 2024The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos5 Apr 2024
12 newest of 27 All 27 (JSON)