Emotion-driven Piano Music Generation via Two-stage Disentanglement and Functional Representation
Not on the map. Why?
Abstract (arXiv)
Managing the emotional aspect remains a challenge in automatic music generation. Prior works aim to learn various emotions at once, leading to inadequate modeling. This paper explores the disentanglement of emotions in piano performance generation through a two-stage framework. The first stage focuses on valence modeling of lead sheet, and the second stage addresses arousal modeling by introducing performance-level attributes. To further capture features that shape valence, an aspect less explored by previous approaches, we introduce a novel functional representation of symbolic music. This representation aims to capture the emotional impact of major-minor tonality, as well as the interactions among notes, chords, and key signatures. Objective and subjective experiments validate the effectiveness of our framework in both emotional valence and arousal modeling. We further leverage our framework in a novel application of emotional controls, showing a broad potential in emotion-driven music generation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 30 of its 51 references that are in the map. First posted on arXiv 30 Jul 2024.
Builds on
30 of 51 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2020Rethinking Attention with Performerscited by 1,584
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2018Music Transformercited by 207
- 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 109
- 2020POP909: A Pop-song Dataset for Music Arrangement Generationcited by 83
- 2020A Theoretical Analysis of the Repetition Problem in Text Generationcited by 83
- 2021EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generationcited by 53
- 2023MuseCoco: Generating Symbolic Music from Textcited by 50
- 2021MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAEcited by 39
18 more
- 2016Music transcription modelling and composition using deep learningcited by 36
- 2021Learning to Generate Music With Sentimentcited by 29
- 2020Music SketchNet: Controllable Music Generation via Factorized Representations of Pitch and Rhythmcited by 28
- 2020Computer-Generated Music for Tabletop Role-Playing Gamescited by 23
- 2022Melody transcription via generative pre-trainingcited by 23
- 2020Automatic Melody Harmonization with Triad Chords: A Comparative Studycited by 19
- 2022Compose & Embellish: Well-Structured Piano Performance Generation via A Two-Stage Approachcited by 17
- 2022Controlling Perceived Emotion in Symbolic Music Generation with Monte Carlo Tree Searchcited by 11
- 2022Generating music with sentiment using Transformer-GANscited by 11
- 2018A data-driven approach to mid-level perceptual musical feature modelingcited by 8
- 2022YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotationscited by 7
- 2023Roman Numeral Analysis with Graph Neural Networks: Onset-wise Predictions from Note-wise Featurescited by 7
- 2021On Perceived Emotion in Expressive Piano Performance: Further Experimental Evidence for the Relevance of Mid-level Perceptual Featurescited by 4
- 2023EmoGen: Eliminating Subjective Bias in Emotional Music Generationcited by 4
- 2024MoodLoopGP: Generating Emotion-Conditioned Loop Tablature Music with Multi-Granular Featurescited by 4
- 2024Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representationcited by 4
- 2023An Comparative Analysis of Different Pitch and Metrical Grid Encoding Methods in the Task of Sequential Music Generationcited by 2
- 2023MusER: Musical Element-Based Regularization for Generating Symbolic Music with Emotioncited by 2
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025Time-Shifted Token Scheduling for Symbolic Music Generationcited by 2
- 2025From Generality to Mastery: Composer-Style Symbolic Music Generation via Large-Scale Pre-trainingcited by 1
- 2025MuseTok: Symbolic Music Tokenization for Generation and Semantic Understandingcited by 1
- 2025AImoclips: A Benchmark for Evaluating Emotion Conveyance in Text-to-Music Generationcited by 0
- 2025MuseTok: Symbolic Music Tokenization for Generation and Semantic Understanding18 Oct 2025
- 2025Time-Shifted Token Scheduling for Symbolic Music Generation28 Sep 2025
- 2025AImoclips: A Benchmark for Evaluating Emotion Conveyance in Text-to-Music Generation31 Aug 2025
- 2025From Generality to Mastery: Composer-Style Symbolic Music Generation via Large-Scale Pre-training20 Jun 2025