mlsanityData to 14 Oct 2026

Let the Model Learn to Feel: Mode-Guided Tonality Injection for Symbolic Music Emotion Recognition

arXiv 2512.17946 ↗First posted 15 Dec 2025cs.SD cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Music emotion recognition is a key task in symbolic music understanding (SMER). Recent approaches have shown promising results by fine-tuning large-scale pre-trained models (e.g., MIDIBERT, a benchmark in symbolic music understanding) to map musical semantics to emotional labels. While these models effectively capture distributional musical semantics, they often overlook tonal structures, particularly musical modes, which play a critical role in emotional perception according to music psychology. In this paper, we investigate the representational capacity of MIDIBERT and identify its limitations in capturing mode-emotion associations. To address this issue, we propose a Mode-Guided Enhancement (MoGE) strategy that incorporates psychological insights on mode into the model. Specifically, we first conduct a mode augmentation analysis, which reveals that MIDIBERT fails to effectively encode emotion-mode correlations. We then identify the least emotion-relevant layer within MIDIBERT and introduce a Mode-guided Feature-wise linear modulation injection (MoFi) framework to inject explicit mode features, thereby enhancing the model's capability in emotional representation and inference. Extensive experiments on the EMOPIA and VGMIDI datasets demonstrate that our mode injection strategy significantly improves SMER performance, achieving accuracies of 75.2% and 59.1%, respectively. These results validate the effectiveness of mode-guided modeling in symbolic music emotion recognition.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

16 of 34 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  4. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
  5. 2020A Primer in BERTology: What we know about how BERT workscited by 815
  6. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  7. 2018Music Transformercited by 211
  8. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 110
  9. 2021MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Trainingcited by 89
  10. 2020PopMAG: Pop Music Accompaniment Generationcited by 68
  11. 2020High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Timescited by 61
  12. 2020Computer-Generated Music for Tabletop Role-Playing Gamescited by 23
4 more
  1. 2019A Convolutional Approach to Melody Line Identification in Symbolic Scorescited by 6
  2. 2023N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understandingcited by 5
  3. 2022A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognitioncited by 3
  4. 2024Think out Loud: Emotion Deducing Explanation in Dialoguescited by 1

Built on by

Not cited yet.