mlsanityData to 14 Oct 2026

RPPNet: Perceptually-Grouped Rhythm-Pitch Primitives for Long-Term Structure Melody Generation via Boundary-Aware Modeling

arXiv 2607.19776 ↗First posted 22 Jul 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing symbolic music generation models typically use bars as the basic structural unit. However, human perception of musical phrases often does not align with notated bar lines, leading to long-term structural fragmentation. This paper proposes RPPNet-a two-stage deep learning architecture with variable structural boundaries. It first generates variable-length Rhythm-Pitch Primitive (RPP) sequences, where each RPP encodes note count, rhythm, and contour; then decodes the RPP sequences into concrete notes. The grouping of RPPs is automatically derived from acoustic cues, auditory inertia, and similarity perception based on music psychology. Experiments show that melodies generated by RPPNet are superior in both long-term structure and musicality, with significant improvements across all subjective evaluation dimensions. Ablation studies confirm that the performance gain stems from the structural correctness of the psychological representation, rather than from model capacity. This work offers an interdisciplinary perspective for music generation, integrating music theory, computational modeling, and music psychology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

27 of 51 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  3. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  4. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  5. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
  6. 2018Music Transformercited by 211
  7. 2016A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialoguescited by 174
  8. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 110
  9. 2021MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Trainingcited by 89
  10. 2017MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generationcited by 72
  11. 2020PopMAG: Pop Music Accompaniment Generationcited by 68
  12. 2020The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measurescited by 53
15 more
  1. 2022Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generationcited by 49
  2. 2021Theme Transformer: Symbolic Music Generation with Theme-Conditioned Transformercited by 40
  3. 2024Foundation Models for Music: A Surveycited by 37
  4. 2021Controllable deep melody generation via hierarchical music structure representationcited by 30
  5. 2023miditok: A Python package for MIDI file tokenizationcited by 27
  6. 2017Music Generation by Deep Learning - Challenges and Directionscited by 24
  7. 2023Byte Pair Encoding for Symbolic Musiccited by 19
  8. 2021MELONS: generating melody with long-term structure using transformers and structure graphcited by 18
  9. 2024WavCraft: Audio Editing and Generation with Large Language Modelscited by 14
  10. 2016Song From PI: A Musically Plausible Network for Pop Music Generationcited by 13
  11. 2021Structure-Enhanced Pop Music Generation via Harmony-Aware Learningcited by 11
  12. 2023MelodyGLM: Multi-task Pre-training for Symbolic Melody Generationcited by 10
  13. 2025Survey on the Evaluation of Generative Models in Musiccited by 10
  14. 2022The Power of Fragmentation: A Hierarchical Transformer Model for Structural Segmentation in Symbolic Music Generationcited by 5
  15. 2025PhraseVAE and PhraseLDM: Latent Diffusion for Full-Song Multitrack Symbolic Music Generationcited by 2

Built on by

Not cited yet.