Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription
Not on the map. Why?
Abstract (arXiv)
Expressive performance rendering (EPR) and automatic piano transcription (APT) are fundamental yet inverse tasks in music information retrieval: EPR generates expressive performances from symbolic scores, while APT recovers scores from performances. Despite their dual nature, prior work has addressed them independently. In this paper we propose a unified framework that jointly models EPR and APT by disentangling note-level score content and global performance style representations from both paired and unpaired data. Our framework is built on a transformer-based sequence-to-sequence architecture and is trained using only sequence-aligned data, without requiring fine-grained note-level alignment. To automate the rendering process while ensuring stylistic compatibility with the score, we introduce an independent diffusion-based performance style recommendation module that generates style embeddings directly from score content. This modular component supports both style transfer and flexible rendering across a range of expressive styles. Experimental results from both objective and subjective evaluations demonstrate that our framework achieves competitive performance on EPR and APT tasks, while enabling effective content-style disentanglement, reliable style transfer, and stylistically appropriate rendering. Demos are available at https://jointpianist.github.io/epr-apt/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 69 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
38 of 69 references.
References · 38
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2020GLU Variants Improve Transformercited by 1,804
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
- 2022Disentangled Representation Learningcited by 112
- 2017Onsets and Frames: Dual-Objective Piano Transcriptioncited by 94
26 more
- 2018Learning Disentangled Joint Continuous and Discrete Representationscited by 83
- 2020High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Timescited by 61
- 2019Generating Sentences from Disentangled Syntactic and Semantic Spacescited by 59
- 2023Posterior Collapse and Latent Variable Non-identifiabilitycited by 57
- 2020Improving Disentangled Text Representation Learning with Information-Theoretic Guidancecited by 52
- 2021Sequence-to-Sequence Piano Transcription with Transformerscited by 48
- 2020Music FaderNets: Controllable Music Generation Based On High-Level Features via Low-Level Feature Modellingcited by 45
- 2019Almost Unsupervised Text to Speech and Automatic Speech Recognitioncited by 41
- 2020Learning Interpretable Representation for Controllable Polyphonic Music Generationcited by 40
- 2019Deep Music Analogy Via Latent Representation Disentanglementcited by 31
- 2023miditok: A Python package for MIDI file tokenizationcited by 27
- 2023Automatic Piano Transcription with Hierarchical Frequency-Time Transformercited by 22
- 2022Partitura: A Python Package for Symbolic Music Processingcited by 16
- 2019Adversarial Learning for Improved Onsets and Frames Music Transcriptioncited by 13
- 2019A holistic approach to polyphonic music transcription with neural networkscited by 11
- 2020Non-Local Musical Statistics as Guides for Audio-to-Score Piano Transcriptioncited by 11
- 2024DExter: Learning and Controlling Performance Expression with Diffusion Modelscited by 11
- 2023Structured Multi-Track Accompaniment Arrangement via Style Prior Modellingcited by 9
- 2024End-to-end Piano Performance-MIDI to Score Conversion with Transformerscited by 9
- 2020Improving Robustness and Generality of NLP Models Using Disentangled Representationscited by 8
- 2021Score Transformer: Generating Musical Score from Note-level Representationcited by 7
- 2023Reconstructing Human Expressiveness in Piano Performances with a Transformer Networkcited by 7
- 2024End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decodingcited by 5
- 2022Sketching the Expression: Flexible Rendering of Expressive Piano Performance with Self-Supervised Learningcited by 4
- 2023The ACCompanion: Combining Reactivity, Robustness, and Musical Expressivity in an Automatic Piano Accompanistcited by 4
- 2022Towards Disentangled Speech Representationscited by 2
Built on by
Not cited yet.