PianoKontext: Expressive Performance Rendering from Deadpan Context
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Expressive performance rendering (EPR) aims to generate realistic performances constrained on sequences of notes. However, flow matching audio editing models manipulate only synchronized music samples of the same duration, limiting their understanding of expressive timing. We introduce PianoKontext, a flow matching rendering model for classical piano music that generates variable-length performances in the latent space of a pretrained Music2Latent model. We synthesize MIDI scores into deadpan audio and employ Dynamic Time Warping (DTW) in the latent space to construct paired data for training. The aligned embeddings are concatenated in DiT blocks, allowing for a simple and effective learning of the dependencies between the score and performances. Audio samples are available at our demo page: https://realfolkcode.github.io/pianokontext_demo/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 24 of its 28 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
24 of 28 references.
Closest ancestors · 3
Same direction, newest first
- 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer9 Sep
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compression12 Aug
- 2023Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls19 Jul
Other references · 21
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2023Simple and Controllable Music Generationcited by 480
- 2024Flow Matching Guide and Codecited by 291
- 2024Rotary Position Embedding for Vision Transformercited by 226
- 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
- 2024Stable Audio Opencited by 192
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
9 more
- 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
- 2023miditok: A Python package for MIDI file tokenizationcited by 26
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
- 2024Scoring Time Intervals using Non-Hierarchical Transformer For Automatic Piano Transcriptioncited by 14
- 2023Online Symbolic Music Alignment with Offline Reinforcement Learningcited by 5
- 2025RenderBox: Expressive Performance Rendering with Text Controlcited by 4
- 2026Diffusion Timbre Transfer Via Mutual Information Guided Inpaintingcited by 3
- 2025GuitarFlow: Realistic Electric Guitar Synthesis From Tablatures via Flow Matching and Style Transfercited by 1
- 2026PianoCoRe: Combined and Refined Piano MIDI Datasetcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CPR: Combining global composing, local performing and full-sequence refining in piano rendering with continuous autoregressive modelling
- 2026PianoFlow: Music-Aware Streaming Piano Motion Generation with Bimanual Coordination
- 2025SyMuPe: Affective and Controllable Symbolic Music Performance
- 2025FlowSynth: Instrument Generation Through Distributional Flow Matching and Test-Time Search
- 2024DExter: Learning and Controlling Performance Expression with Diffusion Models
- 2026MIDI-RAE-JEPA: Hierarchical Representation Learning and Generation for Symbolic Music
- 2024Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting
- 2026Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning