mlsanityData to 14 Oct 2026

CPR: Combining global composing, local performing and full-sequence refining in piano rendering with continuous autoregressive modelling

arXiv 2609.18216 ↗First posted 16 Sep 2026cs.SD cs.AIcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Prompt-conditioned piano MIDI-to-Music rendering aims to faithfully render target notes while reproducing the timbre of a reference recording. Existing approaches primarily follow two paradigms: autoregressive (AR) modeling and flow matching (or diffusion). Discrete-codec AR models provide causal temporal modeling, but quantization can discard acoustic detail. Flow matching better preserves acoustic structure in the cost of full-sequence attention costs and worse semantic structure. Continuous autoregressive models operate directly on continuous representations. It not only combines the condition-following ability of AR models and distribution-modeling capacity of flow matching but also bypasses the quantization bottleneck with lower computational costs. Building on this principle, we present Composer--Performer--Refiner (CPR) framework. Composer autoregressively predicts continuous hidden states, Performer generates 24kHz acoustic latents through local flow matching and Refiner then upsamples the waveform to 48 kHz. We further introduce Bottlenecked Representation Alignment (BREPA) and Modality--Time RoPE (MT-RoPE) to strengthen musical semantic structure in Composer hidden states and temporal alignments across modalities. Codes are available at https://github.com/FEAfeatherTHER/CPR_official

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 29 of its 32 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

29 of 32 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidance13 Jul
  2. 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation6 Feb
  3. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
  4. 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesis8 Jun

Other references · 25

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  8. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  9. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  10. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  11. 2023Simple and Controllable Music Generationcited by 488
  12. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
13 more
  1. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 225
  2. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 217
  3. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
  4. 2026Qwen3-TTS Technical Reportcited by 118
  5. 2019Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantitycited by 86
  6. 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 68
  7. 2025MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encodercited by 48
  8. 2026Making Reconstruction FID Predictive of Diffusion Generation FIDcited by 13
  9. 2025MIDI-VALLE: Improving Expressive Piano Performance Synthesis Through Neural Codec Language Modellingcited by 8
  10. 2021Use of speaker recognition approaches for learning and evaluating embedding representations of musical instrument soundscited by 5
  11. 2026FireRedTTS3: Unified Speech Generation and Editing with Semantically Enriched Speech Representationscited by 3
  12. 2026MuScriptor: An Open Model for Multi-Instrument Music Transcriptioncited by 2
  13. 2026P-MUSE: Prompt-MIDI-Optional Model for Unified Instrumental Music Synthesis and Editingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PianoKontext: Expressive Performance Rendering from Deadpan Context
  2. 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performance
  3. 2026PianoFlow: Music-Aware Streaming Piano Motion Generation with Bimanual Coordination
  4. 2024Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting
  5. 2026Generative Modeling of Bach-Style Symbolic Music: A Comparative Study of Autoregressive, Latent-Variable, and Adversarial Approaches
  6. 2026Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning
  7. 2026Research on Piano Timbre Transformation System Based on Diffusion Model
  8. 2026High-Fidelity Song Generation with Joint Discrete and Continuous Modeling ↗