Research on Piano Timbre Transformation System Based on Diffusion Model
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
We propose a timbre conversion model based on the Diffusion architecture de-signed to precisely translate music played by various instruments into piano ver-sions. The model employs a Pitch Encoder and Loudness Encoder to extract pitch and loudness features of the music, which serve as conditional inputs to the Dif-fusion Model's decoder, generating high-quality piano timbres. Case analysis re-sults show that the model performs excellently in terms of pitch accuracy and timbral similarity, maintaining stable conversion across different musical styles (classical, jazz, pop) and lengths (from short clips to full pieces). Particularly, the model maintains high sound quality and accuracy even when dealing with rapidly changing notes and complex musical structures, demonstrating good generaliza-tion capability. Additionally, the model has the potential for real-time musical conversion and is suitable for live performances and digital music creation tools. Future research will focus on enhancing the handling of loudness dynamics and incorporating additional musical features (such as timbral variations and rhythmic complexity) to improve the model's adaptability and expressiveness. We plan to explore the model's application potential in other timbre conversion tasks, such as converting vocals to instrumental sounds or integration with MIDI digital pianos, further expanding the application scope of the Diffusion-based timbre conversion model in the field of music generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 3 of its 12 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
3 of 12 references.
Closest ancestors · 1
Same direction, newest first
Other references · 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024WaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusion
- 2023Timbre transfer using image-to-image denoising diffusion implicit models
- 2025Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models
- 2025Generation of Musical Timbres using a Text-Guided Diffusion Model
- 2026Diffusion Timbre Transfer Via Mutual Information Guided Inpainting
- 2026Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
- 2023DiffuseRoll: Multi-track multi-category music generation based on diffusion model
- 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer