mlsanityData to 14 Oct 2026

MusRec: Zero-Shot Text-to-Music Editing via Rectified Flow and Diffusion Transformers

arXiv 2511.04376 ↗First posted 6 Nov 2025cs.SD cs.AI cs.LGcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Music editing has emerged as an important and practical area of artificial intelligence, with applications ranging from video game and film music production to personalizing existing tracks according to user preferences. However, existing models face significant limitations, such as being restricted to editing synthesized music generated by their own models, requiring highly precise prompts, or necessitating task-specific retraining, thus lacking true zero-shot capability. leveraging recent advances in rectified flow and diffusion transformers, we introduce MusRec, a zero-shot text-to-music editing model capable of performing diverse editing tasks on real-world music efficiently and effectively. Experimental results demonstrate that our approach outperforms existing methods in preserving musical content, structural consistency, and editing fidelity, establishing a strong foundation for controllable music editing in real-world scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 54 of its 60 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

54 of 60 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025MusFlow: Multimodal Music Generation via Conditional Flow Matching18 Apr
  2. 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion3 Mar
  3. 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation28 Feb
  4. 2025Diffusion based Text-to-Music Generation with Global and Local Text based Conditioning24 Jan
  5. 2024FLUX that Plays Music1 Sep
  6. 2024High Fidelity Text-Guided Music Editing via Single-Stage Flow Matching4 Jul
  7. 2024A Diffusion-Based Generative Equalizer for Music Restoration27 Mar
  8. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion15 Feb
  9. 2024MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models9 Feb
  10. 2024DITTO: Diffusion Inference-Time T-Optimization for Music Generation22 Jan
  11. 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation2 Jan
  12. 2023Mustango: Toward Controllable Text-to-Music Generation14 Nov
7 more
  1. 2023InstructME: An Instruction Guided Music Edit And Remix Framework with Latent Diffusion Models28 Aug
  2. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
  3. 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies3 Aug
  4. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model24 Apr
  5. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models3 Apr
  6. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Models8 Feb
  7. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan

Other references · 35

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  10. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  11. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  12. 2023Simple and Controllable Music Generationcited by 488
23 more
  1. 2023MusicLM: Generating Music From Textcited by 448
  2. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  3. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
  4. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  5. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 174
  6. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  7. 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 132
  8. 2024Improving the Training of Rectified Flowscited by 108
  9. 2023Music ControlNet: Multiple Time-varying Controls for Music Generationcited by 83
  10. 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
  11. 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 68
  12. 2023MuseCoco: Generating Symbolic Music from Textcited by 52
  13. 2024Text-to-Image Rectified Flow as Plug-and-Play Priorscited by 38
  14. 2023M2UGen: Multi-modal Music Understanding and Generation with the Power of Large Language Modelscited by 24
  15. 2021AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfercited by 22
  16. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Modelscited by 19
  17. 2023Content-based Controls For Music Large Language Modelingcited by 19
  18. 2024Audio Prompt Adapter: Unleashing Music Editing Abilities for Text-to-Music with Lightweight Finetuningcited by 12
  19. 2025MusicGen-Stem: Multi-stem music generation and edition through autoregressive modelingcited by 12
  20. 2025Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flowcited by 10
  21. 2025SteerMusic: Enhanced Musical Consistency for Zero-shot Text-guided and Personalized Music Editingcited by 7
  22. 2024Efficient Parallel Audio Generation using Group Masked Language Modelingcited by 5
  23. 2024A Manifold Representation of the Key in Vision Transformerscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FlowSonic: Stable Zero-Shot Music Editing via High-Order Trajectory Integration
  2. 2024Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer
  3. 2024MEDIC: Zero-shot Music Editing with Disentangled Inversion Control
  4. 2025Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models
  5. 2025MusicWeaver: Programmable Long-Form Music Generation with Provably Local Editing ↗
  6. 2025Melodia: Training-Free Music Editing Guided by Attention Probing in Diffusion Models
  7. 2024Improving Controllability and Editability for Pretrained Text-to-Music Generation Models ↗
  8. 2025JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment