mlsanityData to 7 Oct 2026

AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editing

arXiv 2605.31053 ↗First posted 29 May 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Controllable music editing is to modify high-level attributes while strictly preserving rhythmic and melodic structures. However, this task is challenged by a semantic-structural entanglement: steering methods often degrade structure to achieve editing performance, while structural adaptors suppress semantic responsiveness. We propose AnchorSteer, a framework that disentangles this tension by coupling structural anchoring with self-discovered semantic steering. The proposed approach probes internal representations to extract interpretable, label-free concept vectors via a self-supervised reconstruction objective, isolating attributes without curated data. During editing, these portable, plug-and-play concept vectors are injected into diffusion hidden manifolds while a structural adaptor enforces consistency. Variants for unconditioned and conditioned injections are provided to balance robustness and semantic strength. Experiments on ZoME-Bench and subjective tests show that the proposed framework outperforms both steering-only and anchoring-only baselines, enabling significant semantic transformations with high-fidelity structural preservation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

26 of 39 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  9. 2013Auto-Encoding Variational Bayescited by 3,980
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  12. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
14 more
  1. 2023Simple and Controllable Music Generationcited by 480
  2. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  3. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  4. 2022Masked Autoencoders that Listencited by 271
  5. 2021Taming Visually Guided Sound Generationcited by 136
  6. 2023Music ControlNet: Multiple Time-varying Controls for Music Generationcited by 82
  7. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
  8. 2019Deep Music Analogy Via Latent Representation Disentanglementcited by 31
  9. 2024Audio Prompt Adapter: Unleashing Music Editing Abilities for Text-to-Music with Lightweight Finetuningcited by 12
  10. 2023Audio Editing with Non-Rigid Text Promptscited by 8
  11. 2024MEDIC: Zero-shot Music Editing with Disentangled Inversion Controlcited by 8
  12. 2021Is Disentanglement enough? On Latent Representations for Controllable Music Generationcited by 7
  13. 2025Melodia: Training-Free Music Editing Guided by Attention Probing in Diffusion Modelscited by 3
  14. 2025Pianist Transformer: Towards Expressive Piano Performance Rendering via Scalable Self-Supervised Pre-Trainingcited by 2

Built on by

Not cited yet.