mlsanityData to 7 Oct 2026

AttnRouter: Per-Category Attention Routing for Training-Free Image Editing on MMDiT

arXiv 2605.01480 ↗First posted 2 May 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We study training-free image editing on Qwen-Image-Edit-2511, a 60-block multi-modal diffusion transformer (MMDiT) that concatenates noise and source-image tokens within a single attention stream. We make three contributions. (i) We introduce KVInject, a single-forward attention manipulation that alpha-blends source-half key/value projections into the noise-half within a localized layer/step band. KVInject is simpler than the classical two-pass MasaCtrl recipe and avoids the prompt-mismatch failure mode that disables MasaCtrl on MMDiT (composite score drops 31% versus baseline). (ii) We show that no single attention operation dominates across edit types, motivating AttnRouter, a per-category routing table that dispatches edits to the operation that best preserves source structure for that type. With ground-truth categories the router improves the CLIP-T+DINO-I composite by 6.4% over the editing baseline; an automatic CLIP zero-shot classifier closes 98% of this gap despite only 55% category accuracy. (iii) Through layer-, step-, and alpha-band ablations we localize the editing-effective attention sub-circuit: K/V injection in early denoising steps (S0-7) recovers nearly all of the gain of full-step injection, while injection in early (L0-15) or late (L45-60) layer bands fails to drive editing entirely; alpha in [0.3, 0.5] is a stable sweet spot. We also report negative results that highlight what does not transfer from the UNet folklore: simple K/V rescaling never beats baseline and aggressive variants collapse generation entirely (composite 0.084). We release code, pre-computed routing tables, and a 100-sample stratified subset of ImgEdit-Bench used in all ablations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 26 of its 28 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

26 of 28 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformers20 Feb
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  3. 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
  4. 2023Localizing and Editing Knowledge in Text-to-Image Generative Models20 Oct
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  7. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct

Other references · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  10. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
7 more
  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  3. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  4. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  5. 2023Zero-shot Image-to-Image Translationcited by 503
  6. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  7. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024HeadRouter: A Training-free Image Editing Framework for MM-DiTs by Adaptively Routing Attention Heads
  2. 2025Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editing
  3. 2024Stable Flow: Vital Layers for Training-Free Image Editing
  4. 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing
  5. 2026Masked Generative Transformer Is What You Need for Image Editing
  6. 2025EDiT: Efficient Diffusion Transformers with Linear Compressed Attention
  7. 2025Self-Attention Decomposition For Training Free Diffusion Editing
  8. 2026EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Model