Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformers
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Training-free control over editing intensity is a critical requirement for diffusion-based image editing models built on the Diffusion Transformer (DiT) architecture. Existing attention manipulation methods focus exclusively on the Key space to modulate attention routing, leaving the Value space -- which governs feature aggregation -- entirely unexploited. In this paper, we first reveal that both Key and Value projections in DiT's multi-modal attention layers exhibit a pronounced bias-delta structure, where token embeddings cluster tightly around a layer-specific bias vector. Building on this observation, we propose Dual-Channel Attention Guidance (DCAG), a training-free framework that simultaneously manipulates both the Key channel (controlling where to attend) and the Value channel (controlling what to aggregate). We provide a theoretical analysis showing that the Key channel operates through the nonlinear softmax function, acting as a coarse control knob, while the Value channel operates through linear weighted summation, serving as a fine-grained complement. Together, the two-dimensional parameter space (δk, δv) enables more precise editing-fidelity trade-offs than any single-channel method. Extensive experiments on the PIE-Bench benchmark (700 images, 10 editing categories) demonstrate that DCAG consistently outperforms Key-only guidance across all fidelity metrics, with the most significant improvements observed in localized editing tasks such as object deletion (4.9% LPIPS reduction) and object addition (3.2% LPIPS reduction).
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 32 of its 35 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
32 of 35 references.
Closest ancestors · 6
Same direction, newest first
- 2024Layout Control and Semantic Guidance with Attention Loss Backward for T2I Diffusion Model11 Nov
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
14 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 108
- 2025EditID: Training-Free Editable ID Customization for Text-to-Image Generationcited by 8
- 2025EditIDv2: Editable ID Customization with Data-Lubricated ID Feature Integration for Text-to-Image Generationcited by 8
- 2025Group Relative Attention Guidance for Image Editingcited by 8
- 2024E-Commerce Inpainting with Mask Guidance in Controlnet for Reducing Overcompletioncited by 4
- 2026FlexID: Training-Free Flexible Identity Injection via Intent-Aware Modulation for Text-to-Image Generationcited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026AdaEdit: Adaptive Temporal and Channel Modulation for Flow-Based Image Editingcited by 1
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editingcited by 0
- 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoningcited by 0
- 2026AttnRouter: Per-Category Attention Routing for Training-Free Image Editing on MMDiTcited by 0
- 2026PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splattingcited by 0
- 2026Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editingcited by 0
- 2026Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editing28 Sep 2026
- 2026PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting13 May 2026
- 2026AttnRouter: Per-Category Attention Routing for Training-Free Image Editing on MMDiT2 May 2026
- 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning1 May 2026
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editing19 Apr 2026
- 2026AdaEdit: Adaptive Temporal and Channel Modulation for Flow-Based Image Editing23 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editing
- 2025Disentangling Instruction Influence in Diffusion Transformers for Parallel Multi-Instruction-Guided Image Editing
- 2025Self-Attention Decomposition For Training Free Diffusion Editing
- 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing
- 2024Stable Flow: Vital Layers for Training-Free Image Editing
- 2024HeadRouter: A Training-free Image Editing Framework for MM-DiTs by Adaptively Routing Attention Heads
- 2025EDiT: Efficient Diffusion Transformers with Linear Compressed Attention
- 2025Hierarchical and Step-Layer-Wise Tuning of Attention Specialty for Multi-Instance Synthesis in Diffusion Transformers