Attention-Scoped Guidance: Training-Free Spatial Control for Image Editing
Not on the map. Why?
Abstract (arXiv)
Instruction-guided image editing should change what the instruction names and leave the rest of the image untouched. In dual classifier-free guidance (CFG), an editor combines two directions at every denoising step, one that pushes toward the instructed edit and one that pulls back toward the source image, using global weights. We introduce Attention-Scoped Guidance (ASG), a sampler wrapper that makes these weights spatial. It reads a soft support map from the instruction attention that the editor already computes, then weakens text guidance where support is low and strengthens image anchoring where support is high. The wrapper requires no training, no external mask, and no additional network evaluation. On the full MagicBrush and PIE-Bench++ splits, ASG improves preservation-oriented metrics, leading three of four MagicBrush metrics and PIE-Bench++ background PSNR. A dose-matched control that removes the spatial placement loses up to 0.73 CLIP on PIE-Bench++, confirming that the spatial allocation itself carries the gain.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 24 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
21 of 24 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2022Blended Latent Diffusioncited by 432
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
- 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
9 more
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 62
- 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 62
- 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidancecited by 59
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 54
- 2023LIME: Localized Image Editing via Attention Regularization in Diffusion Modelscited by 27
- 2025Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editingcited by 18
- 2025Instruct-CLIP: Improving Instruction-Guided Image Editing with Automated Data Refinement Using Contrastive Learningcited by 9
- 2025Draw-In-Mind: Rebalancing Designer-Painter Roles in Unified Multimodal Models Benefits Image Editingcited by 4
Built on by
Not cited yet.