When Text-to-Image Helps Editing: The Effects of Conditioning During Denoising
Not on the map. Why?
Abstract (arXiv)
Unified models are trained for both instruction-based image editing and text-to-image (T2I) generation, but standard editing pipelines keep source-image conditioning throughout denoising. We ask whether editing can benefit from T2I, and study how the effects of conditioning vary across edits and denoising stages. In pure editing, source attention declines for some edits over the sampling trajectory. This observation led us to task switching, which lets the model draw on its T2I capabilities. Across three unified editors and four benchmarks, switching to the T2I task for bounded intervals improves edit quality, while mean perceptual preservation remains close to pure editing across all three models. Unified editors therefore benefit from using both conditioning modes they are trained for, and the timing of the switch sets the balance between quality and preservation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
16 of 25 references.
References · 16
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
- 2025GIE-Bench: Towards Grounded Evaluation for Text-Guided Image Editingcited by 19
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editorcited by 17
4 more
- 2025Group Relative Attention Guidance for Image Editingcited by 8
- 2025Temporal Concept Dynamics in Diffusion Models via Prompt-Conditioned Interventionscited by 7
- 2025Scale Your Instructions: Enhance the Instruction-Following Fidelity of Unified Image Generation Model by Self-Adaptive Attention Scalingcited by 4
- 2026DuET: Dual Expert Trajectories for Diffusion Image Editingcited by 1
Built on by
Not cited yet.