Prompt-to-Prompt: Text-Based Image Editing Via Cross-Attention Mechanisms -- The Research of Hyperparameters and Novel Mechanisms to Enhance Existing Frameworks
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent advances in image editing have shifted from manual pixel manipulation to employing deep learning methods like stable diffusion models, which now leverage cross-attention mechanisms for text-driven control. This transition has simplified the editing process but also introduced variability in results, such as inconsistent hair color changes. Our research aims to enhance the precision and reliability of prompt-to-prompt image editing frameworks by exploring and optimizing hyperparameters. We present a comprehensive study of the "word swap" method, develop an "attention re-weight method" for better adaptability, and propose the "CL P2P" framework to address existing limitations like cycle inconsistency. This work contributes to understanding and improving the interaction between hyperparameter settings and the architectural choices of neural network models, specifically their attention mechanisms, which significantly influence the composition and quality of the generated images.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 4 of its 5 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
4 of 5 references.
Closest ancestors · 2
Same direction, newest first
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
Other references · 2
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Dynamic Prompt Learning: Addressing Cross-Attention Leakage for Text-Based Image Editing
- 2025Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editing
- 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing
- 2024An Item is Worth a Prompt: Versatile Image Editing with Disentangled Control
- 2023Visual Instruction Inversion: Image Editing via Visual Prompting
- 2025LUSD: Localized Update Score Distillation for Text-Guided Image Editing
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement