When Does High-CFG Diffusion Inversion Fail? A Controlled Study of Prompt--Latent Interactions
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-guided diffusion inversion is central to image editing, where an image is mapped to an initial latent and then edited by replaying the denoising process under a modified prompt. In practice, however, inversion is often performed with a lower classifier-free guidance(CFG) scale than the one used for generation or editing. This mismatch is empirically useful but leaves a basic question unresolved: when a target image is generated by a high-CFG trajectory, when can that trajectory actually be inverted? We study this question in a controlled generation--inversion--reconstruction setting, where the true initial latent and denoising trajectory are known. Using prompts taken from an existing diffusion-editing benchmark, we generate images under high CFG and reconstruct them with fixed-point inversion using the same prompt and guidance setting. The results reveal three types of prompt-level reconstruction behavior: easy prompts that reconstruct for most initial latents, hard prompts that fail for most initial latents, and intermediate prompts whose success depends on the prompt--latent pairing. To analyze the generation side, we define prompt pressure, a step-wise measure of how strongly CFG moves the denoising update away from the unconditional trajectory. Total pressure correlates with reconstruction quality and separates easy from hard prompts, but it does not explain the success or failure of intermediate prompt--latent pairs. Text-side analyses further show that the main visual subject and wording can change inversion difficulty. Finally, we evaluate a compact trajectory-consistency intervention that relaxes guidance only at locally unstable inverse steps. This diagnostic check improves reconstruction and Prompt-to-Prompt editing in our controlled setting, supporting the view that high-CFG inversion failure requires local, trajectory-aware analysis.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 20 of its 24 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
20 of 24 references.
Closest ancestors · 9
Same direction, newest first
- 2024All Seeds Are Not Equal: Enhancing Compositional Text-to-Image Generation with Reliable Random Seeds27 Nov
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing24 Oct
- 2024ERDDCI: Exact Reversible Diffusion via Dual-Chain Inversion for High-Quality Image Editing18 Oct
- 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps20 Jun
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization6 Apr
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
- 2023Grounded Text-to-Image Synthesis with Attention Refocusing8 Jun
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
Other references · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 138
- 2023On Exact Inversion of DPM-Solverscited by 47
- 2025Feedback Guidance of Diffusion Modelscited by 16
- 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models
- 2026Dual Inversion for Text-to-Image Diffusion Models: From Both Prompt and Noise Perspectives
- 2023Inversion-Free Image Editing with Natural Language
- 2023Prompt-tuning latent diffusion models for inverse problems
- 2025Prompt-Guided Dual Latent Steering for Inversion Problems
- 2026ResetEdit: Precise Text-guided Editing of Generated Image via Resettable Starting Latent
- 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editing