Improving Diffusion-Based Image Editing Faithfulness via Guidance and Scheduling
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-guided diffusion models have become essential for high-quality image synthesis, enabling dynamic image editing. In image editing, two crucial aspects are editability, which determines the extent of modification, and faithfulness, which reflects how well unaltered elements are preserved. However, achieving optimal results is challenging because of the inherent trade-off between editability and faithfulness. To address this, we propose Faithfulness Guidance and Scheduling (FGS), which enhances faithfulness with minimal impact on editability. FGS incorporates faithfulness guidance to strengthen the preservation of input image information and introduces a scheduling strategy to resolve misalignment between editability and faithfulness. Experimental results demonstrate that FGS achieves superior faithfulness while maintaining editability. Moreover, its compatibility with various editing methods enables precise, high-quality image edits across diverse tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 37 of its 38 references that are in the map. First posted on arXiv 26 Jun 2025.
Builds on
37 of 38 references.
Closest ancestors · 7
Same direction, newest first
- 2024Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Models17 Mar
- 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing7 Feb
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code2 Oct
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2016Density estimation using Real NVPcited by 2,042
- 2023Consistency Modelscited by 1,822
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
18 more
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2022Perception Prioritized Training of Diffusion Modelscited by 303
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
- 2023Style Aligned Image Generation via Shared Attentioncited by 216
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 113
- 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attentioncited by 59
- 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Modelscited by 53
- 2023Exact Diffusion Inversion via Bi-directional Integration Approximationcited by 44
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
- 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
- 2025Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model
- 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Models