FEC: Three Finetuning-free Methods to Enhance Consistency for Real Image Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-conditional image editing is a very useful task that has recently emerged with immeasurable potential. Most current real image editing methods first need to complete the reconstruction of the image, and then editing is carried out by various methods based on the reconstruction. Most methods use DDIM Inversion for reconstruction, however, DDIM Inversion often fails to guarantee reconstruction performance, i.e., it fails to produce results that preserve the original image content. To address the problem of reconstruction failure, we propose FEC, which consists of three sampling methods, each designed for different editing types and settings. Our three methods of FEC achieve two important goals in image editing task: 1) ensuring successful reconstruction, i.e., sampling to get a generated result that preserves the texture and features of the original real image. 2) these sampling methods can be paired with many editing methods and greatly improve the performance of these editing methods to accomplish various editing tasks. In addition, none of our sampling methods require fine-tuning of the diffusion model or time-consuming training on large-scale datasets. Hence the cost of time as well as the use of computer memory and computation can be significantly reduced.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 29 of its 30 references that are in the map. First posted on arXiv 26 Sep 2023.
Builds on
29 of 30 references.
Closest ancestors · 11
Same direction, newest first
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention17 May
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 18
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
6 more
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2022CLIP-Event: Connecting Text and Images with Event Structurescited by 86
- 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 46
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 3; 2026: 1.
11 papers.
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
- 2025VINCIE: Unlocking In-context Image Editing from Videocited by 17
- 2024LocInv: Localization-aware Inversion for Text-Guided Image Editingcited by 11
- 2025Leveraging Semantic Attribute Binding for Free-Lunch Color Control in Diffusion Modelscited by 7
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generationcited by 5
- 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editingcited by 4
- 2025Attention in Diffusion Model: A Surveycited by 4
- 2026Personalized Image Generation via Human-in-the-loop Bayesian Optimizationcited by 2
- 2023Seal2Real: Prompt Prior Learning on Diffusion Model for Unsupervised Document Seal Data Generation and Realisationcited by 1
- 2026Personalized Image Generation via Human-in-the-loop Bayesian Optimization2 Feb 2026
- 2025VINCIE: Unlocking In-context Image Editing from Video12 Jun 2025
- 2025Attention in Diffusion Model: A Survey1 Apr 2025
- 2025Leveraging Semantic Attribute Binding for Free-Lunch Color Control in Diffusion Models12 Mar 2025
- 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generation21 Nov 2024
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglement9 Jul 2024
- 2024LocInv: Localization-aware Inversion for Text-Guided Image Editing2 May 2024
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb 2024
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization15 Feb 2024
- 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editing7 Jan 2024
- 2023Seal2Real: Prompt Prior Learning on Diffusion Model for Unsupervised Document Seal Data Generation and Realisation1 Oct 2023
Similar, not cited
Close in wording, no citation either way
- 2023Tuning-Free Inversion-Enhanced Control for Consistent Image Editing
- 2024Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editing
- 2025Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Models
- 2023Inversion-Free Image Editing with Natural Language
- 2026Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
- 2024Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing
- 2025Tight Inversion: Image-Conditioned Inversion for Real Image Editing