Image Editing with Diffusion Models: A Survey
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
With deeper exploration of diffusion model, developments in the field of image generation have triggered a boom in image creation. As the quality of base-model generated images continues to improve, so does the demand for further application like image editing. In recent years, many remarkable works are realizing a wide variety of editing effects. However, the wide variety of editing types and diverse editing approaches have made it difficult for researchers to establish a comprehensive view of the development of this field. In this survey, we summarize the image editing field from four aspects: tasks definition, methods classification, results evaluation and editing datasets. First, we provide a definition of image editing, which in turn leads to a variety of editing task forms from the perspective of operation parts and manipulation actions. Subsequently, we categorize and summary methods for implementing editing into three categories: inversion-based, fine-tuning-based and adapter-based. In addition, we organize the currently used metrics, available datasets and corresponding construction methods. At the end, we present some visions for the future development of the image editing field based on the previous summaries.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 123 of its 157 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
123 of 157 references.
Closest ancestors · 27
Same direction, newest first
- 2025Consistent Image Layout Editing with Diffusion Models9 Mar
- 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing28 Feb
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision11 Nov
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedback11 Apr
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey7 Mar
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb
- 2023Learning to Follow Object-Centric Image Editing Instructions Faithfully29 Oct
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods3 Oct
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
- 2023MoEController: Instruction-based Arbitrary Image Manipulation with Mixture-of-Expert Controllers8 Sep
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
15 more
- 2023Differential Diffusion: Giving Each Pixel Its Strength1 Jun
- 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructions29 May
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild18 May
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Blended Latent Diffusion6 Jun
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
- 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct
Other references · 96
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
38 more
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2014Going Deeper with Convolutionscited by 4,241
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2018Demystifying MMD GANscited by 1,293
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
- 2016Pixel Recurrent Neural Networkscited by 816
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2015Holistically-Nested Edge Detectioncited by 592
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
50 most cited of 96 All 96 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025LongCat-Image Technical Reportcited by 100
- 2025Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulationscited by 5
- 2025FlashEdit: Decoupling Speed, Structure, and Semantics for Precise Image Editingcited by 4
- 2026Learning Brain Representation with Hierarchical Visual Embeddingscited by 3
- 2025MENTOR: Efficient Multimodal-Conditioned Tuning for Autoregressive Vision Generation Modelscited by 1
- 2026Forge-and-Quench: Enhancing Image Generation for Higher Fidelity in Unified Multimodal Modelscited by 1
- 2026A Simple Baseline for Unifying Understanding, Generation, and Editing via Vanilla Next-token Predictioncited by 0
- 2026Appearance Pointers -- Multimodal Region Control of Diffusion Transformerscited by 0
- 2026Appearance Pointers -- Multimodal Region Control of Diffusion Transformers21 Jul 2026
- 2026A Simple Baseline for Unifying Understanding, Generation, and Editing via Vanilla Next-token Prediction5 Mar 2026
- 2026Learning Brain Representation with Hierarchical Visual Embeddings7 Feb 2026
- 2026Forge-and-Quench: Enhancing Image Generation for Higher Fidelity in Unified Multimodal Models8 Jan 2026
- 2025LongCat-Image Technical Report8 Dec 2025
- 2025FlashEdit: Decoupling Speed, Structure, and Semantics for Precise Image Editing26 Sep 2025
- 2025MENTOR: Efficient Multimodal-Conditioned Tuning for Autoregressive Vision Generation Models13 Jul 2025
- 2025Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulations1 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models
- 2024Editable Image Elements for Controllable Synthesis
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
- 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing
- 2024Pathways on the Image Manifold: Image Editing via Video Generation
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2023Pix2Video: Video Editing using Image Diffusion
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing