mlsanityData to 14 Oct 2026

Custom-Edit: Text-Guided Image Editing with Customized Diffusion Models

arXiv 2305.15779 ↗First posted 25 May 2023cs.CVcited by 54

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing interface for users, it often fails to ensure the precise concept conveyed by users. To address this issue, we propose Custom-Edit, in which we (i) customize a diffusion model with a few reference images and then (ii) perform text-guided editing. Our key discovery is that customizing only language-relevant parameters with augmented prompts improves reference similarity significantly while maintaining source similarity. Moreover, we provide our recipe for each customization and editing process. We compare popular customization methods and validate our findings on two editing methods using various datasets.

Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 25 of its 28 references that are in the map. First posted on arXiv 25 May 2023.

Builds on

25 of 28 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
  2. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  4. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
6 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  4. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
  5. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  6. 2021Few-shot Image Generation via Cross-domain Correspondencecited by 207

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 11; 2024: 23; 2025: 16; 2026: 4.

54 papers.

Sort:

By area:

  1. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  2. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
  3. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 83
  4. 2024DITTO: Diffusion Inference-Time T-Optimization for Music Generationcited by 73
  5. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  6. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
  7. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
  8. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  9. 2023MetaCloak: Preventing Unauthorized Subject-driven Text-to-image Diffusion-based Synthesis via Meta-learningcited by 44
  10. 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
  11. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 41
  12. 2023DreamEdit: Subject-driven Image Editingcited by 37
38 more
  1. 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
  2. 2024SubjectDrive: Scaling Generative Data in Autonomous Driving via Subject Controlcited by 32
  3. 2023ControlNet-XS: Rethinking the Control of Text-to-Image Diffusion Models as Feedback-Control Systemscited by 30
  4. 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
  5. 2024BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Modelscited by 29
  6. 2024Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Modelscited by 23
  7. 2024Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Modelscited by 22
  8. 2023IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Modelscited by 21
  9. 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editingcited by 21
  10. 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Compositioncited by 17
  11. 2024MeshUp: Multi-Target Mesh Deformation via Blended Score Distillationcited by 17
  12. 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
  13. 2024SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editingcited by 13
  14. 2024Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesiscited by 13
  15. 2025On the Limitations of Vision-Language Models in Understanding Image Transformscited by 13
  16. 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimagecited by 12
  17. 2023Cross Initialization for Personalized Text-to-Image Generationcited by 10
  18. 2025MedEBench: Diagnosing Reliability in Text-Guided Medical Image Editingcited by 8
  19. 2025SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generationcited by 8
  20. 2024Constrained Posterior Sampling: Time Series Generation with Hard Constraintscited by 7
  21. 2025In-Context Brush: Zero-shot Customized Subject Insertion with Context-Aware Latent Space Manipulationcited by 7
  22. 2023EVE: Efficient zero-shot text-based Video Editing with Depth Map Guidance and Temporal Consistency Constraintscited by 5
  23. 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
  24. 2024DreamSteerer: Enhancing Source Image Conditioned Editability using Personalized Diffusion Modelscited by 5
  25. 2025EditCLIP: Representation Learning for Image Editingcited by 5
  26. 2024DreamBlend: Advancing Personalized Fine-tuning of Text-to-Image Diffusion Modelscited by 4
  27. 2025Exploring the latent space of diffusion models directly through singular value decompositioncited by 3
  28. 2025ConceptSplit: Decoupled Multi-Concept Personalization of Diffusion Models via Token-wise Adaptation and Attention Disentanglementcited by 3
  29. 2026Ctrl&Shift: High-Quality Geometry-Aware Object Manipulation in Visual Generationcited by 3
  30. 2023RealCraft: Attention Control as A Tool for Zero-Shot Consistent Video Editingcited by 2
  31. 2025Personalize Your Gaussian: Consistent 3D Scene Personalization from a Single Imagecited by 2
  32. 2025DreamAudio: Customized Text-to-Audio Generation with Diffusion Modelscited by 2
  33. 2024PersonaCraft: Personalized and Controllable Full-Body Multi-Human Scene Generation Using Occlusion-Aware 3D-Conditioned Diffusioncited by 1
  34. 2025Diffusion Prism: Enhancing Diversity and Morphology Consistency in Mask-to-Image Diffusioncited by 1
  35. 2025Energy-Guided Optimization for Personalized Image Editing with Pretrained Text-to-Image Diffusion Modelscited by 1
  36. 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidancecited by 1
  37. 2025Beyond Invisibility: Learning Robust Visible Watermarks for Stronger Copyright Protectioncited by 0
  38. 2025Per-Query Visual Concept Learningcited by 0

50 most cited of 54 All 54 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
  2. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
  3. 2023User-friendly Image Editing with Minimal Text Input: Leveraging Captioning and Injection Techniques
  4. 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
  5. 2023PRedItOR: Text Guided Image Editing with Diffusion Prior
  6. 2025Personalized Image Editing in Text-to-Image Diffusion Models via Collaborative Direct Preference Optimization
  7. 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models
  8. 2021Blended Diffusion for Text-driven Editing of Natural Images