mlsanityData to 14 Oct 2026

Towards Efficient Exemplar Based Image Editing with Multimodal VLMs

arXiv 2506.20155 ↗First posted 25 Jun 2025cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-Image Diffusion models have enabled a wide array of image editing applications. However, capturing all types of edits through text alone can be challenging and cumbersome. The ambiguous nature of certain image edits is better expressed through an exemplar pair, i.e., a pair of images depicting an image before and after an edit respectively. In this work, we tackle exemplar-based image editing -- the task of transferring an edit from an exemplar pair to a content image(s), by leveraging pretrained text-to-image diffusion models and multimodal VLMs. Even though our end-to-end pipeline is optimization-free, our experiments demonstrate that it still outperforms baselines on multiple types of edits while being ~4x faster.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 32 of its 40 references that are in the map. First posted on arXiv 25 Jun 2025.

Builds on

32 of 40 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024Visual Style Prompting with Swapping Self-Attention20 Feb
  2. 2023ReVersion: Diffusion-Based Relation Inversion from Images23 Mar
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  4. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Models8 Dec
  5. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  7. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  8. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  9. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  11. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct

Other references · 21

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  11. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  12. 2023Zero-shot Image-to-Image Translationcited by 505
9 more
  1. 2022Diffusion Models already have a Semantic Latent Spacecited by 328
  2. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  3. 2022Visual Prompting via Image Inpaintingcited by 250
  4. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  5. 2017Visual Attribute Transfer through Deep Image Analogycited by 123
  6. 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
  7. 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
  8. 2023Object-aware Inversion and Reassembly for Image Editingcited by 30
  9. 2022Self-Conditioned Generative Adversarial Networks for Image Editingcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024ReEdit: Multimodal Exemplar-Based Image Editing with Diffusion Models
  2. 2025PIXELS: Progressive Image Xemplar-based Editing with Latent Surgery
  3. 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models
  4. 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor
  5. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
  6. 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Models
  7. 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
  8. 2024Diffusion Model-Based Image Editing: A Survey