mlsanityData to 7 Oct 2026

The Curious Case of End Token: A Zero-Shot Disentangled Image Editing using CLIP

arXiv 2406.00457 ↗First posted 1 Jun 2024cs.CVcited by 4

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models have become prominent in creating high-quality images. However, unlike GAN models celebrated for their ability to edit images in a disentangled manner, diffusion-based text-to-image models struggle to achieve the same level of precise attribute manipulation without compromising image coherence. In this paper, CLIP which is often used in popular text-to-image diffusion models such as Stable Diffusion is capable of performing disentangled editing in a zero-shot manner. Through both qualitative and quantitative comparisons with state-of-the-art editing methods, we show that our approach yields competitive results. This insight may open opportunities for applying this method to various tasks, including image and video editing, providing a lightweight and efficient approach for disentangled editing.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 16 of its 20 references that are in the map. First posted on arXiv 1 Jun 2024.

Builds on

16 of 20 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
  2. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
  3. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  5. 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models16 Dec
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  7. 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image17 Oct
  8. 2022Compositional Visual Generation with Composable Diffusion Models3 Jun

Other references · 8

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  4. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  5. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  6. 2021GAN Inversion: A Surveycited by 366
  7. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  8. 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Structure-Preserving Zero-Shot Image Editing via Stage-Wise Latent Injection in Diffusion Models
  2. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation
  3. 2024An Item is Worth a Prompt: Versatile Image Editing with Disentangled Control
  4. 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
  5. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance
  6. 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing
  7. 2024PixLens: A Novel Framework for Disentangled Evaluation in Diffusion-Based Image Editing with Object Detection + SAM
  8. 2024TurboEdit: Instant text-based image editing