The Curious Case of End Token: A Zero-Shot Disentangled Image Editing using CLIP
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models have become prominent in creating high-quality images. However, unlike GAN models celebrated for their ability to edit images in a disentangled manner, diffusion-based text-to-image models struggle to achieve the same level of precise attribute manipulation without compromising image coherence. In this paper, CLIP which is often used in popular text-to-image diffusion models such as Stable Diffusion is capable of performing disentangled editing in a zero-shot manner. Through both qualitative and quantitative comparisons with state-of-the-art editing methods, we show that our approach yields competitive results. This insight may open opportunities for applying this method to various tasks, including image and video editing, providing a lightweight and efficient approach for disentangled editing.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 16 of its 20 references that are in the map. First posted on arXiv 1 Jun 2024.
Builds on
16 of 20 references.
Closest ancestors · 8
Same direction, newest first
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
- 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models16 Dec
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image17 Oct
- 2022Compositional Visual Generation with Composable Diffusion Models3 Jun
Other references · 8
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2021GAN Inversion: A Surveycited by 366
- 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
Built on by
Citing papers per year: 2024: 2; 2025: 2.
4 papers.
- 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformerscited by 25
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priorscited by 19
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12
- 2025Dynamic View Synthesis as an Inverse Problemcited by 12
- 2025Dynamic View Synthesis as an Inverse Problem9 Jun 2025
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers29 May 2025
- 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformers12 Dec 2024
- 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors5 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2025Structure-Preserving Zero-Shot Image Editing via Stage-Wise Latent Injection in Diffusion Models
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation
- 2024An Item is Worth a Prompt: Versatile Image Editing with Disentangled Control
- 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance
- 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing
- 2024PixLens: A Novel Framework for Disentangled Evaluation in Diffusion-Based Image Editing with Object Detection + SAM
- 2024TurboEdit: Instant text-based image editing