SAEdit: Token-level control for continuous image editing via Sparse AutoEncoder
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Large-scale text-to-image diffusion models have become the backbone of modern image editing, yet text prompts alone do not offer adequate control over the editing process. Two properties are especially desirable: disentanglement, where changing one attribute does not unintentionally alter others, and continuous control, where the strength of an edit can be smoothly adjusted. We introduce a method for disentangled and continuous editing through token-level manipulation of text embeddings. The edits are applied by manipulating the embeddings along carefully chosen directions, which control the strength of the target attribute. To identify such directions, we employ a Sparse Autoencoder (SAE), whose sparse latent space exposes semantically isolated dimensions. Our method operates directly on text embeddings without modifying the diffusion process, making it model agnostic and broadly applicable to various image synthesis backbones. Experiments show that it enables intuitive and efficient manipulations with continuous control across diverse attributes and domains.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 48 of its 56 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
48 of 56 references.
Closest ancestors · 22
Same direction, newest first
- 2025Image Generation from Contextually-Contradictory Prompts2 Jun
- 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Models17 Apr
- 2025Tight Inversion: Image-Conditioned Inversion for Real Image Editing27 Feb
- 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Models3 Feb
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Space21 Jan
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations14 Oct
- 2024Prompt Sliders for Fine-Grained Control, Editing and Erasing of Concepts in Diffusion Models25 Sep
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
- 2024Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directions25 Mar
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar
- 2023Lightning-Fast Image Inversion and Editing for Text-to-Image Diffusion Models19 Dec
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
10 more
- 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
- 2023LEDITS: Real Image Editing with DDPM Inversion and Semantic Guidance2 Jul
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 26
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Zero-shot Image-to-Image Translationcited by 503
14 more
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2025Learning Multi-Level Features with Matryoshka Sparse Autoencoderscited by 136
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
- 2024BatchTopK Sparse Autoencoderscited by 126
- 2025SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoderscited by 75
- 2025SAEs Are Good for Steering -- If You Select the Right Featurescited by 74
- 2025Steering Large Language Model Activations in Sparse Spacescited by 58
- 2024Interpreting the Weight Space of Customized Diffusion Modelscited by 35
- 2024TexSliders: Diffusion-Based Texture Editing in CLIP Spacecited by 23
- 2025IP-Composer: Semantic Composition of Visual Conceptscited by 14
- 2025Navigating with Annealing Guidance Scale in Diffusion Spacecited by 11
- 2025Temporal Score Analysis for Understanding and Correcting Diffusion Artifactscited by 8
- 2025Concept Steerers: Leveraging K-Sparse Autoencoders for Test-Time Controllable Generationscited by 6
- 2025Follow the Flow: On Information Flow Across Textual Tokens in Text-to-Image Modelscited by 4
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steeringcited by 4
- 2026ELROND: Exploring and decomposing intrinsic capabilities of diffusion modelscited by 2
- 2026PixelSmile: Toward Fine-Grained Facial Expression Editingcited by 0
- 2026TokenDial: Continuous Attribute Control for Text-to-Video Generation in Visual Dial Spacecited by 0
- 2026Thinking in Boxes: 3D Editing in Real Images Made Easycited by 0
- 2026Token-to-Token Alignment of Text Embeddings for Semantic Blendingcited by 0
- 2026Latent-Identity Tuning in Text-to-Image Personalization Modelscited by 0
- 2026Diffusion Image Editing via Asynchronous Token Decodingcited by 0
- 2026Diffusion Image Editing via Asynchronous Token Decoding10 Aug 2026
- 2026Latent-Identity Tuning in Text-to-Image Personalization Models13 Jul 2026
- 2026Token-to-Token Alignment of Text Embeddings for Semantic Blending22 Jun 2026
- 2026Thinking in Boxes: 3D Editing in Real Images Made Easy18 Jun 2026
- 2026TokenDial: Continuous Attribute Control for Text-to-Video Generation in Visual Dial Space29 Mar 2026
- 2026PixelSmile: Toward Fine-Grained Facial Expression Editing26 Mar 2026
- 2026The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steering18 Mar 2026
- 2026ELROND: Exploring and decomposing intrinsic capabilities of diffusion models10 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024Prompt-Softbox-Prompt: A Free-Text Embedding Control for Image Editing
- 2023Forgedit: Text Guided Image Editing via Learning and Forgetting
- 2024Latent Space Disentanglement in Diffusion Transformers Enables Zero-shot Fine-grained Semantic Editing
- 2025S2Edit: Text-Guided Image Editing with Precise Semantic and Spatial Control
- 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance
- 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
- 2024Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models