Semantic Surgery: Zero-Shot Concept Erasure in Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Concept erasure in text-to-image diffusion models is crucial for mitigating harmful content, yet existing methods often compromise generative quality. We introduce Semantic Surgery, a novel training-free, zero-shot framework for concept erasure that operates directly on text embeddings before the diffusion process. It dynamically estimates the presence of target concepts in a prompt and performs a calibrated vector subtraction to neutralize their influence at the source, enhancing both erasure completeness and locality. The framework includes a Co-Occurrence Encoding module for robust multi-concept erasure and a visual feedback loop to address latent concept persistence. As a training-free method, Semantic Surgery adapts dynamically to each prompt, ensuring precise interventions. Extensive experiments on object, explicit content, artistic style, and multi-celebrity erasure tasks show our method significantly outperforms state-of-the-art approaches. We achieve superior completeness and robustness while preserving locality and image quality (e.g., 93.58 H-score in object erasure, reducing explicit content to just 1 instance, and 8.09 H_a in style erasure with no quality degradation). This robustness also allows our framework to function as a built-in threat detection system, offering a practical solution for safer text-to-image generation.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 41 of its 53 references that are in the map. First posted on arXiv 26 Oct 2025.
Builds on
41 of 53 references.
Closest ancestors · 18
Same direction, newest first
- 2024Precise, Fast, and Low-cost Concept Erasure in Value Space: Orthogonal Complement Matters9 Dec
- 2024Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation21 Oct
- 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation16 Oct
- 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models17 Jul
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Model25 May
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
- 2024MACE: Mass Concept Erasure in Diffusion Models10 Mar
- 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications26 Dec
- 2023Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers29 Nov
- 2023MMA-Diffusion: MultiModal Attack on Diffusion Models29 Nov
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
6 more
- 2023Unified Concept Editing in Diffusion Models25 Aug
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
- 2023Ablating Concepts in Text-to-Image Diffusion Models23 Mar
- 2023Erasing Concepts from Diffusion Models13 Mar
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
- 2022Red-Teaming the Stable Diffusion Safety Filter3 Oct
Other references · 23
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
11 more
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
- 2023Function Vectors in Large Language Modelscited by 308
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 245
- 2021Contrastive Learning Inverts the Data Generating Processcited by 221
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
- 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 177
- 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
- 2023Concept Algebra for (Score-Based) Text-Controlled Generative Modelscited by 59
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026To Erase, or Not to Erase: Robust Training-Free Concept Erasure with Preservation aware Adaptive Ranked Subspace Expansioncited by 3
- 2026DTVI: Dual-Stage Textual and Visual Intervention for Safe Text-to-Image Generationcited by 1
- 2026Safe Few-Step Generation via Velocity Editingcited by 1
- 2026BARRIER: Bounded Activation Regions for Robust Information Erasurecited by 0
- 2026SACE: Concept Erasure at the Semantic Singularity in Visual Autoregressive Modelscited by 0
- 2026AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogatecited by 0
- 2026Keep It CALM: Analyzing the Limits of Global Unsafety in Text-to-Image Generationcited by 0
- 2026Compositional Concept Erasure in Text-to-Image Diffusion Models via Hierarchically Grounded Semantic Surgerycited by 0
- 2026Compositional Concept Erasure in Text-to-Image Diffusion Models via Hierarchically Grounded Semantic Surgery5 Oct 2026
- 2026Keep It CALM: Analyzing the Limits of Global Unsafety in Text-to-Image Generation1 Oct 2026
- 2026To Erase, or Not to Erase: Robust Training-Free Concept Erasure with Preservation aware Adaptive Ranked Subspace Expansion26 Jul 2026
- 2026AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogate9 Jul 2026
- 2026Safe Few-Step Generation via Velocity Editing22 Jun 2026
- 2026SACE: Concept Erasure at the Semantic Singularity in Visual Autoregressive Models14 Jun 2026
- 2026BARRIER: Bounded Activation Regions for Robust Information Erasure15 May 2026
- 2026DTVI: Dual-Stage Textual and Visual Intervention for Safe Text-to-Image Generation23 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models
- 2023All but One: Surgical Concept Erasing with Model Preservation in Text-to-Image Diffusion Models
- 2025A Comprehensive Survey on Concept Erasure in Text-to-Image Diffusion Models
- 2026Erasing Thousands of Concepts: Towards Scalable and Practical Concept Erasure for Text-to-Image Diffusion Models
- 2025M-ErasureBench: A Comprehensive Multimodal Evaluation Benchmark for Concept Erasure in Diffusion Models
- 2026Neighbor-Aware Localized Concept Erasure in Text-to-Image Diffusion Models
- 2026Localized Concept Erasure in Text-to-Image Diffusion Models via High-Level Representation Misdirection
- 2025Bi-Erasing: A Bidirectional Framework for Concept Removal in Diffusion Models