mlsanityData to 7 Oct 2026

Erased but Not Forgotten: How Backdoors Compromise Concept Erasure

arXiv 2504.21072 ↗First posted 29 Apr 2025cs.CR cs.AI cs.LGcited by 9

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

The expansion of text-to-image diffusion models has raised concerns about harmful outputs, from fabricated depictions of public figures to sexually explicit imagery. To mitigate such risks, prior work has proposed concept erasure methods that aim to sever unwanted concepts from the model via fine-tuning, yet it remains unclear whether these approaches truly remove all links to the harmful concept or merely conceal superficial connections. In this work, we reveal a critical vulnerability, the Erasure Evasion Backdoor (EEB): an adversary binds a backdoor trigger to a concept slated for removal, and this malicious link survives subsequent erasure. We show that both black-box and white-box adversaries can instantiate this threat. Across six state-of-the-art erasure methods, including robust ones that explicitly search for alternative representations of the target concept, EEB consistently exposes harmful content: up to 82% success against celebrity-identity unlearning, up to 94% for object erasure, and up to 16 times amplification of explicit-content exposure. While EEB uncovers a blind spot in current erasure methods, it also provides a diagnostic tool for stress-testing future concept erasure techniques. Our code is available at https://github.com/multimodal-ai-lab/EEB.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 79 of its 109 references that are in the map. First posted on arXiv 29 Apr 2025.

Builds on

79 of 109 references.

Closest ancestors · 29

Same direction, newest first

  1. 2025Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find Them31 Jan
  2. 2025ACE: Anti-Editing Concept Erasure in Text-to-Image Models3 Jan
  3. 2024Safeguarding Text-to-Image Generation via Inference-Time Prompt-Noise Optimization5 Dec
  4. 2024Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation21 Oct
  5. 2024Unstable Unlearning: The Hidden Risk of Concept Resurgence in Diffusion Models10 Oct
  6. 2024STEREO: A Two-Stage Framework for Adversarially Robust Concept Erasing from Text-to-Image Diffusion Models29 Aug
  7. 2024Safeguard Text-to-Image Diffusion Models with Human Feedback Inversion17 Jul
  8. 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models17 Jul
  9. 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models5 Jul
  10. 2024Backdooring Bias (B2) into Stable Diffusion Models21 Jun
  11. 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
  12. 2024SafeGen: Mitigating Sexually Explicit Content Generation in Text-to-Image Models10 Apr
17 more
  1. 2024MACE: Mass Concept Erasure in Diffusion Models10 Mar
  2. 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications26 Dec
  3. 2023Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers29 Nov
  4. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
  5. 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts12 Sep
  6. 2023Unified Concept Editing in Diffusion Models25 Aug
  7. 2023Degeneration-Tuning: Using Scrambled Grid shield Unwanted Concepts from Stable Diffusion2 Aug
  8. 2023Towards Safe Self-Distillation of Internet-Scale Text-to-Image Diffusion Models12 Jul
  9. 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models12 Jun
  10. 2023Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Models18 May
  11. 2023Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoning7 May
  12. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
  13. 2023Ablating Concepts in Text-to-Image Diffusion Models23 Mar
  14. 2023Erasing Concepts from Diffusion Models13 Mar
  15. 2022How to Backdoor Diffusion Models?11 Dec
  16. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
  17. 2022Red-Teaming the Stable Diffusion Safety Filter3 Oct

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  11. 2022Scalable Diffusion Models with Transformerscited by 5,931
  12. 2022Classifier-Free Diffusion Guidancecited by 5,717
38 more
  1. 2013Intriguing properties of neural networkscited by 5,114
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2020Knowledge Distillation: A Surveycited by 1,578
  7. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  8. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  9. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  10. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  11. 2021Membership Inference Attacks From First Principlescited by 839
  12. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  13. 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
  14. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
  15. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  16. 2021GFlowNet Foundationscited by 286
  17. 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
  18. 2023Poisoning Language Models During Instruction Tuningcited by 254
  19. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  20. 2020Media Forensics and DeepFakes: an overviewcited by 208
  21. 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 175
  22. 2020Backdoor Attacks Against Deep Learning Systems in the Physical Worldcited by 129
  23. 2023Editing Implicit Assumptions in Text-to-Image Diffusion Modelscited by 128
  24. 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Modelscited by 87
  25. 2023Circumventing Concept Erasure Methods For Text-to-Image Generative Modelscited by 81
  26. 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
  27. 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesiscited by 59
  28. 2024Direct Unlearning Optimization for Robust and Safe Text-to-Image Modelscited by 50
  29. 2023PoisonPrompt: Backdoor Attack on Prompt-based Large Language Modelscited by 40
  30. 2022Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attackscited by 37
  31. 2023BAGM: A Backdoor Attack for Manipulating Text-to-Image Generative Modelscited by 37
  32. 2023Stealthy Backdoor Attack for Code Modelscited by 32
  33. 2022TrojViT: Trojan Insertion in Vision Transformerscited by 30
  34. 2024AlignGuard: Scalable Safety Alignment for Text-to-Image Generationcited by 17
  35. 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 16
  36. 2025Erasing More Than Intended? How Concept Erasure Degrades the Generation of Non-Target Conceptscited by 12
  37. 2023Exploiting Machine Unlearning for Backdoor Attacks in Deep Learning Systemcited by 4
  38. 2025ReVeil: Unconstrained Concealed Backdoor Attack on Deep Neural Networks using Machine Unlearningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustness
  2. 2025Rethinking the Vulnerability of Concept Erasure and a New Method
  3. 2024Probing Unlearned Diffusion Models: A Transferable Adversarial Attack Perspective
  4. 2025M-ErasureBench: A Comprehensive Multimodal Evaluation Benchmark for Concept Erasure in Diffusion Models
  5. 2025A Comprehensive Survey on Concept Erasure in Text-to-Image Diffusion Models
  6. 2025Comprehensive Evaluation and Analysis for NSFW Concept Erasure in Text-to-Image Diffusion Models
  7. 2025Comprehensive Assessment and Analysis for NSFW Content Erasure in Text-to-Image Diffusion Models
  8. 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Models