Co-occurring Associated REtained concepts in Diffusion Unlearning
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Unlearning has emerged as a key technique to mitigate harmful content generation in diffusion models. However, existing methods often remove not only the target concept, but also benign co-occurring concepts. As illustrated in Fig.1, unlearning nudity can unintentionally suppress the concept of person, preventing a model from generating images with person. We define these undesirably suppressed co-occurring concepts that must be preserved CARE (Co-occurring Associated REtained concepts). Then, we introduce the CARE score, a general metric that directly quantifies their preservation across unlearning tasks. With this foundation, we propose ReCARE (Robust erasure for CARE), a framework that explicitly safeguards CARE while erasing only the target concept. ReCARE automatically constructs the CARE-set, a curated vocabulary of benign co-occurring tokens extracted from target images, and leverages this vocabulary during training for stable unlearning. Extensive experiments across various target concepts (Nudity, Van Gogh style, and Tench object) demonstrate that ReCARE achieves overall state-of-the-art performance in balancing robust concept erasure, overall utility, and CARE preservation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 35 of its 45 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
35 of 45 references.
Closest ancestors · 17
Same direction, newest first
- 2025Training-Free Safe Denoisers for Safe Use of Diffusion Models11 Feb
- 2025Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find Them31 Jan
- 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation16 Oct
- 2024STEREO: A Two-Stage Framework for Adversarially Robust Concept Erasing from Text-to-Image Diffusion Models29 Aug
- 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models17 Jul
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
- 2024Espresso: Robust Concept Filtering in Text-to-Image Models30 Apr
- 2024MACE: Mass Concept Erasure in Diffusion Models10 Mar
- 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications26 Dec
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
5 more
- 2023Unified Concept Editing in Diffusion Models25 Aug
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
- 2023Erasing Concepts from Diffusion Models13 Mar
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
- 2022Red-Teaming the Stable Diffusion Safety Filter3 Oct
Other references · 18
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2019Machine Unlearningcited by 1,061
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
- 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 182
6 more
- 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 177
- 2023Circumventing Concept Erasure Methods For Text-to-Image Generative Modelscited by 85
- 2022ComCLIP: Training-Free Compositional Image and Text Matchingcited by 26
- 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Imagescited by 18
- 2025LLM Unlearning Reveals a Stronger-Than-Expected Coreset Effect in Current Benchmarkscited by 12
- 2025UPCORE: Utility-Preserving Coreset Selection for Balanced Unlearningcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026To Erase, or Not to Erase: Robust Training-Free Concept Erasure with Preservation aware Adaptive Ranked Subspace Expansioncited by 3
- 2026PEAK: Precise and Persistent Concept Erasure via k-Sparse Autoencoderscited by 1
- 2026AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogatecited by 0
- 2026Uni-AdaVD: Universal Concept Erasure for Visual Generation via Orthogonal Value Decompositioncited by 0
- 2026PEAK: Precise and Persistent Concept Erasure via k-Sparse Autoencoders11 Aug 2026
- 2026To Erase, or Not to Erase: Robust Training-Free Concept Erasure with Preservation aware Adaptive Ranked Subspace Expansion26 Jul 2026
- 2026Uni-AdaVD: Universal Concept Erasure for Visual Generation via Orthogonal Value Decomposition16 Jul 2026
- 2026AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogate9 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Erasure or Erosion? Evaluating Compositional Degradation in Unlearned Text-To-Image Diffusion Models
- 2024Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustness
- 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models
- 2024Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearning
- 2026You Can't Have It Both Ways: Concept Entanglement Limits Diffusion Model Unlearning
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Models
- 2024Unstable Unlearning: The Hidden Risk of Concept Resurgence in Diffusion Models