Image Can Bring Your Memory Back: A Novel Multi-Modal Guided Attack against Image Generation Model Unlearning
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Recent advances in image generation models (IGMs), particularly diffusion-based architectures such as Stable Diffusion (SD), have markedly enhanced the quality and diversity of AI-generated visual content. However, their generative capability has also raised significant ethical, legal, and societal concerns, including the potential to produce harmful, misleading, or copyright-infringing content. To mitigate these concerns, machine unlearning (MU) emerges as a promising solution by selectively removing undesirable concepts from pretrained models. Nevertheless, the robustness and effectiveness of existing unlearning techniques remain largely unexplored, particularly in the presence of multi-modal adversarial inputs. To bridge this gap, we propose Recall, a novel adversarial framework explicitly designed to compromise the robustness of unlearned IGMs. Unlike existing approaches that predominantly rely on adversarial text prompts, Recall exploits the intrinsic multi-modal conditioning capabilities of diffusion models by efficiently optimizing adversarial image prompts with guidance from a single semantically relevant reference image. Extensive experiments across ten state-of-the-art unlearning methods and diverse tasks show that Recall consistently outperforms existing baselines in terms of adversarial effectiveness, computational efficiency, and semantic fidelity with the original textual prompt. These findings reveal critical vulnerabilities in current unlearning mechanisms and underscore the need for more robust solutions to ensure the safety and reliability of generative models. Code and data are publicly available at textcolorbluehttps://github.com/ryliu68/RECALL.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 48 of its 58 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
48 of 58 references.
Closest ancestors · 23
Same direction, newest first
- 2025When Are Concepts Erased From Diffusion Models?22 May
- 2024DiffZOO: A Purely Query-Based Black-Box Attack for Red-teaming Text-to-Image Generative Model via Zeroth Order Optimization18 Aug
- 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models17 Jul
- 2024Six-CD: Benchmarking Concept Removals for Benign Text-to-image Diffusion Models21 Jun
- 2024ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning29 May
- 2024Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient24 May
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
- 2024Probing Unlearned Diffusion Models: A Transferable Adversarial Attack Perspective30 Apr
- 2024Jailbreaking Prompt Attack: A Controllable Adversarial Attack against Diffusion Models2 Apr
- 2024MACE: Mass Concept Erasure in Diffusion Models10 Mar
- 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications26 Dec
- 2023Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers29 Nov
11 more
- 2023MMA-Diffusion: MultiModal Attack on Diffusion Models29 Nov
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
- 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts12 Sep
- 2023Unified Concept Editing in Diffusion Models25 Aug
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Models23 May
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
- 2023Ablating Concepts in Text-to-Image Diffusion Models23 Mar
- 2023Erasing Concepts from Diffusion Models13 Mar
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
Other references · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2016Improved Techniques for Training GANscited by 2,970
13 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Editing Implicit Assumptions in Text-to-Image Diffusion Modelscited by 130
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2023Circumventing Concept Erasure Methods For Text-to-Image Generative Modelscited by 85
- 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 82
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
- 2024Direct Unlearning Optimization for Robust and Safe Text-to-Image Modelscited by 50
- 2024Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Modelscited by 46
- 2023SCEdit: Efficient and Controllable Image Diffusion Generation via Skip Connection Editingcited by 37
- 2024ART: Automatic Red-teaming for Text-to-Image Models to Protect Benign Userscited by 35
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videoscited by 9
- 2025Rethinking Machine Unlearning in Image Generation Modelscited by 9
- 2024Red-Teaming Text-to-Image Models via In-Context Experience Replay and Semantic-Preserving Prompt Rewritingcited by 1
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarkscited by 7
- 2026SafeRedir: Prompt Embedding Redirection for Robust Unlearning in Image Generation Modelscited by 3
- 2026The Illusion of Forgetting: Attack Unlearned Diffusion via Initial Latent Variable Optimizationcited by 1
- 2026RASteer: Retain-Aware Activation Steering for Concept Erasure in Diffusion Modelscited by 1
- 2026Your Unlearning Gives You Away: Identifying Erased Concepts in Diffusion Modelscited by 1
- 2026ReLAPSe: Reinforcement-Learning-trained Adversarial Prompt Search for Erased concepts in unlearned diffusion modelscited by 0
- 2026REFORGE: Multi-modal Attacks Reveal Vulnerable Concept Unlearning in Image Generation Modelscited by 0
- 2026Concept Score Relearning: A Unified Cross-Architecture Attack on Concept Erasurecited by 0
- 2026Continual Concept Erasure in Diffusion Models by Suppressing Cross-Edit Interferencecited by 0
- 2026When Scene Text Hijacks the Scene: Uncovering, Exploiting, and Mitigating Rendered-Text Semantic Leakage in Image Generation Modelscited by 0
- 2026When Scene Text Hijacks the Scene: Uncovering, Exploiting, and Mitigating Rendered-Text Semantic Leakage in Image Generation Models8 Oct 2026
- 2026Your Unlearning Gives You Away: Identifying Erased Concepts in Diffusion Models4 Oct 2026
- 2026Continual Concept Erasure in Diffusion Models by Suppressing Cross-Edit Interference1 Oct 2026
- 2026RASteer: Retain-Aware Activation Steering for Concept Erasure in Diffusion Models1 Oct 2026
- 2026Concept Score Relearning: A Unified Cross-Architecture Attack on Concept Erasure27 Sep 2026
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks8 Jul 2026
- 2026REFORGE: Multi-modal Attacks Reveal Vulnerable Concept Unlearning in Image Generation Models17 Mar 2026
- 2026ReLAPSe: Reinforcement-Learning-trained Adversarial Prompt Search for Erased concepts in unlearned diffusion models30 Jan 2026
- 2026The Illusion of Forgetting: Attack Unlearned Diffusion via Initial Latent Variable Optimization30 Jan 2026
- 2026SafeRedir: Prompt Embedding Redirection for Robust Unlearning in Image Generation Models13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Memory Self-Regeneration: Uncovering Hidden Knowledge in Unlearned Models
- 2025Prompting Forgetting: Unlearning in GANs via Textual Guidance
- 2024Unstable Unlearning: The Hidden Risk of Concept Resurgence in Diffusion Models
- 2024AdvAnchor: Enhancing Diffusion Model Unlearning with Adversarial Anchors
- 2024Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearning
- 2026Certifying Concept Unlearning in Text-to-Image Diffusion Models
- 2024Unlearning or Concealment? A Critical Analysis and Evaluation Metrics for Unlearning in Diffusion Models
- 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models