SafeRedir: Prompt Embedding Redirection for Robust Unlearning in Image Generation Models
On the map: LLM safety and security → Vision-language and text-to-image safety
Abstract (arXiv)
Image generation models (IGMs), while capable of producing impressive and creative content, often memorize a wide range of undesirable concepts from their training data, leading to the reproduction of unsafe content such as NSFW imagery and copyrighted artistic styles. Such behaviors pose persistent safety and compliance risks in real-world deployments and cannot be reliably mitigated by post-hoc filtering, owing to the limited robustness of such mechanisms and a lack of fine-grained semantic control. Recent unlearning methods seek to erase harmful concepts at the model level, which exhibit the limitations of requiring costly retraining, degrading the quality of benign generations, or failing to withstand prompt paraphrasing and adversarial attacks. To address these challenges, we introduce SafeRedir, a lightweight inference-time framework for robust unlearning via prompt embedding redirection. Without modifying the underlying IGMs, SafeRedir adaptively routes unsafe prompts toward safe semantic regions through token-level interventions in the embedding space. The framework comprises two core components: a latent-aware multi-modal safety classifier for identifying unsafe generation trajectories, and a token-level delta generator for precise semantic redirection, equipped with auxiliary predictors for token masking and adaptive scaling to localize and regulate the intervention. Empirical results across multiple representative unlearning tasks demonstrate that SafeRedir achieves effective unlearning capability, high semantic and perceptual preservation, robust image quality, and enhanced resistance to adversarial attacks. Furthermore, SafeRedir generalizes effectively across a variety of diffusion backbones and existing unlearned models, validating its plug-and-play compatibility and broad applicability. Code and data are available at https://github.com/ryliu68/SafeRedir.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 42 of its 61 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
42 of 61 references.
Closest ancestors · 8
Same direction, newest first
- 2025Image Can Bring Your Memory Back: A Novel Multi-Modal Guided Attack against Image Generation Model Unlearning9 Jul
- 2024Safe Inputs but Unsafe Output: Benchmarking Cross-modality Safety Alignment of Large Vision-Language Model21 Jun
- 2024ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning29 May
- 2024Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient24 May
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Models20 May
Other references · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2019Machine Unlearningcited by 1,020
- 2023Extracting Training Data from Diffusion Modelscited by 723
22 more
- 2023Erasing Concepts from Diffusion Modelscited by 530
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 459
- 2023Unified Concept Editing in Diffusion Modelscited by 377
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
- 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 298
- 2023MMA-Diffusion: MultiModal Attack on Diffusion Modelscited by 184
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 171
- 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Modelscited by 123
- 2023Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Eraserscited by 118
- 2023Localizing and Editing Knowledge in Text-to-Image Generative Modelscited by 52
- 2023Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Modelscited by 42
- 2023SurrogatePrompt: Bypassing the Safety Filter of Text-to-Image Models via Substitutioncited by 32
- 2024Universal Prompt Optimizer for Safe Text-to-Image Generationcited by 27
- 2025Concept Pinpoint Eraser for Text-to-image Diffusion Models via Residual Attention Gatecited by 16
- 2024Unveiling Concept Attribution in Diffusion Modelscited by 11
- 2025Erasing Concepts, Steering Generations: A Comprehensive Survey of Concept Suppressioncited by 10
- 2025Rethinking Machine Unlearning in Image Generation Modelscited by 9
- 2024ADBA:Approximation Decision Boundary Approach for Black-Box Adversarial Attackscited by 7
- 2025Training-Free Safe Text Embedding Guidance for Text-to-Image Diffusion Modelscited by 6
- 2024Safe Text-to-Image Generation: Simply Sanitize the Prompt Embeddingcited by 4
- 2025Guardians of Generation: Dynamic Inference-Time Copyright Shielding with Adaptive Guidance for AI Image Generationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Robust and Generalizable Safety Steering for Text-to-Image Diffusion Transformers28 May 2026
- 2026DTVI: Dual-Stage Textual and Visual Intervention for Safe Text-to-Image Generation23 Mar 2026
- 2026REFORGE: Multi-modal Attacks Reveal Vulnerable Concept Unlearning in Image Generation Models17 Mar 2026