Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Concept erasure techniques have been widely deployed in T2I diffusion models to prevent inappropriate content generation for safety and copyright considerations. However, as models evolve to next-generation architectures like Flux, established erasure methods (textite.g., ESD, UCE, AC) exhibit degraded effectiveness, raising questions about their true mechanisms. Through systematic analysis, we reveal that concept erasure creates only an illusion of ``amnesia": rather than genuine forgetting, these methods bias sampling trajectories away from target concepts, making the erasure fundamentally reversible. This insight motivates the need to distinguish superficial safety from genuine concept removal. In this work, we propose RevAm (underlineRevoking underlineAmnesia), an RL-based trajectory optimization framework that resurrects erased concepts by dynamically steering the denoising process without modifying model weights. By adapting Group Relative Policy Optimization (GRPO) to diffusion models, RevAm explores diverse recovery trajectories through trajectory-level rewards, overcoming local optima that limit existing methods. Extensive experiments demonstrate that RevAm achieves superior concept resurrection fidelity while reducing computational time by 10×, exposing critical vulnerabilities in current safety mechanisms and underscoring the need for more robust erasure techniques beyond trajectory manipulation.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 38 of its 42 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
38 of 42 references.
Closest ancestors · 15
Same direction, newest first
- 2025Erased or Dormant? Rethinking Concept Erasure Through Reversibility22 May
- 2025ACE: Attentional Concept Erasure in Diffusion Models16 Apr
- 2025Concept Corrector: Erase concepts on the fly for text-to-image diffusion models22 Feb
- 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers29 Dec
- 2024TraSCE: Trajectory Steering for Concept Erasure10 Dec
- 2024Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation21 Oct
- 2024ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning29 May
- 2024MACE: Mass Concept Erasure in Diffusion Models10 Mar
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
- 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts12 Sep
- 2023Unified Concept Editing in Diffusion Models25 Aug
3 more
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
11 more
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2022Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?cited by 150
- 2025Reinforcement Learning with Verifiable Rewards: GRPO's Effective Loss, Dynamics, and Success Amplificationcited by 108
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
- 2025Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Conceptscited by 61
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
- 2025Reason2Attack: Jailbreaking Text-to-Image Models via LLM Reasoningcited by 14
Built on by
Citing papers per year: 2025: 3; 2026: 8.
11 papers.
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarkscited by 4
- 2026Conditioned Activation Transport for T2I Safety Steeringcited by 3
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarkingcited by 2
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systemscited by 1
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offscited by 1
- 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Derainingcited by 0
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editingcited by 0
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 0
- 2026On the Controllability-Fidelity Frontier in Diffusion Editingcited by 0
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing5 Jun 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs31 Mar 2026
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis20 Mar 2026
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems19 Mar 2026
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing5 Mar 2026
- 2026Conditioned Activation Transport for T2I Safety Steering3 Mar 2026
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking24 Feb 2026
- 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Deraining8 Oct 2025
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarks7 Oct 2025
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editing2 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find Them
- 2025SPEED: Scalable, Precise, and Efficient Concept Erasure for Diffusion Models
- 2026Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models
- 2026GRACE: Adaptive Concept Erasure with Geometry-Guided Retention in Diffusion Models
- 2025TRACE: Trajectory-Constrained Concept Erasure in Diffusion Models
- 2025When Are Concepts Erased From Diffusion Models?
- 2026Continual Concept Erasure in Diffusion Models by Suppressing Cross-Edit Interference
- 2026Orthogonal Concept Erasure for Diffusion Models