mlsanityData to 14 Oct 2026

Video Unlearning via Low-Rank Refusal Vector

arXiv 2506.07891 ↗First posted 9 Jun 2025cs.CVcited by 13

On the map: LLM safety and security → Vision-language and text-to-image safety

Abstract (arXiv)

Video generative models achieve high-quality synthesis from natural-language prompts by leveraging large-scale web data. However, this training paradigm inherently exposes them to unsafe biases and harmful concepts, introducing the risk of generating undesirable or illicit content. To mitigate unsafe generations, existing machine unlearning approaches either rely on filtering, and can therefore be bypassed, or they update model weights, but with costly fine-tuning or training-free closed-form edits. We propose the first training-free weight update framework for concept removal in video diffusion models. From five paired safe/unsafe prompts, our method estimates a refusal vector and integrates it into the model weights as a closed-form update. A contrastive low-rank factorization further disentangles the target concept from unrelated semantics, it ensures a selective concept suppression and it does not harm generation quality. Our approach reduces unsafe generations on the Open-Sora and ZeroScopeT2V models across the T2VSafetyBench and SafeSora benchmarks, with average reductions of 36.3% and 58.2% respectively, while preserving prompt alignment and video quality. This establishes an efficient and scalable solution for safe video generation without retraining nor any inference overhead. Project page: https://www.pinlab.org/video-unlearning.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 43 of its 56 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

43 of 56 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation16 Oct
  2. 2024Unstable Unlearning: The Hidden Risk of Concept Resurgence in Diffusion Models10 Oct
  3. 2024SteerDiff: Steering towards Safe Text-to-Image Diffusion Models3 Oct
  4. 2024Unlearning Concepts from Text-to-Video Diffusion Models19 Jul
  5. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
  6. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar

Other references · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2017Deep reinforcement learning from human preferencescited by 3,912
  6. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  7. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  8. 2020Learning to summarize from human feedbackcited by 2,588
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
25 more
  1. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  2. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  3. 2022Toy Models of Superpositioncited by 971
  4. 2023Steering Language Models With Activation Engineeringcited by 922
  5. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  6. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  7. 2023ModelScope Text-to-Video Technical Reportcited by 658
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  9. 2023Erasing Concepts from Diffusion Modelscited by 539
  10. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  11. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  12. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 422
  13. 2023Unified Concept Editing in Diffusion Modelscited by 388
  14. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  15. 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
  16. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
  17. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
  18. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
  19. 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Modelscited by 133
  20. 2023Fine-tuning can cripple your foundation model; preserving features may be the solutioncited by 96
  21. 2024Controlling Language and Diffusion Models by Transporting Activationscited by 68
  22. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  23. 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
  24. 2024SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Datasetcited by 35
  25. 2022The Stable Artist: Steering Semantics in Diffusion Latent Spacecited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025T2VUnlearning: A Concept Erasing Method for Text-to-Video Diffusion Models
  2. 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Models
  3. 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models
  4. 2025Pre-Forgettable Models: Prompt Learning as a Native Mechanism for Unlearning
  5. 2026Why Instruction-Based Unlearning Fails in Diffusion Models?
  6. 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models
  7. 2024ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning
  8. 2025Prompt-Based Safety Guidance Is Ineffective for Unlearned Text-to-Image Diffusion Models