mlsanityData to 14 Oct 2026

Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steering

arXiv 2606.17257 ↗First posted 15 Jun 2026cs.CV cs.AIcited by 1

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 3 more
Abstract (arXiv)

Open-weight video diffusion models can generate photorealistic unsafe content, from violence to misinformation, yet existing defenses either require expensive safety fine-tuning that degrades general capability, or apply external filters that are trivially bypassed by adversarial prompts. We present REINS (REpresentation-space INference-time Safety steering), a training-free method that aligns video diffusion models at inference time by steering their internal representations toward safe generation. Our key finding is that safety-relevant structure is linearly encoded in the hidden-state activations of video diffusion transformers, and a single direction, discovered via Supervised PCA on binary safety labels, suffices to separate safe from unsafe generation trajectories. At inference, adding this direction to hidden states at an intermediate transformer layer redirects generation from harmful content to semantically related safe alternatives, with no weight updates, no concept enumeration, and negligible computational overhead. Through mechanistic analysis, we reveal that while safety information accumulates monotonically with transformer depth, steering effectiveness peaks at intermediate layers (~50% depth), exposing a fundamental tradeoff between information availability and downstream propagation capacity. We evaluate REINS across 9 video diffusion models, multiple parameter scales (1.3B-5B), and both text-to-video and image-to-video generation, to our knowledge, the broadest safety evaluation suite in the video generation literature.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 33 of its 40 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

33 of 40 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025VideoGuard: Protecting Video Content from Unauthorized Editing5 Aug
  2. 2024SteerDiff: Steering towards Safe Text-to-Image Diffusion Models3 Oct
  3. 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models17 Jul
  4. 2024SafeGen: Mitigating Sexually Explicit Content Generation in Text-to-Image Models10 Apr
  5. 2023MMA-Diffusion: MultiModal Attack on Diffusion Models29 Nov
  6. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  7. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
  8. 2023Unified Concept Editing in Diffusion Models25 Aug
  9. 2023SneakyPrompt: Jailbreaking Text-to-image Generative Models20 May
  10. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
  11. 2023Erasing Concepts from Diffusion Models13 Mar
  12. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
1 more
  1. 2022Red-Teaming the Stable Diffusion Safety Filter3 Oct

Other references · 20

  1. 2022Classifier-Free Diffusion Guidancecited by 5,847
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  7. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  8. 2023Steering Language Models With Activation Engineeringcited by 922
  9. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  10. 2025Improving Video Generation with Human Feedbackcited by 284
  11. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  12. 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 127
8 more
  1. 2024Latent Guard: a Safety Framework for Text-to-image Generationcited by 71
  2. 2025Kling-Omni Technical Reportcited by 71
  3. 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
  4. 2023Self-Discovering Interpretable Diffusion Latent Directions for Responsible Text-to-Image Generationcited by 69
  5. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  6. 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 38
  7. 2024SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Datasetcited by 35
  8. 2025PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectorscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SafeCtrl: Region-Aware Safety Control for Text-to-Image Diffusion via Detect-Then-Suppress
  2. 2026Robust and Generalizable Safety Steering for Text-to-Image Diffusion Transformers
  3. 2025Personalized Safety Alignment for Text-to-Image Diffusion Models
  4. 2025Beyond the Safety Tax: Mitigating Unsafe Text-to-Image Generation via External Safety Rectification
  5. 2024Safety Alignment Backfires: Preventing the Re-emergence of Suppressed Concepts in Fine-tuned Text-to-Image Diffusion Models
  6. 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Models
  7. 2025Towards Resilient Safety-driven Unlearning for Diffusion Models against Downstream Fine-tuning
  8. 2026Test-Time Scaling for Safe Text-Guided Image Generation via Intermediate Clean Estimates