Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignment, under which target concepts exhibit higher separability at certain representational depths. Outside these depths, concept and non-target signals remain strongly entangled, limiting the effectiveness of depth-specific erasure. This observation reframes concept erasure as the problem of identifying representational depths where concept-non-target separation naturally emerges. Motivated by this structural constraint, we introduce CLEAR, a separability-driven optimization framework for concept erasure that explicitly enforces concept-layer alignment. CLEAR operationalizes this principle by formulating layer selection as an optimization problem over concept-non-target separability, rather than relying on layer-agnostic or heuristic choices. To enable this, we introduce a separability-aware objective that favors layers exhibiting stronger concept-non-target separation. Experiments on large-scale text-to-video diffusion models demonstrate that enforcing concept--layer alignment leads to more precise concept suppression while preserving overall generative quality.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 43 of its 46 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
43 of 46 references.
Closest ancestors · 13
Same direction, newest first
- 2026Closed-Form Concept Erasure via Double Projections11 Apr
- 2026Mass Concept Erasure in Diffusion Models with Concept Hierarchy6 Jan
- 2025A Single Neuron Works: Precise Concept Erasure in Text-to-Image Diffusion Models25 Sep
- 2025SAEmnesia: Erasing Concepts in Diffusion Models with Supervised Sparse Autoencoders23 Sep
- 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Models21 Aug
- 2025T2VUnlearning: A Concept Erasing Method for Text-to-Video Diffusion Models23 May
- 2025Erased or Dormant? Rethinking Concept Erasure Through Reversibility22 May
- 2025Sparse Autoencoder as a Zero-Shot Classifier for Concept Erasing in Text-to-Image Diffusion Models12 Mar
- 2025SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders29 Jan
- 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation16 Oct
- 2024Unlearning Concepts from Text-to-Video Diffusion Models19 Jul
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
1 more
- 2023Erasing Concepts from Diffusion Models13 Mar
Other references · 30
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
18 more
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2025Learning Multi-Level Features with Matryoshka Sparse Autoencoderscited by 136
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 95
- 2024A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Datacited by 88
- 2023Circumventing Concept Erasure Methods For Text-to-Image Generative Modelscited by 81
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
- 2016A survey of sparse representation: algorithms and applicationscited by 58
- 2024Learning Transferable Negative Prompts for Out-of-Distribution Detectioncited by 43
- 2024Diffusion Lens: Interpreting Text Encoders in Text-to-Image Pipelinescited by 28
- 2025SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Modelscited by 28
- 2025Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignmentcited by 24
- 2025Minimalist Concept Erasure in Generative Modelscited by 13
- 2026Machine Unlearning under Retain-Forget Entanglementcited by 10
- 2026Triggering Chain-of-Thought via Latent Feature Interventions in Large Language Modelscited by 9
- 2026Where Knowledge Collides: A Mechanistic Study of Intra-Memory Knowledge Conflict in Language Modelscited by 5
- 2025Faithful and Stable Neuron Explanations for Trustworthy Mechanistic Interpretabilitycited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Motion Concept Unlearning in Video Diffusion Modelscited by 0
- 2026Motion Concept Unlearning in Video Diffusion Models29 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models
- 2026PROBE: Diagnosing Residual Concept Capacity in Erased Text-to-Video Diffusion Models
- 2026You Can't Have It Both Ways: Concept Entanglement Limits Diffusion Model Unlearning
- 2026Localized Concept Erasure in Text-to-Image Diffusion Models via High-Level Representation Misdirection
- 2026Neighbor-Aware Localized Concept Erasure in Text-to-Image Diffusion Models
- 2025Semantic Surgery: Zero-Shot Concept Erasure in Diffusion Models
- 2026Erasure or Erosion? Evaluating Compositional Degradation in Unlearned Text-To-Image Diffusion Models
- 2026EraseAnything++: Enabling Concept Erasure in Rectified Flow Transformers Leveraging Multi-Object Optimization