Latent Space Probing for Adult Content Detection in Video Generative Models
Not on the map. Why?
Abstract (arXiv)
The rapid proliferation of AI-powered video generation systems has introduced significant challenges in content moderation, particularly with respect to adult and sexually explicit material. Existing detection methods operate on either prompts or decoded pixel-space outputs. Therefore, both approaches are blind to the rich internal representations formed during generation. In this paper, we propose a novel latent space probing framework that intercepts the denoised latent representations produced by the CogVideoX video diffusion model during inference and attaches lightweight classifiers to perform real-time adult content detection. To support this work, we construct a large-scale binary dataset of 11039 ten-second video clips (5086 violating, 5953 non-violating) sourced from adult websites and YouTube respectively. We introduce two lightweight probing classifier architectures. We train and evaluate it on the dataset. Our work demonstrates that latent-space signals encode strong discriminative features for harmful content detection, achieving 97.29% F1 on our held-out test set with an overhead in the 4-6ms range. Our results suggest that probing the latent space results in improvements in both detection performance as well as cost.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 60 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
40 of 60 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2016Layer Normalizationcited by 5,579
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
28 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2020Aligning AI With Shared Human Valuescited by 706
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
- 2013Network In Networkcited by 600
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 501
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teamingcited by 172
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 171
- 2024Latent Guard: a Safety Framework for Text-to-image Generationcited by 68
- 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
- 2026Building Production-Ready Probes For Geminicited by 38
- 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 37
- 2024Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Surveycited by 34
- 2024Jailbreak Attacks and Defenses against Multimodal Generative Models: A Surveycited by 31
- 2025Deepfakes on Demand: the rise of accessible non-consensual deepfake image generatorscited by 15
- 2026Diffusion Probe: Generated Image Result Prediction Using CNN Probescited by 13
- 2024T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognitioncited by 10
- 2024AEIOU: A Unified Defense Framework against NSFW Prompts in Text-to-Image Modelscited by 7
- 2025Video Deepfake Abuse: How Company Choices Predictably Shape Misuse Patternscited by 4
- 2025Seeing It Before It Happens: In-Generation NSFW Detection for Diffusion-Based Text-to-Image Modelscited by 3
- 2018Spatiotemporal CNNs for Pornography Detection in Videoscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Uncovering Hidden Subspaces in Video Diffusion Models Using Re-Identification
- 2025NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generation
- 2026UniNDM: A Unified Noise-driven Detection and Mitigation Framework Against Sexual Content in Text-to-Image Generation
- 2024Factorized Video Autoencoders for Efficient Generative Modelling
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation
- 2025Stabilizing Self-Consuming Diffusion Models with Latent Space Filtering
- 2026Detecting AI-Generated Content on Social Media with Multi-modal Language Models
- 2024Turns Out I'm Not Real: Towards Robust Detection of AI-Generated Videos