UNIVID: Unified Vision-Language Model for Video Moderation
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Global-scale video moderation faces a dual challenge: the need for fine-grained multi-modal reasoning and the demand for interpretable outputs to support downstream enforcement. Traditional moderation systems often rely on fragmented black-box classifiers that are difficult to maintain and lack transparency. In this paper, we present UNIVID, a UNIfied VIsion-language model for video moDeration. Unlike standard classification models, UNIVID generates policy-aware captions that serve as an interpretable intermediate representation, enabling human-verifiable decisions and multi-task reusability. While existing open-source and commercial VLMs often suffer from safety-guardrail refusals and lack fine-grained policy alignment, we develop a specialized training data recipe that combines expert human-refined labels with synthetic data to align the model with our safety guidelines. By integrating UNIVID as the core captioner, we design a novel end-to-end video moderation system that reduces violation leakage by 42.7% and overkill rate by 37.0% relatively. Meanwhile, by replacing over 1,000 policy-specific models with a single UNIVID backbone, we recycled extensive computation resources while reducing engineering maintenance overhead. To our knowledge, this is one of the first reports of a high-efficiency captioning VLM successfully supporting industrial-scale moderation and cross-functional business.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 33 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
19 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2025AI vs. Human Moderators: A Comparative Evaluation of Multimodal LLMs in Content Moderation for Brand Safety7 Aug
- 2025Video-SafetyBench: A Benchmark for Safety Evaluation of Video LVLMs17 May
Other references · 17
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 140
- 2022Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderationcited by 66
- 2025VLM as Policy: Common-Law Content Moderation Framework for Short Video Platformcited by 19
5 more
- 2025Reasoning-Enhanced Domain-Adaptive Pretraining of Multimodal Large Language Models for Short Video Content Governancecited by 13
- 2023Validating Multimedia Content Moderation Software via Semantic Fusioncited by 5
- 2024CPFD: Confidence-aware Privileged Feature Distillation for Short Video Classificationcited by 4
- 2025Embedding-based Retrieval in Multimodal Content Moderationcited by 4
- 2026From Native Memes to Global Moderation: Cross-Cultural Evaluation of Vision-Language Models for Hateful Meme Detectioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025UniVid: The Open-Source Unified Video Model
- 2026HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models
- 2026RuleSafe-VL: Evaluating Rule-Conditioned Decision Reasoning in Vision-Language Content Moderation
- 2025Filter-And-Refine: A MLLM Based Cascade System for Industrial-Scale Video Content Moderation
- 2023The Potential of Vision-Language Models for Content Moderation of Children's Videos
- 2026Nemotron 3.5 Content Safety Moderator: A Compact Multimodal, Multilingual, and Reasoning Enabled Content Safety Moderator
- 2026Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization
- 2025UniVid: Unifying Vision Tasks with Pre-trained Video Generation Models