mlsanityData to 7 Oct 2026

Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization

arXiv 2610.02019 ↗First posted 1 Oct 2026cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid growth of video-based social media has increased users' exposure to harmful content, creating a need for reliable automated video safety detection. Although recent Vision-Language Models (VLMs) show strong video understanding capabilities, existing harmful video detection systems face two key limitations: they typically reduce safety detection to binary classification, overlooking the inherently multi-label nature of unsafe videos, and they rely on static training objectives that do not support controllable precision-recall trade-offs, though the desired operating point may vary across moderation pipelines and unsafe categories. To address these gaps, we propose Adaptive Tversky Policy Optimization (ATPO), a reinforcement learning framework for Multi-label Video Safety Detection (Multi-VSD). ATPO introduces the Adaptive Tversky Reward (ATR), which dynamically adjusts false-positive and false-negative penalties during training to enable controllable precision-recall trade-offs. Experiments on SafeWatch-Bench and XD-Violence show that ATPO substantially improves multi-label performance, increasing the Jaccard Index from 40.66 to 75.44 on SafeWatch-Bench-Real. Moreover, ATR enables reliable steering of the precision-recall operating point, supporting deployment scenarios with heterogeneous policy requirements. Code and checkpoints are provided at https://bruceyg.github.io/ATPO-project-page/ .

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 49 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

33 of 49 references.

References · 33

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  6. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  7. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  8. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  9. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  10. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  11. 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
  12. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
21 more
  1. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
  2. 2024Improve Vision Language Model Chain-of-thought Reasoningcited by 135
  3. 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generationcited by 125
  4. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  5. 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
  6. 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
  7. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 60
  8. 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
  9. 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoningcited by 38
  10. 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 37
  11. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiencycited by 25
  12. 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thoughtcited by 23
  13. 2025TempSamp-R1: Effective Temporal Sampling with Reinforcement Fine-Tuning for Video LLMscited by 15
  14. 2025Anomize: Better Open Vocabulary Video Anomaly Detectioncited by 13
  15. 2024T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognitioncited by 10
  16. 2025SEA: Low-Resource Safety Alignment for Multimodal Large Language Models via Synthetic Embeddingscited by 9
  17. 2025SafeVid: Toward Safety Aligned Video Large Multimodal Modelscited by 9
  18. 2024Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Fastercited by 7
  19. 2025ExPO-HM: Learning to Explain-then-Detect for Hateful Meme Detectioncited by 6
  20. 2025Protecting Your Video Content: Disrupting Automated Video-based LLM Annotationscited by 5
  21. 2025From Evaluation to Defense: Advancing Safety in Video Large Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Video-SafetyBench: A Benchmark for Safety Evaluation of Video LVLMs
  2. 2026HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models
  3. 2026UNIVID: Unified Vision-Language Model for Video Moderation
  4. 2026SafeCtrl: Region-Aware Safety Control for Text-to-Image Diffusion via Detect-Then-Suppress
  5. 2026Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steering
  6. 2025RedDiffuser: Auditing Multimodal Safety Failures in Vision-Language Models via Reinforced Diffusion
  7. 2026SafeLens: Deliberate and Efficient Video Guardrails with Fast-and-Slow Screening
  8. 2025AI vs. Human Moderators: A Comparative Evaluation of Multimodal LLMs in Content Moderation for Brand Safety