mlsanityData to 14 Oct 2026

VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuning

arXiv 2505.23504 ↗First posted 29 May 2025cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

Video Anomaly Understanding (VAU) is essential for applications such as smart cities, security surveillance, and disaster alert systems, yet remains challenging due to its demand for fine-grained spatio-temporal perception and robust reasoning under ambiguity. Despite advances in anomaly detection, existing methods often lack interpretability and struggle to capture the causal and contextual aspects of abnormal events. This limitation is further compounded by the absence of comprehensive benchmarks for evaluating reasoning ability in anomaly scenarios. To address both challenges, we introduce VAU-R1, a data-efficient framework built upon Multimodal Large Language Models (MLLMs), which enhances anomaly reasoning through Reinforcement Fine-Tuning (RFT). Besides, we propose VAU-Bench, the first Chain-of-Thought benchmark tailored for video anomaly reasoning, featuring multiple-choice QA, detailed rationales, temporal annotations, and descriptive captions. Empirical results show that VAU-R1 significantly improves question answering accuracy, temporal grounding, and reasoning coherence across diverse contexts. Together, our method and benchmark establish a strong foundation for interpretable and reasoning-aware video anomaly understanding. Our code is available at https://github.com/GVCLab/VAU-R1.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 44 of its 53 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

44 of 53 references.

References · 44

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2017Non-local Neural Networkscited by 2,293
  6. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
  7. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
  8. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  9. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
  10. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  11. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  12. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
32 more
  1. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  2. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
  3. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
  4. 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
  5. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
  6. 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 123
  7. 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 93
  8. 2019Street Scene: A new dataset and evaluation protocol for video anomaly detectioncited by 90
  9. 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 90
  10. 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 89
  11. 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 87
  12. 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 70
  13. 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 64
  14. 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
  15. 2017Appearance-and-Relation Networks for Video Classificationcited by 61
  16. 2019Multi-timescale Trajectory Prediction for Abnormal Human Activity Detectioncited by 59
  17. 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
  18. 2023Open-Vocabulary Video Anomaly Detectioncited by 57
  19. 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 57
  20. 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
  21. 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 49
  22. 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 47
  23. 2024Uncovering What, Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomalycited by 45
  24. 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
  25. 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
  26. 2024Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Promptscited by 40
  27. 2025EventVAD: Training-Free Event-Aware Video Anomaly Detectioncited by 36
  28. 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
  29. 2024Learnable Expansion of Graph Operators for Multi-Modal Feature Fusioncited by 23
  30. 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)cited by 23
  31. 2024Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detectioncited by 10
  32. 2024Exploring What Why and How: A Multifaceted Benchmark for Causation Understanding of Video Anomalycited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 17.

24 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  2. 2026Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddingscited by 24
  3. 2025Reinforcement Learning for Large Model: A Surveycited by 9
  4. 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Promptingcited by 8
  5. 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
  6. 2026Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimizationcited by 4
  7. 2025OpenView: Empowering MLLMs with Out-of-view VQAcited by 3
  8. 2025Text-guided Fine-Grained Video Anomaly Understandingcited by 2
  9. 2026Understanding Real-World Traffic Safety through RoadSafe365 Benchmarkcited by 2
  10. 2026Learning Transferable Temporal Primitives for Video Reasoning via Synthetic Videoscited by 2
  11. 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 2
  12. 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitionscited by 1
12 more
  1. 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detectioncited by 1
  2. 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
  3. 2025DAMS:Dual-Branch Adaptive Multiscale Spatiotemporal Framework for Video Anomaly Detectioncited by 0
  4. 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Methodcited by 0
  5. 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learningcited by 0
  6. 2026OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoningcited by 0
  7. 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
  8. 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoningcited by 0
  9. 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understandingcited by 0
  10. 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understandingcited by 0
  11. 2026Test-time Reinforcement Learning for Anomalous Video Understandingcited by 0
  12. 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding
  2. 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thought
  3. 2025VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models
  4. 2026Anomaly-Guided Observation and Two-Level Semantic Feedback for Training-Free Video Anomaly Analysis
  5. 2026FineVAU: A Novel Human-Aligned Benchmark for Fine-Grained Video Anomaly Understanding
  6. 2025Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarks
  7. 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
  8. 2025CueBench: Advancing Unified Understanding of Context-Aware Video Anomalies in Real-World