VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
Video Anomaly Understanding (VAU) is essential for applications such as smart cities, security surveillance, and disaster alert systems, yet remains challenging due to its demand for fine-grained spatio-temporal perception and robust reasoning under ambiguity. Despite advances in anomaly detection, existing methods often lack interpretability and struggle to capture the causal and contextual aspects of abnormal events. This limitation is further compounded by the absence of comprehensive benchmarks for evaluating reasoning ability in anomaly scenarios. To address both challenges, we introduce VAU-R1, a data-efficient framework built upon Multimodal Large Language Models (MLLMs), which enhances anomaly reasoning through Reinforcement Fine-Tuning (RFT). Besides, we propose VAU-Bench, the first Chain-of-Thought benchmark tailored for video anomaly reasoning, featuring multiple-choice QA, detailed rationales, temporal annotations, and descriptive captions. Empirical results show that VAU-R1 significantly improves question answering accuracy, temporal grounding, and reasoning coherence across diverse contexts. Together, our method and benchmark establish a strong foundation for interpretable and reasoning-aware video anomaly understanding. Our code is available at https://github.com/GVCLab/VAU-R1.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 44 of its 53 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
44 of 53 references.
References · 44
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2017Non-local Neural Networkscited by 2,293
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
32 more
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 123
- 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 93
- 2019Street Scene: A new dataset and evaluation protocol for video anomaly detectioncited by 90
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 90
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 89
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 87
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 70
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 64
- 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
- 2017Appearance-and-Relation Networks for Video Classificationcited by 61
- 2019Multi-timescale Trajectory Prediction for Abnormal Human Activity Detectioncited by 59
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 57
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 49
- 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 47
- 2024Uncovering What, Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomalycited by 45
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
- 2024Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Promptscited by 40
- 2025EventVAD: Training-Free Event-Aware Video Anomaly Detectioncited by 36
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2024Learnable Expansion of Graph Operators for Multi-Modal Feature Fusioncited by 23
- 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)cited by 23
- 2024Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detectioncited by 10
- 2024Exploring What Why and How: A Multifaceted Benchmark for Causation Understanding of Video Anomalycited by 9
Built on by
Citing papers per year: 2025: 7; 2026: 17.
24 papers.
Sort:
By area:
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2026Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddingscited by 24
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Promptingcited by 8
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimizationcited by 4
- 2025OpenView: Empowering MLLMs with Out-of-view VQAcited by 3
- 2025Text-guided Fine-Grained Video Anomaly Understandingcited by 2
- 2026Understanding Real-World Traffic Safety through RoadSafe365 Benchmarkcited by 2
- 2026Learning Transferable Temporal Primitives for Video Reasoning via Synthetic Videoscited by 2
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 2
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitionscited by 1
12 more
- 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detectioncited by 1
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
- 2025DAMS:Dual-Branch Adaptive Multiscale Spatiotemporal Framework for Video Anomaly Detectioncited by 0
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Methodcited by 0
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learningcited by 0
- 2026OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoningcited by 0
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoningcited by 0
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understandingcited by 0
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understandingcited by 0
- 2026Test-time Reinforcement Learning for Anomalous Video Understandingcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understandingcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding1 Oct 2026
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding7 Sep 2026
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understanding7 Sep 2026
- 2026Test-time Reinforcement Learning for Anomalous Video Understanding18 Aug 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning20 Jul 2026
- 2026Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization1 Jul 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning14 Jun 2026
- 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detection14 May 2026
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitions9 Apr 2026
12 more
- 2026Learning Transferable Temporal Primitives for Video Reasoning via Synthetic Videos18 Mar 2026
- 2026Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddings14 Feb 2026
- 2026Understanding Real-World Traffic Safety through RoadSafe365 Benchmark6 Feb 2026
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learning1 Feb 2026
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method15 Jan 2026
- 2025OpenView: Empowering MLLMs with Out-of-view VQA21 Dec 2025
- 2025Text-guided Fine-Grained Video Anomaly Understanding1 Nov 2025
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Prompting2 Oct 2025
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Survey2 Sep 2025
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2025DAMS:Dual-Branch Adaptive Multiscale Spatiotemporal Framework for Video Anomaly Detection28 Jul 2025
- 2026Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddingscited by 24
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026Learning Transferable Temporal Primitives for Video Reasoning via Synthetic Videoscited by 2
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Methodcited by 0
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learningcited by 0
- 2026OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoningcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understandingcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding1 Oct 2026
- 2026OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning14 Jun 2026
- 2026Learning Transferable Temporal Primitives for Video Reasoning via Synthetic Videos18 Mar 2026
- 2026Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddings14 Feb 2026
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learning1 Feb 2026
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method15 Jan 2026
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Promptingcited by 8
- 2025OpenView: Empowering MLLMs with Out-of-view VQAcited by 3
- 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detectioncited by 1
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detection14 May 2026
- 2025OpenView: Empowering MLLMs with Out-of-view VQA21 Dec 2025
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Prompting2 Oct 2025
- 2026Test-time Reinforcement Learning for Anomalous Video Understanding18 Aug 2026
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2026Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimizationcited by 4
- 2025Text-guided Fine-Grained Video Anomaly Understandingcited by 2
- 2026Understanding Real-World Traffic Safety through RoadSafe365 Benchmarkcited by 2
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 2
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitionscited by 1
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
- 2025DAMS:Dual-Branch Adaptive Multiscale Spatiotemporal Framework for Video Anomaly Detectioncited by 0
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoningcited by 0
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understandingcited by 0
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understandingcited by 0
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding7 Sep 2026
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understanding7 Sep 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
- 2026O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning20 Jul 2026
- 2026Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization1 Jul 2026
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitions9 Apr 2026
- 2026Understanding Real-World Traffic Safety through RoadSafe365 Benchmark6 Feb 2026
- 2025Text-guided Fine-Grained Video Anomaly Understanding1 Nov 2025
- 2025DAMS:Dual-Branch Adaptive Multiscale Spatiotemporal Framework for Video Anomaly Detection28 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding
- 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thought
- 2025VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models
- 2026Anomaly-Guided Observation and Two-Level Semantic Feedback for Training-Free Video Anomaly Analysis
- 2026FineVAU: A Novel Human-Aligned Benchmark for Fine-Grained Video Anomaly Understanding
- 2025Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarks
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
- 2025CueBench: Advancing Unified Understanding of Context-Aware Video Anomalies in Real-World