Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Recent progress in reasoning capabilities of Multimodal Large Language Models(MLLMs) has highlighted their potential for performing complex video understanding tasks. However, in the domain of Video Anomaly Detection and Understanding (VAD&U), existing MLLM-based methods are largely limited to anomaly localization or post-hoc description, lacking explicit reasoning processes, risk awareness, and decision-oriented interpretation. To address this gap, we define a new task termed Video Anomaly Reasoning (VAR), which elevates video anomaly analysis from descriptive understanding to structured, multi-stage reasoning. VAR explicitly requires models to perform progressive reasoning over anomalous events before answering anomaly-related questions, encompassing visual perception, causal interpretation, and risk-aware decision making. To support this task, we present a new dataset with 8,641 videos, where each video is annotated with diverse question types corresponding to different reasoning depths, totaling more than 50,000 samples, making it one of the largest datasets for video anomaly. The annotations are based on a structured Perception-Cognition-Action Chain-of-Thought (PerCoAct-CoT), which formalizes domain-specific reasoning priors for video anomaly understanding. This design enables systematic evaluation of multi-stage and adaptive anomaly reasoning. In addition, we propose Anomaly-Aware Group Relative Policy Optimization to further enhance reasoning reliability under weak supervision. Building upon the proposed task and dataset, we develop an end-to-end MLLM-based VAR model termed Vad-R1-Plus, which supports adaptive hierarchical reasoning and risk-aware decision making. Extensive experiments demonstrate that the proposed benchmark and method effectively advance the reasoning capabilities of MLLMs on VAR tasks, outperforming both open-source and proprietary baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 47 of its 89 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
47 of 89 references.
References · 47
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024OpenAI o1 System Cardcited by 1,220
35 more
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2024Long Context Transfer from Language to Visioncited by 502
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
- 2025Kimi-VL Technical Reportcited by 381
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 145
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 112
- 2025MiMo-VL Technical Reportcited by 106
- 2025Ovis2.5 Technical Reportcited by 103
- 2025Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledgecited by 68
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
- 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
- 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoningcited by 41
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
- 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuningcited by 24
- 2025VRU-Accident: A Vision-Language Benchmark for Video Question Answering and Dense Captioning for Accident Scene Understandingcited by 20
- 2025SurveillanceVQA-589K: A Benchmark for Comprehensive Surveillance Video-Language Understanding with Large Modelscited by 18
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Treecited by 15
- 2024Exploring What Why and How: A Multifaceted Benchmark for Causation Understanding of Video Anomalycited by 9
- 2025VAGU & GtS: LLM-Based Benchmark and Framework for Joint Video Anomaly Grounding and Understandingcited by 6
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understandingcited by 5
- 2025L2V-CoT: Cross-Modal Transfer of Chain-of-Thought Reasoning via Latent Interventioncited by 4
- 2025CueBench: Advancing Unified Understanding of Context-Aware Video Anomalies in Real-Worldcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thought
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Models
- 2025SlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding
- 2026Reasoning-Guided Grounding: Elevating Video Anomaly Detection through Multimodal Large Language Models
- 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection