Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Video Anomaly Detection (VAD) aims to temporally localize abnormal events in videos. Most existing approaches rely on dataset-specific training and curated annotations, limiting generalization in open-set scenarios. Recent zero-shot methods based on Large Vision- Language Models (LVLMs) alleviate this dependency but often lack temporal continuity and structured reasoning. We propose Cog-VADU, a fully training-free framework that reformulates VAD as a sequential cognitive reasoning task. Cog-VADU introduces Chain-of- Anomaly Detection Thought Prompting (CoADTP), which unrolls an LVLM into a recurrent reasoning chain across video segments. By propagating structured rationales over time, the model maintains implicit temporal memory, enabling robust discrimination between com- plex anomalies and high-motion normal activities. To improve reliability, we further design a cross-modal re-ranking stage that aligns textual rationales with visual embeddings, enforcing semantic consistency and temporal coherence for refined and stable predictions. Extensive experiments on multiple public VAD benchmarks demonstrate that Cog-VADU achieves competitive zero-shot performance. Moreover, cross-model evaluations show that CoADTP consistently enhances reasoning-based anomaly detection in a model-agnostic manner, pro- viding interpretable and generalizable anomaly understanding for real-world applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 58 of its 70 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
58 of 70 references.
Closest ancestors · 5
Same direction, newest first
- 2025Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames1 Jul
- 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought10 Jun
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May
Other references · 53
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
38 more
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2020CLAWS: Clustering Assisted Weakly Supervised Learning with Normalcy Suppression for Anomalous Event Detectioncited by 79
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2019GODS: Generalized One-class Discriminative Subspaces for Anomaly Detectioncited by 64
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
- 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
- 2021Weakly Supervised Video Anomaly Detection via Center-guided Discriminative Learningcited by 44
- 2023Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detectioncited by 43
- 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
- 2022DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Networkcited by 26
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Modelscited by 24
- 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuningcited by 24
- 2023Exploring Diffusion Models for Unsupervised Video Anomaly Detectioncited by 23
- 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thoughtcited by 23
- 2023BatchNorm-based Weakly Supervised Video Anomaly Detectioncited by 22
- 2024VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMscited by 20
- 2024NarrativeBridge: Enhancing Video Captioning with Causal-Temporal Narrativecited by 10
- 2025Sherlock: Towards Multi-scene Video Abnormal Event Extraction and Localization via a Global-local Spatial-sensitive LLMcited by 10
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
- 2026Reasoning-Guided Grounding: Elevating Video Anomaly Detection through Multimodal Large Language Models
- 2025A Unified Reasoning Framework for Holistic Zero-Shot Video Anomaly Analysis
- 2025SlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model
- 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection
- 2026GridVAD: Open-Set Video Anomaly Detection via Spatial Reasoning over Stratified Frame Grids
- 2026Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection