Advancing Video Anomaly Detection: A Concise Review and a New Dataset
Not on the map. Why?
Abstract (arXiv)
Video Anomaly Detection (VAD) finds widespread applications in security surveillance, traffic monitoring, industrial monitoring, and healthcare. Despite extensive research efforts, there remains a lack of concise reviews that provide insightful guidance for researchers. Such reviews would serve as quick references to grasp current challenges, research trends, and future directions. In this paper, we present such a review, examining models and datasets from various perspectives. We emphasize the critical relationship between model and dataset, where the quality and diversity of datasets profoundly influence model performance, and dataset development adapts to the evolving needs of emerging approaches. Our review identifies practical issues, including the absence of comprehensive datasets with diverse scenarios. To address this, we introduce a new dataset, Multi-Scenario Anomaly Detection (MSAD), comprising 14 distinct scenarios captured from various camera views. Our dataset has diverse motion patterns and challenging variations, such as different lighting and weather conditions, providing a robust foundation for training superior models. We conduct an in-depth analysis of recent representative models using MSAD and highlight its potential in addressing the challenges of detecting anomalies across diverse and evolving surveillance scenarios. [Project website: https://msad-dataset.github.io/]
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 77 of its 127 references that are in the map. First posted on arXiv 7 Feb 2024.
Builds on
77 of 127 references.
References · 77
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2022Generative Adversarial Networkscited by 5,603
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2021Video Swin Transformercited by 1,090
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
38 more
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
- 2021A survey on datasets for fairness-aware machine learningcited by 157
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
- 2018Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Videocited by 110
- 2019Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videoscited by 103
- 2020Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learningcited by 91
- 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 91
- 2019Street Scene: A new dataset and evaluation protocol for video anomaly detectioncited by 89
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2020A Background-Agnostic Framework with Adversarial Training for Abnormal Event Detection in Videocited by 85
- 2021Learning Normal Dynamics in Videos with Meta Prototype Networkcited by 71
- 2019Unsupervised Traffic Accident Detection in First-Person Videoscited by 69
- 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
- 2022Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzlescited by 62
- 2019Multi-timescale Trajectory Prediction for Abnormal Human Activity Detectioncited by 59
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 59
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2016Deep-Anomaly: Fully Convolutional Neural Network for Fast Anomaly Detection in Crowded Scenescited by 50
- 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
- 2023Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detectioncited by 43
- 2018Egocentric Vision-based Future Vehicle Localization for Intelligent Driving Assistance Systemscited by 42
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 20233Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognitioncited by 40
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2023Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectorscited by 37
- 2020Learning a distance function with a Siamese network to localize anomalies in videoscited by 31
- 2023Vision-Based Traffic Accident Detection and Anticipation: A Surveycited by 31
- 2019A Comparative Review of Recent Kinect-based Action Recognition Algorithmscited by 29
- 2021Spatio-Temporal Scene-Graph Embedding for Autonomous Vehicle Collision Predictioncited by 29
- 2020Tensor Representations for Action Recognitioncited by 28
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2024: 5; 2025: 22; 2026: 21.
48 papers.
Sort:
By area:
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Surveycited by 36
- 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuningcited by 24
- 2024Learnable Expansion of Graph Operators for Multi-Modal Feature Fusioncited by 22
- 2025SurveillanceVQA-589K: A Benchmark for Comprehensive Surveillance Video-Language Understanding with Large Modelscited by 18
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Treecited by 15
- 2024Do Language Models Understand Time?cited by 14
- 2025A Unified Reasoning Framework for Holistic Zero-Shot Video Anomaly Analysiscited by 9
- 2025Language-guided Open-world Video Anomaly Detection under Weak Supervisioncited by 8
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detectioncited by 7
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmarkcited by 6
- 2025Mixture of Experts Guided by Gaussian Splatters Matters: A new Approach to Weakly-Supervised Video Anomaly Detectioncited by 6
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understandingcited by 5
36 more
- 2025Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarkscited by 5
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detectioncited by 4
- 2024When Spatial meets Temporal in Action Recognitioncited by 3
- 2025Foundation Models for Anomaly Detection: Vision and Challengescited by 3
- 2025Rethinking Metrics and Benchmarks of Video Anomaly Detectioncited by 3
- 2025Feature Hallucination for Self-supervised Action Recognitioncited by 3
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understandingcited by 3
- 2026StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Videocited by 3
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detectioncited by 3
- 2025FrameShield: Adversarially Robust Video Anomaly Detectioncited by 2
- 2025Learning Time in Static Classifierscited by 2
- 2026Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindnesscited by 2
- 2025Evolving Skeletons: Motion Dynamics in Action Recognitioncited by 1
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localizationcited by 1
- 2025Uncertainty-Weighted Fusion of Image and Synthetic Event for Video Anomaly Detectioncited by 1
- 2025Just Dance with π! A Poly-modal Inductor for Weakly-supervised Video Anomaly Detectioncited by 1
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studiescited by 1
- 2025TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detectioncited by 1
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understandingcited by 1
- 2026Designing Multi-Robot Ground Video Sensemaking with Public Safety Professionalscited by 1
- 2026Benchmarking Compact VLMs for Clip-Level Surveillance Anomaly Detection Under Weak Supervisioncited by 1
- 2026MLE-UVAD: Minimal Latent Entropy Autoencoder for Fully Unsupervised Video Anomaly Detectioncited by 1
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitionscited by 1
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Modelscited by 1
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
- 2026Auditing Frame-Level AUC in Weakly Supervised Video Anomaly Detection: Granularity, Resolution, and Scene Biascited by 1
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detectioncited by 1
- 2025PiercingEye: Dual-Space Video Violence Detection with Hyperbolic Vision-Language Guidancecited by 0
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learningcited by 0
- 2026Privacy-Aware Video Anomaly Detection through Orthogonal Subspace Projectioncited by 0
- 2026Trust-Aware Joint Feature-Prediction Discrepancy for Robust Domain Adaptationcited by 0
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 0
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detectioncited by 0
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detectioncited by 0
- 2026Multi-Modal Anomaly Detection: A Surveycited by 0
- 2026GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignmentcited by 0
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection15 Sep 2026
- 2026GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignment27 Aug 2026
- 2026Multi-Modal Anomaly Detection: A Survey24 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026Auditing Frame-Level AUC in Weakly Supervised Video Anomaly Detection: Granularity, Resolution, and Scene Bias12 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
- 2026Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness22 Jul 2026
- 2026Trust-Aware Joint Feature-Prediction Discrepancy for Robust Domain Adaptation24 May 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models12 May 2026
36 more
- 2026StreamPro: From Reactive Perception to Proactive Decision-Making in Streaming Video11 May 2026
- 2026Privacy-Aware Video Anomaly Detection through Orthogonal Subspace Projection9 May 2026
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitions9 Apr 2026
- 2026MLE-UVAD: Minimal Latent Entropy Autoencoder for Fully Unsupervised Video Anomaly Detection25 Mar 2026
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understanding19 Mar 2026
- 2026Benchmarking Compact VLMs for Clip-Level Surveillance Anomaly Detection Under Weak Supervision3 Mar 2026
- 2026Designing Multi-Robot Ground Video Sensemaking with Public Safety Professionals9 Feb 2026
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learning1 Feb 2026
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding6 Jan 2026
- 2025Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarks22 Nov 2025
- 2025Learning Time in Static Classifiers15 Nov 2025
- 2025A Unified Reasoning Framework for Holistic Zero-Shot Video Anomaly Analysis2 Nov 2025
- 2025TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detection1 Nov 2025
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Tree26 Oct 2025
- 2025FrameShield: Adversarially Robust Video Anomaly Detection24 Oct 2025
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detection16 Oct 2025
- 2025Mixture of Experts Guided by Gaussian Splatters Matters: A new Approach to Weakly-Supervised Video Anomaly Detection8 Aug 2025
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies9 Jul 2025
- 2025Feature Hallucination for Self-supervised Action Recognition25 Jun 2025
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detection23 Jun 2025
- 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuning29 May 2025
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understanding28 May 2025
- 2025Rethinking Metrics and Benchmarks of Video Anomaly Detection25 May 2025
- 2025Just Dance with π! A Poly-modal Inductor for Weakly-supervised Video Anomaly Detection19 May 2025
- 2025SurveillanceVQA-589K: A Benchmark for Comprehensive Surveillance Video-Language Understanding with Large Models19 May 2025
- 2025Uncertainty-Weighted Fusion of Image and Synthetic Event for Video Anomaly Detection5 May 2025
- 2025PiercingEye: Dual-Space Video Violence Detection with Hyperbolic Vision-Language Guidance26 Apr 2025
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localization18 Apr 2025
- 2025Language-guided Open-world Video Anomaly Detection under Weak Supervision17 Mar 2025
- 2025Foundation Models for Anomaly Detection: Vision and Challenges10 Feb 2025
- 2025Evolving Skeletons: Motion Dynamics in Action Recognition5 Jan 2025
- 2024Do Language Models Understand Time?18 Dec 2024
- 2024When Spatial meets Temporal in Action Recognition22 Nov 2024
- 2024Learnable Expansion of Graph Operators for Multi-Modal Feature Fusion2 Oct 2024
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmark26 Aug 2024
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey31 Jul 2024
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Surveycited by 36
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detectioncited by 4
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understandingcited by 3
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understanding19 Mar 2026
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detection16 Oct 2025
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey31 Jul 2024
- 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuningcited by 24
- 2024Learnable Expansion of Graph Operators for Multi-Modal Feature Fusioncited by 22
- 2025SurveillanceVQA-589K: A Benchmark for Comprehensive Surveillance Video-Language Understanding with Large Modelscited by 18
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Treecited by 15
- 2024Do Language Models Understand Time?cited by 14
- 2025A Unified Reasoning Framework for Holistic Zero-Shot Video Anomaly Analysiscited by 9
- 2025Language-guided Open-world Video Anomaly Detection under Weak Supervisioncited by 8
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detectioncited by 7
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmarkcited by 6
- 2025Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarkscited by 5
- 2024When Spatial meets Temporal in Action Recognitioncited by 3
- 2025Foundation Models for Anomaly Detection: Vision and Challengescited by 3
12 most cited of 41 All 41 (JSON)
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection15 Sep 2026
- 2026GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignment27 Aug 2026
- 2026Multi-Modal Anomaly Detection: A Survey24 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026Auditing Frame-Level AUC in Weakly Supervised Video Anomaly Detection: Granularity, Resolution, and Scene Bias12 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
- 2026Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness22 Jul 2026
- 2026Trust-Aware Joint Feature-Prediction Discrepancy for Robust Domain Adaptation24 May 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models12 May 2026
12 newest of 41 All 41 (JSON)