Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmark
Not on the map. Why?
Abstract (arXiv)
Human-centric Video Anomaly Detection (VAD) aims to identify human behaviors that deviate from normal. At its core, human-centric VAD faces substantial challenges, such as the complexity of diverse human behaviors, the rarity of anomalies, and ethical constraints. These challenges limit access to high-quality datasets and highlight the need for a dataset and framework supporting continual learning. Moving towards adaptive human-centric VAD, we introduce the HuVAD (Human-centric privacy-enhanced Video Anomaly Detection) dataset and a novel Unsupervised Continual Anomaly Learning (UCAL) framework. UCAL enables incremental learning, allowing models to adapt over time, bridging traditional training and real-world deployment. HuVAD prioritizes privacy by providing de-identified annotations and includes seven indoor/outdoor scenes, offering over 5x more pose-annotated frames than previous datasets. Our standard and continual benchmarks, utilize a comprehensive set of metrics, demonstrating that UCAL-enhanced models achieve superior performance in 82.14% of cases, setting a new state-of-the-art (SOTA). The dataset can be accessed at https://github.com/TeCSAR-UNCC/HuVAD.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 45 of its 85 references that are in the map. First posted on arXiv 26 Aug 2024.
Builds on
45 of 85 references.
References · 45
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
- 2018Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselinescited by 228
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2019Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videoscited by 103
- 2019Graph Embedded Pose Clustering for Anomaly Detectioncited by 95
- 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 91
- 2019Street Scene: A new dataset and evaluation protocol for video anomaly detectioncited by 89
33 more
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2022Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzlescited by 62
- 2019Multi-timescale Trajectory Prediction for Abnormal Human Activity Detectioncited by 59
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 59
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2020Continual Learning for Anomaly Detection in Surveillance Videoscited by 49
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 48
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
- 2022SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detectioncited by 45
- 2024Uncovering What, Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomalycited by 44
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 42
- 2023Continual Learning with Scaled Gradient Projectioncited by 33
- 2021A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videoscited by 28
- 2022Synthetic Data in Human Analysis: A Surveycited by 28
- 2023Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and Modelcited by 25
- 2020Online Anomaly Detection in Surveillance Videos with Asymptotic Bounds on False Alarm Ratecited by 22
- 2021Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detectioncited by 22
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detectioncited by 21
- 2022A Survey of Graph-based Deep Learning for Anomaly Detection in Distributed Systemscited by 20
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Predictioncited by 19
- 2022CHAD: Charlotte Anomaly Datasetcited by 18
- 2023Ancilia: Scalable Intelligent Video Surveillance for the Artificial Intelligence of Thingscited by 17
- 2023Understanding the Challenges and Opportunities of Pose-based Anomaly Detectioncited by 14
- 2024Unveiling the Anomalies in an Ever-Changing World: A Benchmark for Pixel-Level Anomaly Detection in Continual Learningcited by 13
- 2024Context-aware Video Anomaly Detection in Long-Term Datasetscited by 11
- 2020Developing Future Human-Centered Smart Cities: Critical Analysis of Smart City Security, Interpretability, and Ethical Challengescited by 9
- 2023Understanding Policy and Technical Aspects of AI-Enabled Smart Video Surveillance to Address Public Safetycited by 9
- 2023Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insightscited by 8
- 2022OCFR 2022: Competition on Occluded Face Recognition From Synthetically Generated Structure-Aware Occlusionscited by 7
- 2022Understanding Ethics, Privacy, and Regulations in Smart Video Surveillance for Public Safetycited by 7
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deploymentcited by 7
- 2023Exploring Public's Perception of Safety and Video Surveillance Technology: A Survey Approachcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 4.
6 papers.
- 2024Privacy-Preserving Video Anomaly Detection: A Surveycited by 11
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholdscited by 3
- 2026Are Multimodal LLMs Ready for Surveillance? A Reality Check on Zero-Shot Anomaly Detection in the Wildcited by 1
- 2026From Frames to Events: Rethinking Evaluation in Human-Centric Video Anomaly Detectioncited by 1
- 2026Structured Evidence Selection for Weakly Supervised Video Anomaly Detectioncited by 0
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detectioncited by 0
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
- 2026Structured Evidence Selection for Weakly Supervised Video Anomaly Detection11 Jul 2026
- 2026From Frames to Events: Rethinking Evaluation in Human-Centric Video Anomaly Detection10 Apr 2026
- 2026Are Multimodal LLMs Ready for Surveillance? A Reality Check on Zero-Shot Anomaly Detection in the Wild5 Mar 2026
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholds12 Aug 2025
- 2024Privacy-Preserving Video Anomaly Detection: A Survey21 Nov 2024