Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos
Not on the map. Why?
Abstract (arXiv)
Appearance features have been widely used in video anomaly detection even though they contain complex entangled factors. We propose a new method to model the normal patterns of human movements in surveillance video for anomaly detection using dynamic skeleton features. We decompose the skeletal movements into two sub-components: global body movement and local body posture. We model the dynamics and interaction of the coupled features in our novel Message-Passing Encoder-Decoder Recurrent Network. We observed that the decoupled features collaboratively interact in our spatio-temporal model to accurately identify human-related irregular events from surveillance video sequences. Compared to traditional appearance-based models, our method achieves superior outlier detection performance. Our model also offers "open-box" examination and decision explanation made possible by the semantically understandable features and a network architecture supporting interpretability.
Key facts. Cited by 104 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 18; 2023: 21; 2024: 26; 2025: 14; 2026: 10.
104 papers.
Sort:
By area:
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2022Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzlescited by 62
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 60
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 57
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 42
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2021A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videoscited by 28
38 more
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2022DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Networkcited by 26
- 2021Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detectioncited by 22
- 2021Deep Anomaly Discovery From Unlabeled Videos via Normality Advantage and Self-Paced Refinementcited by 21
- 2023Prompt-Guided Zero-Shot Anomaly Action Recognition using Pretrained Deep Skeleton Featurescited by 21
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Predictioncited by 19
- 2022Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detectioncited by 18
- 2022CHAD: Charlotte Anomaly Datasetcited by 18
- 2023Graph Anomaly Detection in Time Series: A Surveycited by 18
- 2024Video Anomaly Detection in 10 Years: A Survey and Outlookcited by 18
- 2021Learnable Locality-Sensitive Hashing for Video Anomaly Detectioncited by 17
- 2023Ancilia: Scalable Intelligent Video Surveillance for the Artificial Intelligence of Thingscited by 17
- 2021Learning Asynchronous and Sparse Human-Object Interaction in Videoscited by 16
- 2021Anomaly Detection in Multi-Agent Trajectories for Automated Drivingcited by 15
- 2023Understanding the Challenges and Opportunities of Pose-based Anomaly Detectioncited by 15
- 2023Holistic Representation Learning for Multitask Trajectory Anomaly Detectioncited by 15
- 2021Deep Video Anomaly Detection: Opportunities and Challengescited by 14
- 2022Skeletal Video Anomaly Detection using Deep Learning: Survey, Challenges and Future Directionscited by 14
- 2023Contracting Skeletal Kinematics for Human-Related Video Anomaly Detectioncited by 14
- 2023A Coarse-to-Fine Pseudo-Labeling (C2FPL) Framework for Unsupervised Video Anomaly Detectioncited by 13
- 2024Privacy-Preserving Video Anomaly Detection: A Surveycited by 11
- 2022Multi-Contextual Predictions with Vision Transformer for Video Anomaly Detectioncited by 10
- 2023Making Reconstruction-based Method Great Again for Video Anomaly Detectioncited by 10
- 2023Survey on video anomaly detection in dynamic scenes with moving camerascited by 10
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2023Understanding Policy and Technical Aspects of AI-Enabled Smart Video Surveillance to Address Public Safetycited by 9
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 9
- 2022Privacy-Protecting Behaviours of Risk Detection in People with Dementia using Videoscited by 8
- 2024VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detectioncited by 8
- 2021A Critical Study on the Recent Deep Learning Based Semi-Supervised Video Anomaly Detection Methodscited by 7
- 2022BiPOCO: Bi-Directional Trajectory Prediction with Pose Constraints for Pedestrian Anomaly Detectioncited by 7
- 2023Exploring the Potential of World Models for Anomaly Detection in Autonomous Drivingcited by 7
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deploymentcited by 7
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detectioncited by 7
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognitioncited by 7
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detectioncited by 7
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generationcited by 7
- 2021A Modular and Unified Framework for Detecting and Localizing Video Anomaliescited by 6
50 most cited of 104 All 104 (JSON)
- 2026Auditing Observation-Quality Shortcuts in the Evaluation of Person-Centered Motion for Video Anomaly Detection12 Oct 2026
- 2026RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos15 Sep 2026
- 2026Look Inside Each Video: Rethinking How Video Anomaly Detection Is Evaluated22 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026LLM-Guided Safety Agent for Edge Robotics with an ISO-Compliant Perception-Compute-Control Architecture22 Apr 2026
- 2026Motion Semantics Guided Normalizing Flow for Privacy-Preserving Video Anomaly Detection23 Mar 2026
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Security5 Mar 2026
- 2026Forward Consistency Learning with Gated Context Aggregation for Video Anomaly Detection26 Jan 2026
- 20253D Human-Human Interaction Anomaly Detection15 Dec 2025
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation8 Dec 2025
38 more
- 2025Human-Centric Anomaly Detection in Surveillance Videos Using YOLO-World and Spatio-Temporal Deep Learning24 Oct 2025
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detection14 Sep 2025
- 2025Few-shot Human Action Anomaly Detection via a Unified Contrastive Learning Framework25 Aug 2025
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environment19 Aug 2025
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholds12 Aug 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025Emotion Recognition from Skeleton Data: A Comprehensive Survey24 Jul 2025
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detection23 Jun 2025
- 2025SlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model14 Apr 2025
- 2025Video Anomaly Detection with Contours -- A Study25 Mar 2025
- 2025An Expert Ensemble for Detecting Anomalous Scenes, Interactions, and Behaviors in Autonomous Driving23 Feb 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2024Dual Conditioned Motion Diffusion for Pose-Based Video Anomaly Detection23 Dec 2024
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection4 Dec 2024
- 2024Privacy-Preserving Video Anomaly Detection: A Survey21 Nov 2024
- 2024Appearance Blur-driven AutoEncoder and Motion-guided Memory Module for Video Anomaly Detection26 Sep 2024
- 2024VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detection24 Sep 2024
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detection21 Sep 2024
- 2024Deep Learning for Video Anomaly Detection: A Review9 Sep 2024
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformer27 Aug 2024
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmark26 Aug 2024
- 2024Modelling the Distribution of Human Motion for Sign Language Assessment19 Aug 2024
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognition16 Aug 2024
- 2024Towards Open-World Object-based Anomaly Detection via Self-Supervised Outlier Synthesis22 Jul 2024
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models14 Jul 2024
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection5 Jun 2024
- 2024Video Anomaly Detection in 10 Years: A Survey and Outlook29 May 2024
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Prediction29 Apr 2024
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deployment29 Apr 2024
- 2024Frequency-Guided Multi-Level Human Action Anomaly Detection with Normalizing Flows26 Apr 2024
- 2024RetailOpt: Opt-In, Easy-to-Deploy Trajectory Estimation from Smartphone Motion Data and Retail Facility Information19 Apr 2024
- 2024Enhancing Sign Language Teaching: A Mixed Reality Approach for Immersive Learning and Multi-Dimensional Feedback16 Apr 2024
- 2024Learning to Score Sign Language with Two-stage Method16 Apr 2024
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognition14 Apr 2024
- 2024Patch Spatio-Temporal Relation Prediction for Video Anomaly Detection28 Mar 2024
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection18 Mar 2024
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Dataset7 Feb 2024
- 2024Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detection24 Jan 2024
50 newest of 104 All 104 (JSON)
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 42
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 9
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detectioncited by 6
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection4 Dec 2024
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection18 Mar 2024
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection14 Jul 2023
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2022Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wildcited by 70
- 2022Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzlescited by 62
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 60
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2021A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videoscited by 28
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2022DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Networkcited by 26
12 most cited of 96 All 96 (JSON)
- 2026Auditing Observation-Quality Shortcuts in the Evaluation of Person-Centered Motion for Video Anomaly Detection12 Oct 2026
- 2026RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos15 Sep 2026
- 2026Look Inside Each Video: Rethinking How Video Anomaly Detection Is Evaluated22 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026Motion Semantics Guided Normalizing Flow for Privacy-Preserving Video Anomaly Detection23 Mar 2026
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Security5 Mar 2026
- 2026Forward Consistency Learning with Gated Context Aggregation for Video Anomaly Detection26 Jan 2026
- 20253D Human-Human Interaction Anomaly Detection15 Dec 2025
- 2025UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation8 Dec 2025
- 2025Human-Centric Anomaly Detection in Surveillance Videos Using YOLO-World and Spatio-Temporal Deep Learning24 Oct 2025
12 newest of 96 All 96 (JSON)