Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Anomaly detection in surveillance videos is challenging and important for ensuring public security. Different from pixel-based anomaly detection methods, pose-based methods utilize highly-structured skeleton data, which decreases the computational burden and also avoids the negative impact of background noise. However, unlike pixel-based methods, which could directly exploit explicit motion features such as optical flow, pose-based methods suffer from the lack of alternative dynamic representation. In this paper, a novel Motion Embedder (ME) is proposed to provide a pose motion representation from the probability perspective. Furthermore, a novel task-specific Spatial-Temporal Transformer (STT) is deployed for self-supervised pose sequence reconstruction. These two modules are then integrated into a unified framework for pose regularity learning, which is referred to as Motion Prior Regularity Learner (MoPRL). MoPRL achieves the state-of-the-art performance by an average improvement of 4.7% AUC on several challenging datasets. Extensive experiments validate the versatility of each proposed module.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 49 of its 79 references that are in the map. First posted on arXiv 7 Dec 2021.
Builds on
49 of 79 references.
References · 49
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
37 more
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2021Video Swin Transformercited by 1,090
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 852
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2019Deep Learning for Anomaly Detection: A Surveycited by 357
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2019Anomaly Detection in Video Sequence with Appearance-Motion Correspondencecited by 118
- 2020Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigmcited by 115
- 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
- 2018Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Videocited by 110
- 2019Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videoscited by 103
- 2018Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identificationcited by 96
- 2019Graph Embedded Pose Clustering for Anomaly Detectioncited by 95
- 2018Pose Flow: Efficient Online Pose Trackingcited by 80
- 2020CLAWS: Clustering Assisted Weakly Supervised Learning with Normalcy Suppression for Anomalous Event Detectioncited by 79
- 2020Cloze Test Helps: Effective Video Anomaly Detection via Learning to Complete Video Eventscited by 70
- 2019Multi-timescale Trajectory Prediction for Abnormal Human Activity Detectioncited by 59
- 2021Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detectioncited by 31
- 2018Cascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localizationcited by 8
Built on by
Citing papers per year: 2023: 3; 2024: 10; 2025: 5; 2026: 4.
22 papers.
Sort:
By area:
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 48
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Predictioncited by 19
- 2023A Large-scale Study of Spatiotemporal Representation Learning with a New Benchmark on Action Recognitioncited by 14
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deploymentcited by 7
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detectioncited by 7
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmarkcited by 6
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformercited by 6
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detectioncited by 6
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detectioncited by 6
- 2025MoFM: A Large-Scale Human Motion Foundation Modelcited by 5
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLMcited by 4
10 more
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environmentcited by 4
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detectioncited by 3
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholdscited by 3
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Securitycited by 3
- 2023Human Kinematics-inspired Skeleton-based Video Anomaly Detectioncited by 1
- 2023A Lightweight Video Anomaly Detection Model with Weak Supervision and Adaptive Instance Selectioncited by 1
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detectioncited by 1
- 2026Are Multimodal LLMs Ready for Surveillance? A Reality Check on Zero-Shot Anomaly Detection in the Wildcited by 1
- 2026From Frames to Events: Rethinking Evaluation in Human-Centric Video Anomaly Detectioncited by 1
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detectioncited by 0
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
- 2026From Frames to Events: Rethinking Evaluation in Human-Centric Video Anomaly Detection10 Apr 2026
- 2026Are Multimodal LLMs Ready for Surveillance? A Reality Check on Zero-Shot Anomaly Detection in the Wild5 Mar 2026
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Security5 Mar 2026
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detection14 Sep 2025
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environment19 Aug 2025
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholds12 Aug 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection4 Dec 2024
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detection21 Sep 2024
- 2024Deep Learning for Video Anomaly Detection: A Review9 Sep 2024
10 more
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detection5 Sep 2024
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformer27 Aug 2024
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmark26 Aug 2024
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection5 Jun 2024
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Prediction29 Apr 2024
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deployment29 Apr 2024
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Dataset7 Feb 2024
- 2023A Lightweight Video Anomaly Detection Model with Weak Supervision and Adaptive Instance Selection9 Oct 2023
- 2023Human Kinematics-inspired Skeleton-based Video Anomaly Detection27 Sep 2023
- 2023A Large-scale Study of Spatiotemporal Representation Learning with a New Benchmark on Action Recognition23 Mar 2023
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 48
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Predictioncited by 19
- 2023A Large-scale Study of Spatiotemporal Representation Learning with a New Benchmark on Action Recognitioncited by 14
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deploymentcited by 7
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detectioncited by 7
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmarkcited by 6
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformercited by 6
- 2025MoFM: A Large-Scale Human Motion Foundation Modelcited by 5
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLMcited by 4
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environmentcited by 4
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detectioncited by 3
12 most cited of 19 All 19 (JSON)
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
- 2026From Frames to Events: Rethinking Evaluation in Human-Centric Video Anomaly Detection10 Apr 2026
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Security5 Mar 2026
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detection14 Sep 2025
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environment19 Aug 2025
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholds12 Aug 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2024Deep Learning for Video Anomaly Detection: A Review9 Sep 2024
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detection5 Sep 2024
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformer27 Aug 2024
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmark26 Aug 2024
12 newest of 19 All 19 (JSON)