Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzles
Not on the map. Why?
Abstract (arXiv)
Video Anomaly Detection (VAD) is an important topic in computer vision. Motivated by the recent advances in self-supervised learning, this paper addresses VAD by solving an intuitive yet challenging pretext task, i.e., spatio-temporal jigsaw puzzles, which is cast as a multi-label fine-grained classification problem. Our method exhibits several advantages over existing works: 1) the spatio-temporal jigsaw puzzles are decoupled in terms of spatial and temporal dimensions, responsible for capturing highly discriminative appearance and motion features, respectively; 2) full permutations are used to provide abundant jigsaw puzzles covering various difficulty levels, allowing the network to distinguish subtle spatio-temporal differences between normal and abnormal events; and 3) the pretext task is tackled in an end-to-end manner without relying on any pre-trained models. Our method outperforms state-of-the-art counterparts on three public benchmarks. Especially on ShanghaiTech Campus, the result is superior to reconstruction and prediction-based methods by a large margin.
Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). Builds on 37 of its 63 references that are in the map. First posted on arXiv 20 Jul 2022.
Builds on
37 of 63 references.
References · 37
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2017Non-local Neural Networkscited by 2,293
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
- 2016Colorful Image Colorizationcited by 1,114
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
25 more
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2017Unsupervised Representation Learning by Sorting Sequencescited by 221
- 2020SpeedNet: Learning the Speediness in Videoscited by 171
- 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
- 2018Self-Supervised Video Representation Learning with Space-Time Cubic Puzzlescited by 149
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 148
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2019Anomaly Detection in Video Sequence with Appearance-Motion Correspondencecited by 118
- 2018Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Videocited by 111
- 2019Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videoscited by 104
- 2020A Background-Agnostic Framework with Adversarial Training for Abnormal Event Detection in Videocited by 86
- 2020Video Representation Learning by Recognizing Temporal Transformationscited by 83
- 2020Cloze Test Helps: Effective Video Anomaly Detection via Learning to Complete Video Eventscited by 70
- 2020Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Predictioncited by 42
- 2018Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognitioncited by 40
- 2021Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detectioncited by 31
- 2021Learning Not to Reconstruct Anomaliescited by 31
- 2019Future Frame Prediction Using Convolutional VRNN for Anomaly Detectioncited by 27
- 2018Video Anomaly Detection and Localization via Gaussian Mixture Fully Convolutional Variational Autoencodercited by 21
- 2017Limiting the Reconstruction Capability of Generative Neural Network using Negative Learningcited by 16
- 2020Towards Anomaly Detection in Dashcam Videoscited by 16
Built on by
Citing papers per year: 2022: 3; 2023: 13; 2024: 25; 2025: 12; 2026: 9.
62 papers.
Sort:
By area:
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 60
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 57
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectorscited by 37
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2023Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and Modelcited by 25
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detectioncited by 22
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Predictioncited by 19
- 2022Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detectioncited by 18
- 2025AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMcited by 15
38 more
- 2024Solving Masked Jigsaw Puzzles with Diffusion Vision Transformerscited by 11
- 2024Privacy-Preserving Video Anomaly Detection: A Surveycited by 11
- 2023Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approachcited by 10
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 9
- 2024VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detectioncited by 8
- 2025ComplexVAD: Detecting Interaction Anomalies in Videocited by 8
- 2025VAGU & GtS: LLM-Based Benchmark and Framework for Joint Video Anomaly Grounding and Understandingcited by 8
- 2023Unveiling the Unseen: A Comprehensive Survey on Explainable Anomaly Detection in Images and Videoscited by 7
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deploymentcited by 7
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detectioncited by 7
- 2024Anomaly Detection for People with Visual Impairments Using an Egocentric 360-Degree Cameracited by 7
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detectioncited by 7
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmarkcited by 6
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformercited by 6
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detectioncited by 6
- 2023Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detectioncited by 5
- 2024Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detectioncited by 5
- 2025MoFM: A Large-Scale Human Motion Foundation Modelcited by 5
- 2025Autoregressive Denoising Score Matching is a Good Video Anomaly Detectorcited by 4
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLMcited by 4
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environmentcited by 4
- 2022Lightning Fast Video Anomaly Detection via Adversarial Knowledge Distillationcited by 3
- 2024IPAD: Industrial Process Anomaly Detection Datasetcited by 3
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detectioncited by 3
- 2025Self-Supervised Learning for Image Segmentation: A Comprehensive Surveycited by 3
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholdscited by 3
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Securitycited by 3
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detectioncited by 3
- 2023Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autismcited by 2
- 2024Frequency-Guided Multi-Level Human Action Anomaly Detection with Normalizing Flowscited by 2
- 2024CKNN: Cleansed k-Nearest Neighbor for Unsupervised Video Anomaly Detectioncited by 2
- 2023Divide and Conquer in Video Anomaly Detection: A Comprehensive Review and New Approachcited by 1
- 2023Human Kinematics-inspired Skeleton-based Video Anomaly Detectioncited by 1
- 2023Beyond the Benchmark: Detecting Diverse Anomalies in Videoscited by 1
- 2024Interactive Explainable Anomaly Detection for Industrial Settingscited by 1
- 2024Identifying Spatio-Temporal Drivers of Extreme Eventscited by 1
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detectioncited by 1
- 2023Reasonable Anomaly Detection in Long Sequencescited by 0
50 most cited of 62 All 62 (JSON)
- 2026Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection23 Sep 2026
- 2026RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos15 Sep 2026
- 2026Look Inside Each Video: Rethinking How Video Anomaly Detection Is Evaluated22 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026Event Stream based Multi-Modal Video Anomaly Detection: A Benchmark Dataset and Algorithms10 Jul 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026MTL-MAD: Multi-Task Learners are Effective Medical Anomaly Detectors7 May 2026
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Security5 Mar 2026
- 2026BAAF: Universal Transformation of One-Class Classifiers for Unsupervised Image Anomaly Detection13 Feb 2026
- 2025Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation16 Sep 2025
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detection14 Sep 2025
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environment19 Aug 2025
38 more
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholds12 Aug 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025VAGU & GtS: LLM-Based Benchmark and Framework for Joint Video Anomaly Grounding and Understanding29 Jul 2025
- 2025Autoregressive Denoising Score Matching is a Good Video Anomaly Detector29 Jun 2025
- 2025Sequential keypoint density estimator: an overlooked baseline of skeleton-based video anomaly detection23 Jun 2025
- 2025Self-Supervised Learning for Image Segmentation: A Comprehensive Survey19 May 2025
- 2025AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLM6 Mar 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2025ComplexVAD: Detecting Interaction Anomalies in Video16 Jan 2025
- 2024Privacy-Preserving Video Anomaly Detection: A Survey21 Nov 2024
- 2024KDC-MAE: Knowledge Distilled Contrastive Mask Auto-Encoder19 Nov 2024
- 2024Anomaly Detection for People with Visual Impairments Using an Egocentric 360-Degree Camera17 Nov 2024
- 2024Self-supervised Representation Learning for Cell Event Recognition through Time Arrow Prediction6 Nov 2024
- 2024Identifying Spatio-Temporal Drivers of Extreme Events31 Oct 2024
- 2024Interactive Explainable Anomaly Detection for Industrial Settings1 Oct 2024
- 2024VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detection24 Sep 2024
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detection21 Sep 2024
- 2024Deep Learning for Video Anomaly Detection: A Review9 Sep 2024
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detection5 Sep 2024
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformer27 Aug 2024
- 2024Towards Adaptive Human-centric Video Anomaly Detection: A Comprehensive Framework and A New Benchmark26 Aug 2024
- 2024CKNN: Cleansed k-Nearest Neighbor for Unsupervised Video Anomaly Detection6 Aug 2024
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models14 Jul 2024
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection5 Jun 2024
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Prediction29 Apr 2024
- 2024Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deployment29 Apr 2024
- 2024Frequency-Guided Multi-Level Human Action Anomaly Detection with Normalizing Flows26 Apr 2024
- 2024IPAD: Industrial Process Anomaly Detection Dataset23 Apr 2024
- 2024Solving Masked Jigsaw Puzzles with Diffusion Vision Transformers10 Apr 2024
- 2024Patch Spatio-Temporal Relation Prediction for Video Anomaly Detection28 Mar 2024
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detection21 Mar 2024
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection18 Mar 2024
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Dataset7 Feb 2024
- 2024Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detection24 Jan 2024
- 2023A brief introduction to a framework named Multilevel Guidance-Exploration Network7 Dec 2023
- 2023Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach27 Nov 2023
- 2023Open-Vocabulary Video Anomaly Detection13 Nov 2023
- 2023Beyond the Benchmark: Detecting Diverse Anomalies in Videos3 Oct 2023
50 newest of 62 All 62 (JSON)
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 60
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectorscited by 37
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2023Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and Modelcited by 25
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detectioncited by 22
- 2024An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Predictioncited by 19
- 2022Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detectioncited by 18
- 2025AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMcited by 15
- 2024Solving Masked Jigsaw Puzzles with Diffusion Vision Transformerscited by 11
12 most cited of 56 All 56 (JSON)
- 2026Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection23 Sep 2026
- 2026RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos15 Sep 2026
- 2026Look Inside Each Video: Rethinking How Video Anomaly Detection Is Evaluated22 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026Event Stream based Multi-Modal Video Anomaly Detection: A Benchmark Dataset and Algorithms10 Jul 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026From Offline to Periodic Adaptation for Pose-Based Shoplifting Detection in Real-world Retail Security5 Mar 2026
- 2026BAAF: Universal Transformation of One-Class Classifiers for Unsupervised Image Anomaly Detection13 Feb 2026
- 2025Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation16 Sep 2025
- 2025Action Hints: Semantic Typicality and Context Uniqueness for Generalizable Skeleton-based Video Anomaly Detection14 Sep 2025
- 2025A Survey on Video Anomaly Detection via Deep Learning: Human, Vehicle, and Environment19 Aug 2025
- 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholds12 Aug 2025
12 newest of 56 All 56 (JSON)