Learning Normal Dynamics in Videos with Meta Prototype Network
Not on the map. Why?
Abstract (arXiv)
Frame reconstruction (current or future frame) based on Auto-Encoder (AE) is a popular method for video anomaly detection. With models trained on the normal data, the reconstruction errors of anomalous scenes are usually much larger than those of normal ones. Previous methods introduced the memory bank into AE, for encoding diverse normal patterns across the training videos. However, they are memory-consuming and cannot cope with unseen new scenarios in the testing data. In this work, we propose a dynamic prototype unit (DPU) to encode the normal dynamics as prototypes in real time, free from extra memory cost. In addition, we introduce meta-learning to our DPU to form a novel few-shot normalcy learner, namely Meta-Prototype Unit (MPU). It enables the fast adaption capability on new scenes by only consuming a few iterations of update. Extensive experiments are conducted on various benchmarks. The superior performance over the state-of-the-art demonstrates the effectiveness of our method.
Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). Builds on 35 of its 52 references that are in the map. First posted on arXiv 14 Apr 2021.
Builds on
35 of 52 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2019Selective Kernel Networkscited by 401
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
23 more
- 2017Residual Attention Network for Image Classificationcited by 385
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 377
- 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 357
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2017Meta Networkscited by 268
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2016Unrolled Generative Adversarial Networkscited by 208
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2019Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detectioncited by 171
- 2018Latent Space Autoregression for Novelty Detectioncited by 149
- 2019Anomaly Detection in Video Sequence with Appearance-Motion Correspondencecited by 118
- 2018Learning a Discriminative Feature Network for Semantic Segmentationcited by 114
- 2020Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detectioncited by 83
- 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
- 2017Abnormal Event Detection in Videos using Spatiotemporal Autoencodercited by 57
- 2017Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledgecited by 55
- 2020Localizing Anomalies from Weakly-Labeled Videoscited by 52
- 2017Unmasking the abnormal events in videocited by 48
- 2019Multi-Person Pose Estimation with Enhanced Channel-wise and Spatial Informationcited by 35
- 2018Meta-Tracker: Fast and Robust Online Adaptation for Visual Object Trackerscited by 34
- 2019Future Frame Prediction Using Convolutional VRNN for Anomaly Detectioncited by 27
- 2017Robust, Deep and Inductive Anomaly Detectioncited by 24
- 2017xUnit: Learning a Spatial Activation Function for Efficient Image Restorationcited by 10
Built on by
Citing papers per year: 2021: 4; 2022: 10; 2023: 15; 2024: 19; 2025: 18; 2026: 5.
71 papers.
Sort:
By area:
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2023Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detectioncited by 66
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 48
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detectioncited by 47
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Diversity-Measurable Anomaly Detectioncited by 41
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2023Anomaly Detection under Distribution Shiftcited by 35
38 more
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
- 2022Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detectioncited by 27
- 2023Delving into CLIP latent space for Video Anomaly Recognitioncited by 27
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2021Deep Anomaly Discovery From Unlabeled Videos via Normality Advantage and Self-Paced Refinementcited by 21
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detectioncited by 21
- 2022Cross-Domain Video Anomaly Detection without Target Domain Adaptationcited by 20
- 2022Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detectioncited by 18
- 2021Learnable Locality-Sensitive Hashing for Video Anomaly Detectioncited by 17
- 2025AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMcited by 15
- 2024MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generationcited by 14
- 2024Video Anomaly Detection with Motion and Appearance Guided Patch Diffusion Modelcited by 14
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Imagescited by 13
- 2024Context-aware Video Anomaly Detection in Long-Term Datasetscited by 11
- 2023SLSG: Industrial Image Anomaly Detection by Learning Better Feature Embeddings and One-Class Classificationcited by 10
- 2025MoniTor: Exploiting Large Language Models with Instruction for Online Video Anomaly Detectioncited by 10
- 2023REB: Reducing Biases in Representation for Industrial Anomaly Detectioncited by 9
- 2025Towards Visual Discrimination and Reasoning of Real-World Physical Dynamics: Physics-Grounded Anomaly Detectioncited by 9
- 2024VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detectioncited by 8
- 2025Foundation Models and Transformers for Anomaly Detection: A Surveycited by 8
- 2025HiProbe-VAD: Video Anomaly Detection via Hidden States Probing in Tuning-Free Multimodal LLMscited by 8
- 2025INP-Former++: Advancing Universal Anomaly Detection via Intrinsic Normal Prototypes and Residual Learningcited by 7
- 2024Cross-Domain Learning for Video Anomaly Detection with Limited Supervisioncited by 6
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformercited by 6
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detectioncited by 6
- 2022Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detectioncited by 5
- 2023Multi-level Memory-augmented Appearance-Motion Correspondence Framework for Video Anomaly Detectioncited by 5
- 2024Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localizationcited by 5
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understandingcited by 5
- 2025SmartHome-Bench: A Comprehensive Benchmark for Video Anomaly Detection in Smart Homes Using Multi-Modal Large Language Modelscited by 4
- 2025Autoregressive Denoising Score Matching is a Good Video Anomaly Detectorcited by 4
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLMcited by 4
- 2022Object Class Aware Video Anomaly Detection through Image Translationcited by 3
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detectioncited by 3
- 2024Appearance Blur-driven AutoEncoder and Motion-guided Memory Module for Video Anomaly Detectioncited by 3
- 2025Detecting Contextual Anomalies by Discovering Consistent Spatial Regionscited by 3
- 2022Language-Assisted Deep Learning for Autistic Behaviors Recognitioncited by 2
- 2023Future Video Prediction from a Single Frame for Video Anomaly Detectioncited by 2
50 most cited of 71 All 71 (JSON)
- 2026Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection23 Sep 2026
- 2026Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inference26 Apr 2026
- 2026Multi-turn Physics-informed Vision-language Model for Physics-grounded Anomaly Detection16 Mar 2026
- 2026Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection27 Feb 2026
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding6 Jan 2026
- 2025HeadHunt-VAD: Hunting Robust Anomaly-Sensitive Heads in MLLM for Tuning-Free Video Anomaly Detection19 Dec 2025
- 2025ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantification1 Dec 2025
- 2025ProtoAnomalyNCD: Prototype Learning for Multi-class Novel Anomaly Discovery in Industrial Scenarios17 Nov 2025
- 2025MoniTor: Exploiting Large Language Models with Instruction for Online Video Anomaly Detection24 Oct 2025
- 2025Instance Relation Learning Network with Label Knowledge Propagation for Few-shot Multi-label Intent Detection9 Oct 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025HiProbe-VAD: Video Anomaly Detection via Hidden States Probing in Tuning-Free Multimodal LLMs23 Jul 2025
38 more
- 2025Foundation Models and Transformers for Anomaly Detection: A Survey21 Jul 2025
- 2025Autoregressive Denoising Score Matching is a Good Video Anomaly Detector29 Jun 2025
- 2025Pro-AD: Learning Comprehensive Prototypes with Prototype-based Constraint for Multi-class Unsupervised Anomaly Detection16 Jun 2025
- 2025SmartHome-Bench: A Comprehensive Benchmark for Video Anomaly Detection in Smart Homes Using Multi-Modal Large Language Models15 Jun 2025
- 2025INP-Former++: Advancing Universal Anomaly Detection via Intrinsic Normal Prototypes and Residual Learning4 Jun 2025
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understanding28 May 2025
- 2025Advancing Video Anomaly Detection: A Bi-Directional Hybrid Framework for Enhanced Single- and Multi-Task Approaches20 Apr 2025
- 2025AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLM6 Mar 2025
- 2025Towards Visual Discrimination and Reasoning of Real-World Physical Dynamics: Physics-Grounded Anomaly Detection5 Mar 2025
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detection4 Mar 2025
- 2025Detecting Contextual Anomalies by Discovering Consistent Spatial Regions14 Jan 2025
- 2024Video Anomaly Detection with Motion and Appearance Guided Patch Diffusion Model12 Dec 2024
- 2024Edge Case Detection in Automated Driving: Methods, Challenges, and Future Directions11 Oct 2024
- 2024Appearance Blur-driven AutoEncoder and Motion-guided Memory Module for Video Anomaly Detection26 Sep 2024
- 2024VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detection24 Sep 2024
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detection21 Sep 2024
- 2024Deep Learning for Video Anomaly Detection: A Review9 Sep 2024
- 2024Unveiling Context-Related Anomalies: Knowledge Graph Empowered Decoupling of Scene and Action for Human-Related Video Anomaly Detection5 Sep 2024
- 2024Human-Centric Video Anomaly Detection Through Spatio-Temporal Pose Tokenization and Transformer27 Aug 2024
- 2024Cross-Domain Learning for Video Anomaly Detection with Limited Supervision9 Aug 2024
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models14 Jul 2024
- 2024MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generation27 Jun 2024
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detection12 Apr 2024
- 2024Context-aware Video Anomaly Detection in Long-Term Datasets11 Apr 2024
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detection1 Apr 2024
- 2024Patch Spatio-Temporal Relation Prediction for Video Anomaly Detection28 Mar 2024
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detection21 Mar 2024
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images13 Mar 2024
- 2024Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localization27 Feb 2024
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Dataset7 Feb 2024
- 2023Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detection22 Oct 2023
- 2023Delving into CLIP latent space for Video Anomaly Recognition4 Oct 2023
- 2023Beyond the Benchmark: Detecting Diverse Anomalies in Videos3 Oct 2023
- 2023Reasonable Anomaly Detection in Long Sequences6 Sep 2023
- 2023REB: Reducing Biases in Representation for Industrial Anomaly Detection24 Aug 2023
- 2023Future Video Prediction from a Single Frame for Video Anomaly Detection15 Aug 2023
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipation23 May 2023
- 2023Enhance Multi-Scale Spatial-Temporal Coherence for Configurable Video Anomaly Detection12 May 2023
50 newest of 71 All 71 (JSON)
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understandingcited by 5
- 2026Multi-turn Physics-informed Vision-language Model for Physics-grounded Anomaly Detectioncited by 2
- 2026Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inferencecited by 0
- 2026Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inference26 Apr 2026
- 2026Multi-turn Physics-informed Vision-language Model for Physics-grounded Anomaly Detection16 Mar 2026
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understanding28 May 2025
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models14 Jul 2024
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detectioncited by 6
- 2025ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantificationcited by 2
- 2026Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detectioncited by 2
- 2026Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection27 Feb 2026
- 2025ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantification1 Dec 2025
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detection21 Sep 2024
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2023Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detectioncited by 66
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 48
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detectioncited by 47
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Diversity-Measurable Anomaly Detectioncited by 41
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2023Anomaly Detection under Distribution Shiftcited by 35
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
12 most cited of 63 All 63 (JSON)
- 2026Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection23 Sep 2026
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding6 Jan 2026
- 2025HeadHunt-VAD: Hunting Robust Anomaly-Sensitive Heads in MLLM for Tuning-Free Video Anomaly Detection19 Dec 2025
- 2025ProtoAnomalyNCD: Prototype Learning for Multi-class Novel Anomaly Discovery in Industrial Scenarios17 Nov 2025
- 2025MoniTor: Exploiting Large Language Models with Instruction for Online Video Anomaly Detection24 Oct 2025
- 2025Instance Relation Learning Network with Label Knowledge Propagation for Few-shot Multi-label Intent Detection9 Oct 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025HiProbe-VAD: Video Anomaly Detection via Hidden States Probing in Tuning-Free Multimodal LLMs23 Jul 2025
- 2025Foundation Models and Transformers for Anomaly Detection: A Survey21 Jul 2025
- 2025Autoregressive Denoising Score Matching is a Good Video Anomaly Detector29 Jun 2025
- 2025Pro-AD: Learning Comprehensive Prototypes with Prototype-based Constraint for Multi-class Unsupervised Anomaly Detection16 Jun 2025
- 2025SmartHome-Bench: A Comprehensive Benchmark for Video Anomaly Detection in Smart Homes Using Multi-Modal Large Language Models15 Jun 2025
12 newest of 63 All 63 (JSON)