Learning Temporal Regularity in Video Sequences
Not on the map. Why?
Abstract (arXiv)
Perceiving meaningful activities in a long video sequence is a challenging problem due to ambiguous definition of 'meaningfulness' as well as clutters in the scene. We approach this problem by learning a generative model for regular motion patterns, termed as regularity, using multiple sources with very limited supervision. Specifically, we propose two methods that are built upon the autoencoders for their ability to work with little to no supervision. We first leverage the conventional handcrafted spatio-temporal local features and learn a fully connected autoencoder on them. Second, we build a fully convolutional feed-forward autoencoder to learn both the local features and the classifiers as an end-to-end learning framework. Our model can capture the regularities from multiple datasets. We evaluate our methods in both qualitative and quantitative ways - showing the learned regularity of videos in various aspects and demonstrating competitive performance on anomaly detection datasets as an application.
Key facts. Cited by 254 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 49; 2023: 36; 2024: 43; 2025: 45; 2026: 30.
254 papers.
Sort:
By area:
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 91
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
- 2021Learning Normal Dynamics in Videos with Meta Prototype Networkcited by 71
- 2022CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detectioncited by 67
38 more
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
- 2022Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzlescited by 62
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2022Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detectioncited by 47
- 2022SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detectioncited by 45
- 2021Weakly Supervised Video Anomaly Detection via Center-guided Discriminative Learningcited by 44
- 2023Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detectioncited by 43
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 42
- 2021Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signalscited by 41
- 2023Diversity-Measurable Anomaly Detectioncited by 41
- 2024Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Promptscited by 40
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2023Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectorscited by 37
- 2022Self-Supervised Masked Convolutional Transformer Block for Anomaly Detectioncited by 34
- 2021Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Videocited by 32
- 2021Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detectioncited by 31
- 2021Learning Not to Reconstruct Anomaliescited by 31
- 2021Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approachescited by 27
- 2022Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detectioncited by 27
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2021Synthetic Temporal Anomaly Guided End-to-End Video Anomaly Detectioncited by 26
- 2022Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detectioncited by 26
- 2022Towards Open Set Video Anomaly Detectioncited by 26
- 2022DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Networkcited by 26
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Modelscited by 24
- 2022Bayesian Nonparametric Submodular Video Partition for Robust Anomaly Detectioncited by 23
- 2021Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detectioncited by 22
- 2021Deep Anomaly Discovery From Unlabeled Videos via Normality Advantage and Self-Paced Refinementcited by 21
- 2024MULDE: Multiscale Log-Density Estimation via Denoising Score Matching for Video Anomaly Detectioncited by 21
- 2024Networking Systems for Video Anomaly Detection: A Tutorial and Surveycited by 21
- 2022Visual Anomaly Detection Via Partition Memory Bank Module and Error Estimationcited by 20
50 most cited of 254 All 254 (JSON)
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding1 Oct 2026
- 2026Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection23 Sep 2026
- 2026Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration16 Sep 2026
- 2026RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos15 Sep 2026
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection15 Sep 2026
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding7 Sep 2026
- 2026Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection4 Sep 2026
- 2026Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring31 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026TD-VAD: Breaking Visual Dependence in Video Anomaly Detection with Text-Driven Learning12 Aug 2026
- 2026Beyond Hazard Resemblance: Contrastive Event Adjudication for Training-Free Video Anomaly Detection10 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
38 more
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
- 2026Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness22 Jul 2026
- 2026SENSE-VAD: Sentient and Semantic Video Anomaly Detection for Autonomous Driving30 Jun 2026
- 2026Learning Where and When: Patch-Based Spatiotemporal Localization in Weakly Supervised Video Anomaly Detection28 Jun 2026
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference31 May 2026
- 2026FoodMonitor: Benchmarking MLLMs for Explainable Compliance Analysis23 May 2026
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection22 May 2026
- 2026Bounding-Box Trajectories Matter for Video Anomaly Detection21 May 2026
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models12 May 2026
- 2026Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inference26 Apr 2026
- 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filtering15 Apr 2026
- 2026Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding9 Apr 2026
- 2026Weakly Supervised Video Anomaly Detection with Anomaly-Connected Components and Intention Reasoning28 Feb 2026
- 2026DeepSVU: Towards In-depth Security-oriented Video Understanding via Unified Physical-world Regularized MoE20 Feb 2026
- 2026Enhancing Weakly Supervised Multimodal Video Anomaly Detection through Text Guidance11 Feb 2026
- 2026Designing Multi-Robot Ground Video Sensemaking with Public Safety Professionals9 Feb 2026
- 2026Instance-Aligned Captions for Explainable Video Anomaly Detection13 Jan 2026
- 2025HeadHunt-VAD: Hunting Robust Anomaly-Sensitive Heads in MLLM for Tuning-Free Video Anomaly Detection19 Dec 2025
- 2025ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantification1 Dec 2025
- 2025Mistake Attribution: Fine-Grained Mistake Understanding in Egocentric Videos25 Nov 2025
- 2025RefineVAD: Semantic-Guided Feature Recalibration for Weakly Supervised Video Anomaly Detection17 Nov 2025
- 2025Learning Time in Static Classifiers15 Nov 2025
- 2025VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models10 Nov 2025
- 2025Beyond Observations: Reconstruction Error-Guided Irregularly Sampled Time Series Representation Learning10 Nov 2025
- 2025M2S2L: Mamba-based Multi-Scale Spatial-temporal Learning for Video Anomaly Detection4 Nov 2025
- 2025A Unified Reasoning Framework for Holistic Zero-Shot Video Anomaly Analysis2 Nov 2025
- 2025TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detection1 Nov 2025
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Tree26 Oct 2025
- 2025Human-Centric Anomaly Detection in Surveillance Videos Using YOLO-World and Spatio-Temporal Deep Learning24 Oct 2025
- 2025VelocityNet: Real-Time Crowd Anomaly Detection via Person-Specific Velocity Analysis21 Oct 2025
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detection16 Oct 2025
- 2025AVAR-Net: A Lightweight Audio-Visual Anomaly Recognition Framework with a Benchmark Dataset15 Oct 2025
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Prompting2 Oct 2025
- 2025PANDA: Towards Generalist Video Anomaly Detection via Agentic AI Engineer30 Sep 2025
- 2025AnoF-Diff: One-Step Diffusion-Based Anomaly Detection for Forceful Tool Use18 Sep 2025
- 2025AnomalyLMM: Bridging Generative Knowledge and Discriminative Retrieval for Text-Based Person Anomaly Search4 Sep 2025
- 2025Context-Aware Zero-Shot Anomaly Detection in Surveillance Using Contrastive and Predictive Spatiotemporal Modeling25 Aug 2025
50 newest of 254 All 254 (JSON)
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Modelscited by 24
- 2024TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioningcited by 17
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Promptingcited by 8
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detectioncited by 4
- 2025ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantificationcited by 2
- 2025ALARM: Automated MLLM-Based Anomaly Detection in Complex-EnviRonment Monitoring with Uncertainty Quantification1 Dec 2025
- 2025Leveraging Multimodal LLM Descriptions of Activity for Explainable Semi-Supervised Video Anomaly Detection16 Oct 2025
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Prompting2 Oct 2025
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularity9 Dec 2024
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Models2 Dec 2024
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLM18 Jun 2024
- 2024TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning14 Apr 2024
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detection22 Aug 2023
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understandingcited by 5
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detectioncited by 1
- 2026Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inferencecited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understandingcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding1 Oct 2026
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection22 May 2026
- 2026Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inference26 Apr 2026
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understanding28 May 2025
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models14 Jul 2024
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 42
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 9
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detectioncited by 6
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection4 Dec 2024
- 2024Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection18 Mar 2024
- 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection14 Jul 2023
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 91
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
- 2021Learning Normal Dynamics in Videos with Meta Prototype Networkcited by 71
- 2022CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detectioncited by 67
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
12 most cited of 230 All 230 (JSON)
- 2026Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection23 Sep 2026
- 2026Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration16 Sep 2026
- 2026RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos15 Sep 2026
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection15 Sep 2026
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding7 Sep 2026
- 2026Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection4 Sep 2026
- 2026Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring31 Aug 2026
- 2026STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection20 Aug 2026
- 2026TD-VAD: Breaking Visual Dependence in Video Anomaly Detection with Text-Driven Learning12 Aug 2026
- 2026Beyond Hazard Resemblance: Contrastive Event Adjudication for Training-Free Video Anomaly Detection10 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection5 Aug 2026
12 newest of 230 All 230 (JSON)