Learning Deep Representations of Appearance and Motion for Anomalous Event Detection
Not on the map. Why?
Abstract (arXiv)
We present a novel unsupervised deep learning framework for anomalous event detection in complex video scenes. While most existing works merely use hand-crafted appearance and motion features, we propose Appearance and Motion DeepNet (AMDN) which utilizes deep neural networks to automatically learn feature representations. To exploit the complementary information of both appearance and motion patterns, we introduce a novel double fusion framework, combining both the benefits of traditional early fusion and late fusion strategies. Specifically, stacked denoising autoencoders are proposed to separately learn both appearance and motion features as well as a joint representation (early fusion). Based on the learned representations, multiple one-class SVM models are used to predict the anomaly scores of each input, which are then integrated with a late fusion strategy for final anomaly detection. We evaluate the proposed method on two publicly available video surveillance datasets, showing competitive performance with respect to state of the art approaches.
Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Oct 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 21; 2023: 8; 2024: 10; 2025: 8; 2026: 3.
75 papers.
Sort:
By area:
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021Deep One-Class Classification via Interpolated Gaussian Descriptorcited by 67
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 49
- 2022Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detectioncited by 47
- 2022SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detectioncited by 45
- 2021Offline Reinforcement Learning as Anti-Explorationcited by 44
- 2021Cross-modal Consensus Network for Weakly Supervised Temporal Action Localizationcited by 34
- 2021Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Videocited by 32
38 more
- 2021Learning Not to Reconstruct Anomaliescited by 31
- 2022Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detectioncited by 27
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2022EVAL: Explainable Video Anomaly Localizationcited by 19
- 2022Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detectioncited by 18
- 2021Learnable Locality-Sensitive Hashing for Video Anomaly Detectioncited by 17
- 2021Applications of Generative Adversarial Networks in Anomaly Detection: A Systematic Literature Reviewcited by 15
- 2024Gazing Into Missteps: Leveraging Eye-Gaze for Unsupervised Mistake Detection in Egocentric Videos of Skilled Human Activitiescited by 15
- 2021Behavior-Driven Synthesis of Human Dynamicscited by 14
- 2021OLED: One-Class Learned Encoder-Decoder Network with Adversarial Context Masking for Novelty Detectioncited by 14
- 2022Stabilizing Adversarially Learned One-Class Novelty Detection Using Pseudo Anomaliescited by 14
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Reviewcited by 13
- 2022Clustering Aided Weakly Supervised Training to Detect Anomalous Events in Surveillance Videoscited by 12
- 2021Context-Dependent Anomaly Detection for Low Altitude Traffic Surveillancecited by 10
- 2021Anomaly Detection in Video Sequences: A Benchmark and Computational Modelcited by 10
- 2023Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approachcited by 10
- 2022Adversarial Machine Learning Attacks Against Video Anomaly Detection Systemscited by 9
- 2021Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregationcited by 8
- 2021A Critical Study on the Recent Deep Learning Based Semi-Supervised Video Anomaly Detection Methodscited by 7
- 2021A Modular and Unified Framework for Detecting and Localizing Video Anomaliescited by 6
- 2024Cross-Domain Learning for Video Anomaly Detection with Limited Supervisioncited by 6
- 2022Anomaly Detection in Echocardiograms with Dynamic Variational Trajectory Modelscited by 5
- 2022Anomaly detection in surveillance videos using transformer based attention modelcited by 4
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLMcited by 4
- 2021CheXseen: Unseen Disease Detection for Deep Learning Interpretation of Chest X-rayscited by 3
- 2021PANDA : Perceptually Aware Neural Detection of Anomaliescited by 3
- 2023Multi-module based CVAE to predict HVCM faults in the SNS acceleratorcited by 3
- 2024Distilling Aggregated Knowledge for Weakly-Supervised Video Anomaly Detectioncited by 3
- 2021Video Anomaly Detection By The Duality Of Normality-Granted Optical Flowcited by 2
- 2022Learning to Adapt to Unseen Abnormal Activities under Weak Supervisioncited by 2
- 2025Anomalies by Synthesis: Anomaly Detection using Generative Diffusion Models for Off-Road Navigationcited by 2
- 2021Anomaly Detection with Prototype-Guided Discriminative Latent Embeddingscited by 1
- 2021Video Abnormal Event Detection by Learning to Complete Visual Cloze Testscited by 1
- 2022Contextual Information Based Anomaly Detection for a Multi-Scene UAV Aerial Videoscited by 1
- 2022Look at Adjacent Frames: Video Anomaly Detection without Offline Trainingcited by 1
- 2022Spatio-Temporal Relation Learning for Video Anomaly Detectioncited by 1
- 2022Towards Realistic Out-of-Distribution Detection: A Novel Evaluation Framework for Improving Generalization in OOD Detectioncited by 1
- 2023CNTS: Cooperative Network for Time Seriescited by 1
50 most cited of 75 All 75 (JSON)
- 2026A Unified Score Matching Paradigm for Video Anomaly Detection and Anticipation8 Oct 2026
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models12 May 2026
- 2026SMT-AD: a scalable quantum-inspired anomaly detection approach7 Apr 2026
- 2025CEDL: Centre-Enhanced Discriminative Learning for Anomaly Detection15 Nov 2025
- 2025An Improved Time Series Anomaly Detection by Applying Structural Similarity24 Sep 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025Anomalies by Synthesis: Anomaly Detection using Generative Diffusion Models for Off-Road Navigation28 May 2025
- 2025Advancing Video Anomaly Detection: A Bi-Directional Hybrid Framework for Enhanced Single- and Multi-Task Approaches20 Apr 2025
- 2025Enhancing Human Motion Prediction via Multi-range Decoupling Decoding with Gating-adjusting Aggregation30 Mar 2025
- 2025Anomaly detection in non-stationary videos using time-recursive differencing network based prediction4 Mar 2025
- 2025Anomaly Detection via Autoencoder Composite Features and NCE4 Feb 2025
- 2024Exploring the Magnitude-Shape Plot Framework for Anomaly Detection in Crowded Video Scenes29 Dec 2024
38 more
- 2024Abnormal Event Detection In Videos Using Deep Embedding15 Sep 2024
- 2024Deep Learning for Video Anomaly Detection: A Review9 Sep 2024
- 2024Cross-Domain Learning for Video Anomaly Detection with Limited Supervision9 Aug 2024
- 2024Enhancing Anomaly Detection Generalization through Knowledge Exposure: The Dual Effects of Augmentation15 Jun 2024
- 2024Gazing Into Missteps: Leveraging Eye-Gaze for Unsupervised Mistake Detection in Egocentric Videos of Skilled Human Activities12 Jun 2024
- 2024Distilling Aggregated Knowledge for Weakly-Supervised Video Anomaly Detection5 Jun 2024
- 2024Hawk: Learning to Understand Open-World Video Anomalies27 May 2024
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detection12 Apr 2024
- 2024Beyond the Known: Adversarial Autoencoders in Novelty Detection6 Apr 2024
- 2023Dynamic Erasing Network Based on Multi-Scale Temporal Features for Weakly Supervised Video Anomaly Detection4 Dec 2023
- 2023Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach27 Nov 2023
- 2023LBL: Logarithmic Barrier Loss Function for One-class Classification20 Jul 2023
- 2023Multi-module based CVAE to predict HVCM faults in the SNS accelerator20 Apr 2023
- 2023DOAD: Decoupled One Stage Action Detection Network1 Apr 2023
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection22 Mar 2023
- 2023CNTS: Cooperative Network for Time Series20 Feb 2023
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Models10 Feb 2023
- 2022EVAL: Explainable Video Anomaly Localization15 Dec 2022
- 2022Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detection8 Dec 2022
- 2022Towards Realistic Out-of-Distribution Detection: A Novel Evaluation Framework for Improving Generalization in OOD Detection20 Nov 2022
- 2022TempNet: Temporal Attention Towards the Detection of Animal Behaviour in Videos17 Nov 2022
- 2022ODBAE: a high-performance model identifying complex phenotypes in high-dimensional biological datasets6 Nov 2022
- 2022Spatio-Temporal Relation Learning for Video Anomaly Detection27 Sep 2022
- 2022Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detection7 Sep 2022
- 2022Look at Adjacent Frames: Video Anomaly Detection without Offline Training27 Jul 2022
- 2022Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detection22 Jul 2022
- 2022SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detection16 Jul 2022
- 2022Anomaly Detection with Adversarially Learned Perturbations of Latent Space3 Jul 2022
- 2022Anomaly Detection in Echocardiograms with Dynamic Variational Trajectory Models30 Jun 2022
- 2022Anomaly detection in surveillance videos using transformer based attention model3 Jun 2022
- 2022Anomaly detection using prediction error with Spatio-Temporal Convolutional LSTM18 May 2022
- 2022Adversarial Machine Learning Attacks Against Video Anomaly Detection Systems7 Apr 2022
- 2022Contextual Information Based Anomaly Detection for a Multi-Scene UAV Aerial Videos29 Mar 2022
- 2022Stabilizing Adversarially Learned One-Class Novelty Detection Using Pseudo Anomalies25 Mar 2022
- 2022Clustering Aided Weakly Supervised Training to Detect Anomalous Events in Surveillance Videos25 Mar 2022
- 2022Learning to Adapt to Unseen Abnormal Activities under Weak Supervision25 Mar 2022
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detection8 Mar 2022
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Review7 Mar 2022
50 newest of 75 All 75 (JSON)
- 2021Offline Reinforcement Learning as Anti-Explorationcited by 44
- 2021Offline Reinforcement Learning as Anti-Exploration11 Jun 2021
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021Deep One-Class Classification via Interpolated Gaussian Descriptorcited by 67
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 49
- 2022Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detectioncited by 47
- 2021Cross-modal Consensus Network for Weakly Supervised Temporal Action Localizationcited by 34
- 2021Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Videocited by 32
- 2021Learning Not to Reconstruct Anomaliescited by 31
- 2022Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detectioncited by 27
12 most cited of 72 All 72 (JSON)
- 2026A Unified Score Matching Paradigm for Video Anomaly Detection and Anticipation8 Oct 2026
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models12 May 2026
- 2026SMT-AD: a scalable quantum-inspired anomaly detection approach7 Apr 2026
- 2025CEDL: Centre-Enhanced Discriminative Learning for Anomaly Detection15 Nov 2025
- 2025An Improved Time Series Anomaly Detection by Applying Structural Similarity24 Sep 2025
- 2025The Evolution of Video Anomaly Detection: A Unified Framework from DNN to MLLM29 Jul 2025
- 2025Advancing Video Anomaly Detection: A Bi-Directional Hybrid Framework for Enhanced Single- and Multi-Task Approaches20 Apr 2025
- 2025Enhancing Human Motion Prediction via Multi-range Decoupling Decoding with Gating-adjusting Aggregation30 Mar 2025
- 2025Anomaly detection in non-stationary videos using time-recursive differencing network based prediction4 Mar 2025
- 2025Anomaly Detection via Autoencoder Composite Features and NCE4 Feb 2025
- 2024Exploring the Magnitude-Shape Plot Framework for Anomaly Detection in Crowded Video Scenes29 Dec 2024
- 2024Abnormal Event Detection In Videos Using Deep Embedding15 Sep 2024
12 newest of 72 All 72 (JSON)