A Lightweight Dual-Branch System for Weakly-Supervised Video Anomaly Detection on Consumer Edge Devices
Not on the map. Why?
Abstract (arXiv)
The growing demand for intelligent security in consumer electronics, such as smart home cameras and personal monitoring systems, is often hindered by the high computational cost and large model sizes of advanced AI. These limitations prevent the effective deployment of real-time Video Anomaly Detection (VAD) on resource-constrained edge devices. To bridge this gap, this paper introduces Rule-based Video Anomaly Detection (RuleVAD), a novel, lightweight system engineered for high-efficiency and low-complexity threat detection directly on consumer hardware. RuleVAD features an innovative decoupled dual-branch architecture to minimize computational load. An implicit branch uses visual features for rapid, coarse-grained binary classification, efficiently filtering out normal activity to avoid unnecessary processing. For potentially anomalous or complex events, a multimodal explicit branch takes over. This branch leverages YOLO-World to detect objects and applies data mining to generate interpretable, text-based association rules from the scene. By aligning these rules with visual data, RuleVAD achieves a more nuanced, fine-grained classification, significantly reducing the false alarms common in vision-only systems. Extensive experiments on the XD-Violence and UCF-Crime benchmark datasets show that RuleVAD achieves superior performance, surpassing existing state-of-the-art methods in both accuracy and speed. Crucially, the entire system is optimized for low-power operation and is fully deployable on an NVIDIA Jetson Nano board, demonstrating its practical feasibility for bringing advanced, real-time security monitoring to everyday consumer electronic devices.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 29 Oct 2024.
Builds on
20 of 41 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
- 2021ClipCap: CLIP Prefix for Image Captioningcited by 559
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
8 more
- 2019Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detectioncited by 171
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 123
- 2022CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detectioncited by 67
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2024Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Promptscited by 40
- 2019WaveletKernelNet: An Interpretable Deep Neural Network for Industrial Intelligent Diagnosiscited by 23
- 2023Weakly-Supervised Video Anomaly Detection with Snippet Anomalous Attentioncited by 15
Built on by
Citing papers per year: 2025: 2.
2 papers.