QVAD: A Question-Centric Agentic Framework for Efficient and Training-Free Video Anomaly Detection
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Video Anomaly Detection (VAD) is a fundamental challenge in computer vision, particularly due to the open-set nature of anomalies. While recent training-free approaches utilizing Vision-Language Models (VLMs) have shown promise, they typically rely on massive, resource-intensive foundation models to compensate for the ambiguity of static prompts. We argue that the bottleneck in VAD is not necessarily model capacity, but rather the static nature of inquiry. We propose QVAD, a question-centric agentic framework that treats VLM-LLM interaction as a dynamic dialogue. By iteratively refining queries based on visual context, our LLM agent guides smaller VLMs to produce high-fidelity captions and precise semantic reasoning without parameter updates. This ``prompt-updating" mechanism effectively unlocks the latent capabilities of lightweight models, enabling state-of-the-art performance on UCF-Crime, XD-Violence, and UBNormal using a fraction of the parameters required by competing methods. We further demonstrate exceptional generalizability on the single-scene ComplexVAD dataset. Crucially, QVAD achieves high inference speeds with minimal memory footprints, making advanced VAD capabilities deployable on resource-constrained edge devices.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 24 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
18 of 24 references.
References · 18
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 91
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
6 more
- 2023Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectorscited by 37
- 2025EventVAD: Training-Free Event-Aware Video Anomaly Detectioncited by 32
- 2024Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baselinecited by 17
- 2025PANDA: Towards Generalist Video Anomaly Detection via Agentic AI Engineercited by 15
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Treecited by 15
- 2025ComplexVAD: Detecting Interaction Anomalies in Videocited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Prompting
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection
- 2026AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detection
- 2026Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding
- 2025SlowFastVAD: Video Anomaly Detection via Integrating Simple Detector and RAG-Enhanced Vision-Language Model
- 2026GridVAD: Open-Set Video Anomaly Detection via Spatial Reasoning over Stratified Frame Grids