VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models
Not on the map. Why?
Abstract (arXiv)
Video anomaly understanding (VAU) aims to provide detailed interpretation and semantic comprehension of anomalous events within videos, addressing limitations of traditional methods that focus solely on detecting and localizing anomalies. However, existing approaches often neglect the deeper causal relationships and interactions between objects, which are critical for understanding anomalous behaviors. In this paper, we propose VADER, an LLM-driven framework for Video Anomaly unDErstanding, which integrates keyframe object Relation features with visual cues to enhance anomaly comprehension from video. Specifically, VADER first applies an Anomaly Scorer to assign per-frame anomaly scores, followed by a Context-AwarE Sampling (CAES) strategy to capture the causal context of each anomalous event. A Relation Feature Extractor and a COntrastive Relation Encoder (CORE) jointly model dynamic object interactions, producing compact relational representations for downstream reasoning. These visual and relational cues are integrated with LLMs to generate detailed, causally grounded descriptions and support robust anomaly-related question answering. Experiments on multiple real-world VAU benchmarks demonstrate that VADER achieves strong results across anomaly description, explanation, and causal reasoning tasks, advancing the frontier of explainable video anomaly analysis.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 54 of its 73 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
54 of 73 references.
References · 54
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Visual Instruction Tuningcited by 7,792
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
38 more
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 548
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2023PandaGPT: One Model To Instruction-Follow Them Allcited by 330
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 157
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Segment Any Anomaly without Training via Hybrid Prompt Regularizationcited by 59
- 2017Abnormal Event Detection in Videos using Spatiotemporal Autoencodercited by 57
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
- 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
- 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 45
- 2024Uncovering What, Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomalycited by 44
- 2020Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Predictioncited by 42
- 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
- 2023Diversity-Measurable Anomaly Detectioncited by 41
- 2023Delving into CLIP latent space for Video Anomaly Recognitioncited by 27
- 2024Large Language Models for Anomaly and Out-of-Distribution Detection: A Surveycited by 24
- 2023BatchNorm-based Weakly Supervised Video Anomaly Detectioncited by 22
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuning
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method
- 2024Quo Vadis, Anomaly Detection? LLMs and VLMs in the Spotlight
- 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models
- 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Models
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding