mlsanityData to 7 Oct 2026

VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models

arXiv 2511.07299 ↗First posted 10 Nov 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Video anomaly understanding (VAU) aims to provide detailed interpretation and semantic comprehension of anomalous events within videos, addressing limitations of traditional methods that focus solely on detecting and localizing anomalies. However, existing approaches often neglect the deeper causal relationships and interactions between objects, which are critical for understanding anomalous behaviors. In this paper, we propose VADER, an LLM-driven framework for Video Anomaly unDErstanding, which integrates keyframe object Relation features with visual cues to enhance anomaly comprehension from video. Specifically, VADER first applies an Anomaly Scorer to assign per-frame anomaly scores, followed by a Context-AwarE Sampling (CAES) strategy to capture the causal context of each anomalous event. A Relation Feature Extractor and a COntrastive Relation Encoder (CORE) jointly model dynamic object interactions, producing compact relational representations for downstream reasoning. These visual and relational cues are integrated with LLMs to generate detailed, causally grounded descriptions and support robust anomaly-related question answering. Experiments on multiple real-world VAU benchmarks demonstrate that VADER achieves strong results across anomaly description, explanation, and causal reasoning tasks, advancing the frontier of explainable video anomaly analysis.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 54 of its 73 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

54 of 73 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  9. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  10. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  11. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  12. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
38 more
  1. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  2. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  3. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  4. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  5. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
  6. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  7. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  8. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
  9. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
  10. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  11. 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 548
  12. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  13. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  14. 2023PandaGPT: One Model To Instruction-Follow Them Allcited by 330
  15. 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
  16. 2016Learning Temporal Regularity in Video Sequencescited by 254
  17. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
  18. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
  19. 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 157
  20. 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
  21. 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
  22. 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
  23. 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
  24. 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
  25. 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
  26. 2023Segment Any Anomaly without Training via Hybrid Prompt Regularizationcited by 59
  27. 2017Abnormal Event Detection in Videos using Spatiotemporal Autoencodercited by 57
  28. 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
  29. 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
  30. 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
  31. 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 45
  32. 2024Uncovering What, Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomalycited by 44
  33. 2020Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Predictioncited by 42
  34. 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
  35. 2023Diversity-Measurable Anomaly Detectioncited by 41
  36. 2023Delving into CLIP latent space for Video Anomaly Recognitioncited by 27
  37. 2024Large Language Models for Anomaly and Out-of-Distribution Detection: A Surveycited by 24
  38. 2023BatchNorm-based Weakly Supervised Video Anomaly Detectioncited by 22

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VAU-R1: Advancing Video Anomaly Understanding via Reinforcement Fine-Tuning
  2. 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method
  3. 2024Quo Vadis, Anomaly Detection? LLMs and VLMs in the Spotlight
  4. 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models
  5. 2026PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding
  6. 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Models
  7. 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
  8. 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding