mlsanityData to 7 Oct 2026

Instance-Aligned Captions for Explainable Video Anomaly Detection

arXiv 2601.08155 ↗First posted 13 Jan 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Explainable video anomaly detection (VAD) is crucial for safety-critical applications, yet even with recent progress, much of the research still lacks spatial grounding, making the explanations unverifiable. This limitation is especially pronounced in multi-entity interactions, where existing explainable VAD methods often produce incomplete or visually misaligned descriptions, reducing their trustworthiness. To address these challenges, we introduce instance-aligned captions that link each textual claim to specific object instances with appearance and motion attributes. Our framework captures who caused the anomaly, what each entity was doing, whom it affected, and where the explanationis grounded, enabling verifiable and actionable reasoning. We annotate eight widely used VAD benchmarks and extend the 360-degree egocentric dataset, VIEW360, with 868 additional videos, eight locations, and four new anomaly types, creating VIEW360+, a comprehensive testbed for explainable VAD. Experiments show that our instance-level spatially grounded captions reveal significant limitations in current LLM- and VLM-based methods while providing a robust benchmark for future research in trustworthy and interpretable anomaly detection.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

46 of 60 references.

References · 46

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  4. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  5. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  6. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  7. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
  8. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
  9. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  10. 2016Learning Temporal Regularity in Video Sequencescited by 254
  11. 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
  12. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 220
34 more
  1. 2022Language as Queries for Referring Video Object Segmentationcited by 180
  2. 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
  3. 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
  4. 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
  5. 2020Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentencescited by 116
  6. 2016Deep Structured Energy Based Models for Anomaly Detectioncited by 113
  7. 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
  8. 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
  9. 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
  10. 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
  11. 2023OnlineRefer: A Simple Online Baseline for Referring Video Object Segmentationcited by 62
  12. 2023Open-Vocabulary Video Anomaly Detectioncited by 57
  13. 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
  14. 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
  15. 2020Localizing Anomalies from Weakly-Labeled Videoscited by 52
  16. 2024VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videoscited by 51
  17. 2023PG-Video-LLaVA: Pixel Grounding Large Video-Language Modelscited by 50
  18. 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
  19. 2022Grounding Answers for Visual Questions Asked by Visually Impaired Peoplecited by 47
  20. 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
  21. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  22. 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
  23. 2024Uncovering What, Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomalycited by 44
  24. 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
  25. 2023Tracking with Human-Intent Reasoningcited by 32
  26. 2025Pixel-SAIL: Single Transformer For Pixel-Grounded Understandingcited by 22
  27. 2023Discovering Spatio-Temporal Rationales for Video Question Answeringcited by 21
  28. 2015Real-Time Anomaly Detection and Localization in Crowded Scenescited by 20
  29. 2022Locate before Answering: Answer Guided Question Localization for Video Question Answeringcited by 19
  30. 2025Commonsense Video Question Answering through Video-Grounded Entailment Tree Reasoningcited by 11
  31. 2024ActionVOS: Actions as Prompts for Video Object Segmentationcited by 8
  32. 2025Real-time Traffic Accident Anticipation with Feature Reusecited by 8
  33. 2024Anomaly Detection for People with Visual Impairments Using an Egocentric 360-Degree Cameracited by 7
  34. 2025CaptionFormer: Unified Segmentation, Tracking, and Captioning for Spatio-Temporal Objectscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Quo Vadis, Anomaly Detection? LLMs and VLMs in the Spotlight
  2. 2026Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection
  3. 2025VADER: Towards Causal Video Anomaly Understanding with Relation-Aware Large Language Models
  4. 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models
  5. 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection
  6. 2025Knowledge-Guided Textual Reasoning for Explainable Video Anomaly Detection via LLMs
  7. 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection
  8. 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection