Unveiling the Unseen: A Comprehensive Survey on Explainable Anomaly Detection in Images and Videos
Not on the map. Why?
Abstract (arXiv)
Anomaly detection and localization in visual data, including images and videos, are crucial in machine learning and real-world applications. Despite rapid advancements in visual anomaly detection (VAD), interpreting these often black-box models and explaining why specific instances are flagged as anomalous remains challenging. This paper provides the first comprehensive survey focused specifically on explainable 2D visual anomaly detection (X-VAD), covering methods for both images (IAD) and videos (VAD). We first introduce the background of IAD and VAD. Then, as the core contribution, we present a thorough literature review of explainable methods, categorized by their underlying techniques (e.g., attention-based, generative model-based, reasoning-based, foundation model-based). We analyze the commonalities and differences in applying these methods across image and video modalities, highlighting modality-specific challenges and opportunities for explainability. Additionally, we summarize relevant datasets and evaluation metrics, discussing both standard performance metrics and emerging approaches for assessing explanation quality (e.g., faithfulness, stability). Finally, we discuss promising future directions and open problems, including quantifying explanation quality, explaining diverse AD paradigms (SSL, zero-shot), enhancing context-awareness, leveraging foundation models responsibly, and addressing real-world constraints like efficiency and robustness. A curated collection of related resources is available at https://github.com/wyzjack/Awesome-XAD.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 87 of its 172 references that are in the map. First posted on arXiv 13 Feb 2023.
Builds on
87 of 172 references.
References · 87
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
38 more
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2022A Unified Model for Multi-class Anomaly Detectioncited by 268
- 2016Learning Temporal Regularity in Video Sequencescited by 254
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
- 2022Diffusion Models for Medical Anomaly Detectioncited by 232
- 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 227
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 223
- 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
- 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2018Latent Space Autoregression for Novelty Detectioncited by 149
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 148
- 2021Student-Teacher Feature Pyramid Matching for Anomaly Detectioncited by 146
- 2019Segmentation-Based Deep-Learning Approach for Surface-Defect Detectioncited by 145
- 2020Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encodercited by 145
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 138
- 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129
50 most cited of 87 All 87 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 2; 2026: 3.
7 papers.
- 2023VaQuitA: Enhancing Alignment in LLM-Assisted Video Understandingcited by 18
- 2023Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?cited by 8
- 2025BalancEdit: Dynamically Balancing the Generality-Locality Trade-off in Multi-modal Model Editingcited by 7
- 2026FoMo X: Modular Explainability Signals for Outlier Detection Foundation Modelscited by 2
- 2026Benchmarking Compact VLMs for Clip-Level Surveillance Anomaly Detection Under Weak Supervisioncited by 1
- 2025Research on Anomaly Detection Methods Based on Diffusion Modelscited by 0
- 2026Augmenting Visual Anomaly Detection with Automated Interpretabilitycited by 0
- 2026Augmenting Visual Anomaly Detection with Automated Interpretability27 Sep 2026
- 2026FoMo X: Modular Explainability Signals for Outlier Detection Foundation Models18 Mar 2026
- 2026Benchmarking Compact VLMs for Clip-Level Surveillance Anomaly Detection Under Weak Supervision3 Mar 2026
- 2025Research on Anomaly Detection Methods Based on Diffusion Models8 May 2025
- 2025BalancEdit: Dynamically Balancing the Generality-Locality Trade-off in Multi-modal Model Editing2 May 2025
- 2023VaQuitA: Enhancing Alignment in LLM-Assisted Video Understanding4 Dec 2023
- 2023Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?14 Sep 2023