mlsanityData to 14 Oct 2026

Unveiling the Unseen: A Comprehensive Survey on Explainable Anomaly Detection in Images and Videos

arXiv 2302.06670 ↗First posted 13 Feb 2023cs.LG cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Anomaly detection and localization in visual data, including images and videos, are crucial in machine learning and real-world applications. Despite rapid advancements in visual anomaly detection (VAD), interpreting these often black-box models and explaining why specific instances are flagged as anomalous remains challenging. This paper provides the first comprehensive survey focused specifically on explainable 2D visual anomaly detection (X-VAD), covering methods for both images (IAD) and videos (VAD). We first introduce the background of IAD and VAD. Then, as the core contribution, we present a thorough literature review of explainable methods, categorized by their underlying techniques (e.g., attention-based, generative model-based, reasoning-based, foundation model-based). We analyze the commonalities and differences in applying these methods across image and video modalities, highlighting modality-specific challenges and opportunities for explainability. Additionally, we summarize relevant datasets and evaluation metrics, discussing both standard performance metrics and emerging approaches for assessing explanation quality (e.g., faithfulness, stability). Finally, we discuss promising future directions and open problems, including quantifying explanation quality, explaining diverse AD paradigms (SSL, zero-shot), enhancing context-awareness, leveraging foundation models responsibly, and addressing real-world constraints like efficiency and robustness. A curated collection of related resources is available at https://github.com/wyzjack/Awesome-XAD.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 87 of its 172 references that are in the map. First posted on arXiv 13 Feb 2023.

Builds on

87 of 172 references.

References · 87

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  7. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  9. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  10. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  11. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  12. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
38 more
  1. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  2. 2018Sanity Checks for Saliency Mapscited by 1,156
  3. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  4. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
  5. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  6. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
  7. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
  8. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
  9. 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
  10. 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
  11. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  12. 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
  13. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  14. 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
  15. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  16. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  17. 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
  18. 2020A Survey on Neural Network Interpretabilitycited by 291
  19. 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
  20. 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
  21. 2022A Unified Model for Multi-class Anomaly Detectioncited by 268
  22. 2016Learning Temporal Regularity in Video Sequencescited by 254
  23. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
  24. 2022Diffusion Models for Medical Anomaly Detectioncited by 232
  25. 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 227
  26. 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 223
  27. 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
  28. 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
  29. 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
  30. 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
  31. 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
  32. 2018Latent Space Autoregression for Novelty Detectioncited by 149
  33. 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 148
  34. 2021Student-Teacher Feature Pyramid Matching for Anomaly Detectioncited by 146
  35. 2019Segmentation-Based Deep-Learning Approach for Surface-Defect Detectioncited by 145
  36. 2020Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encodercited by 145
  37. 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 138
  38. 2021A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Predictioncited by 129

50 most cited of 87 All 87 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 0; 2025: 2; 2026: 3.

7 papers.