mlsanityData to 7 Oct 2026

xAI-CV: An Overview of Explainable Artificial Intelligence in Computer Vision

arXiv 2509.18913 ↗First posted 23 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning has become the de facto standard and dominant paradigm in image analysis tasks, achieving state-of-the-art performance. However, this approach often results in "black-box" models, whose decision-making processes are difficult to interpret, raising concerns about reliability in critical applications. To address this challenge and provide human a method to understand how AI model process and make decision, the field of xAI has emerged. This paper surveys four representative approaches in xAI for visual perception tasks: (i) Saliency Maps, (ii) Concept Bottleneck Models (CBM), (iii) Prototype-based methods, and (iv) Hybrid approaches. We analyze their underlying mechanisms, strengths and limitations, as well as evaluation metrics, thereby providing a comprehensive overview to guide future research and applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 36 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

28 of 36 references.

References · 28

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  4. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  5. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  6. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  7. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  8. 2018Sanity Checks for Saliency Mapscited by 1,149
  9. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  10. 2020Concept Bottleneck Modelscited by 1,022
  11. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  12. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
16 more
  1. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  2. 2020Quantifying Attention Flow in Transformerscited by 759
  3. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
  4. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  5. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  6. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 416
  7. 2022Post-hoc Concept Bottleneck Modelscited by 289
  8. 2023Label-Free Concept Bottleneck Modelscited by 282
  9. 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 213
  10. 2021Do Concept Bottleneck Models Learn as Intended?cited by 114
  11. 2023Probabilistic Concept Bottleneck Modelscited by 101
  12. 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
  13. 2020Assessing the (Un)Trustworthiness of Saliency Maps for Localizing Abnormalities in Medical Imagingcited by 32
  14. 2023Attention-based Saliency Maps Improve Interpretability of Pneumothorax Classificationcited by 13
  15. 2024Why do explanations fail? A typology and discussion on failures in XAIcited by 6
  16. 2025Concept-Based Explainable Artificial Intelligence: Metrics and Benchmarkscited by 5

Built on by

Not cited yet.