mlsanityData to 14 Oct 2026

Explainable Artificial Intelligence in Biomedical Image Analysis: A Comprehensive Survey

arXiv 2507.07148 ↗First posted 9 Jul 2025cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Explainable artificial intelligence (XAI) has become increasingly important in biomedical image analysis to promote transparency, trust, and clinical adoption of DL models. While several surveys have reviewed XAI techniques, they often lack a modality-aware perspective, overlook recent advances in multimodal and vision-language paradigms, and provide limited practical guidance. This survey addresses this gap through a comprehensive and structured synthesis of XAI methods tailored to biomedical image analysis.We systematically categorize XAI methods, analyzing their underlying principles, strengths, and limitations within biomedical contexts. A modality-centered taxonomy is proposed to align XAI methods with specific imaging types, highlighting the distinct interpretability challenges across modalities. We further examine the emerging role of multimodal learning and vision-language models in explainable biomedical AI, a topic largely underexplored in previous work. Our contributions also include a summary of widely used evaluation metrics and open-source frameworks, along with a critical discussion of persistent challenges and future directions. This survey offers a timely and in-depth foundation for advancing interpretable DL in biomedical image analysis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 68 of its 251 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

68 of 251 references.

References · 68

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  6. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  7. 2015VQA: Visual Question Answeringcited by 2,506
  8. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  9. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  10. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  11. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  12. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
38 more
  1. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  2. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  3. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  4. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  5. 2020Concept Bottleneck Modelscited by 1,032
  6. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  7. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  8. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
  9. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 824
  10. 2020Quantifying Attention Flow in Transformerscited by 775
  11. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
  12. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  13. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  14. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
  15. 2016Visual Dialogcited by 377
  16. 2016Top-down Neural Attention by Excitation Backpropcited by 321
  17. 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 262
  18. 2017Real Time Image Saliency for Black Box Classifierscited by 246
  19. 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
  20. 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
  21. 2019Full-Gradient Representation for Neural Network Visualizationcited by 191
  22. 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 189
  23. 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
  24. 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 126
  25. 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
  26. 2019XRAI: Better Attributions Through Regionscited by 116
  27. 2020Explainable deep learning models in medical image analysiscited by 111
  28. 2021Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methodscited by 83
  29. 2020Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networkscited by 79
  30. 2018Deep Feature Factorization For Concept Discoverycited by 64
  31. 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
  32. 2020Reliable Tuberculosis Detection using Chest X-ray with Deep Learning, Segmentation and Visualizationcited by 50
  33. 2020SS-CAM: Smoothed Score-CAM for Sharper Visual Feature Localizationcited by 46
  34. 2022Explainable Deep Learning Methods in Medical Image Classification: A Surveycited by 32
  35. 2019Explaining Models by Propagating Shapley Values of Local Componentscited by 29
  36. 2020IS-CAM: Integrated Score-CAM for axiomatic-based explanationscited by 29
  37. 2022Explaining Chest X-ray Pathologies in Natural Languagecited by 27
  38. 2023Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosiscited by 26

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Foundation Models in Medical Image Analysis: A Systematic Review and Meta-Analysis
  2. 2026MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models
  3. 2026XAI-CLIP: ROI-Guided Perturbation Framework for Explainable Medical Image Segmentation in Multimodal Vision-Language Models
  4. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Review
  5. 2025An Explainable Biomedical Foundation Model via Large-Scale Concept-Enhanced Vision-Language Pre-training
  6. 2025Human-aligned Deep Learning: Explainability, Causality, and Biological Inspiration
  7. 2025From Explainable to Explained AI: Ideas for Falsifying and Quantifying Explanations
  8. 2024Envisioning MedCLIP: A Deep Dive into Explainability for Medical Vision-Language Models