mlsanityData to 7 Oct 2026

IBO: Inpainting-Based Occlusion to Enhance Explainable Artificial Intelligence Evaluation in Histopathology

arXiv 2408.16395 ↗First posted 29 Aug 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Histopathological image analysis is crucial for accurate cancer diagnosis and treatment planning. While deep learning models, especially convolutional neural networks, have advanced this field, their "black-box" nature raises concerns about interpretability and trustworthiness. Explainable Artificial Intelligence (XAI) techniques aim to address these concerns, but evaluating their effectiveness remains challenging. A significant issue with current occlusion-based XAI methods is that they often generate Out-of-Distribution (OoD) samples, leading to inaccurate evaluations. In this paper, we introduce Inpainting-Based Occlusion (IBO), a novel occlusion strategy that utilizes a Denoising Diffusion Probabilistic Model to inpaint occluded regions in histopathological images. By replacing cancerous areas with realistic, non-cancerous tissue, IBO minimizes OoD artifacts and preserves data integrity. We evaluate our method on the CAMELYON16 dataset through two phases: first, by assessing perceptual similarity using the Learned Perceptual Image Patch Similarity (LPIPS) metric, and second, by quantifying the impact on model predictions through Area Under the Curve (AUC) analysis. Our results demonstrate that IBO significantly improves perceptual fidelity, achieving nearly twice the improvement in LPIPS scores compared to the best existing occlusion strategy. Additionally, IBO increased the precision of XAI performance prediction from 42% to 71% compared to traditional methods. These results demonstrate IBO's potential to provide more reliable evaluations of XAI techniques, benefiting histopathology and other applications. The source code for this study is available at https://github.com/a-fsh-r/IBO.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 29 Aug 2024.

Builds on

28 of 49 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  6. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  7. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  8. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  9. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
  10. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 416
  11. 2017The (Un)reliability of saliency methodscited by 331
  12. 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
16 more
  1. 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
  2. 2019Full-Gradient Representation for Neural Network Visualizationcited by 189
  3. 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
  4. 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
  5. 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
  6. 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
  7. 2019Sanity Checks for Saliency Metricscited by 119
  8. 2022A Consistent and Efficient Evaluation Strategy for Attribution Methodscited by 100
  9. 2022Framework for Evaluating Faithfulness of Local Explanationscited by 55
  10. 2019Deep Learning for Whole Slide Image Analysis: An Overviewcited by 51
  11. 2022Metrics for saliency map evaluation of deep learning explanation methodscited by 40
  12. 2020What Do You See? Evaluation of Explainable Artificial Intelligence (XAI) Interpretability through Neural Backdoorscited by 32
  13. 2024A comprehensive study on fidelity metrics for XAIcited by 14
  14. 2020Achievements and Challenges in Explaining Deep Learning based Computer-Aided Diagnosis Systemscited by 7
  15. 2023TbExplain: A Text-based Explanation Method for Scene Classification Models with the Statistical Prediction Correctioncited by 4
  16. 2024Wavelet Analysis of Noninvasive EEG Signals Discriminates Complex and Natural Grasp Typescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathology
  2. 2024Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs
  3. 2026Controllable Diffusion-Based Lesion Inpainting for Scalable Histopathology Data Augmentation
  4. 2024A Mixture of Experts (MoE) model to improve AI-based computational pathology prediction performance under variable levels of histopathology image blur
  5. 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images
  6. 2026Diffusion Models in Medical Image Inpainting: Challenges, Solution Taxonomy, and Future Directions
  7. 2024LatentArtiFusion: An Effective and Efficient Histological Artifacts Restoration Framework
  8. 2023ViT-DAE: Transformer-driven Diffusion Autoencoder for Histopathology Image Analysis