IBO: Inpainting-Based Occlusion to Enhance Explainable Artificial Intelligence Evaluation in Histopathology
Not on the map. Why?
Abstract (arXiv)
Histopathological image analysis is crucial for accurate cancer diagnosis and treatment planning. While deep learning models, especially convolutional neural networks, have advanced this field, their "black-box" nature raises concerns about interpretability and trustworthiness. Explainable Artificial Intelligence (XAI) techniques aim to address these concerns, but evaluating their effectiveness remains challenging. A significant issue with current occlusion-based XAI methods is that they often generate Out-of-Distribution (OoD) samples, leading to inaccurate evaluations. In this paper, we introduce Inpainting-Based Occlusion (IBO), a novel occlusion strategy that utilizes a Denoising Diffusion Probabilistic Model to inpaint occluded regions in histopathological images. By replacing cancerous areas with realistic, non-cancerous tissue, IBO minimizes OoD artifacts and preserves data integrity. We evaluate our method on the CAMELYON16 dataset through two phases: first, by assessing perceptual similarity using the Learned Perceptual Image Patch Similarity (LPIPS) metric, and second, by quantifying the impact on model predictions through Area Under the Curve (AUC) analysis. Our results demonstrate that IBO significantly improves perceptual fidelity, achieving nearly twice the improvement in LPIPS scores compared to the best existing occlusion strategy. Additionally, IBO increased the precision of XAI performance prediction from 42% to 71% compared to traditional methods. These results demonstrate IBO's potential to provide more reliable evaluations of XAI techniques, benefiting histopathology and other applications. The source code for this study is available at https://github.com/a-fsh-r/IBO.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
28 of 49 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 416
- 2017The (Un)reliability of saliency methodscited by 331
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
16 more
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2019Full-Gradient Representation for Neural Network Visualizationcited by 189
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
- 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2019Sanity Checks for Saliency Metricscited by 119
- 2022A Consistent and Efficient Evaluation Strategy for Attribution Methodscited by 100
- 2022Framework for Evaluating Faithfulness of Local Explanationscited by 55
- 2019Deep Learning for Whole Slide Image Analysis: An Overviewcited by 51
- 2022Metrics for saliency map evaluation of deep learning explanation methodscited by 40
- 2020What Do You See? Evaluation of Explainable Artificial Intelligence (XAI) Interpretability through Neural Backdoorscited by 32
- 2024A comprehensive study on fidelity metrics for XAIcited by 14
- 2020Achievements and Challenges in Explaining Deep Learning based Computer-Aided Diagnosis Systemscited by 7
- 2023TbExplain: A Text-based Explanation Method for Scene Classification Models with the Statistical Prediction Correctioncited by 4
- 2024Wavelet Analysis of Noninvasive EEG Signals Discriminates Complex and Natural Grasp Typescited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Photorealistic Inpainting for Perturbation-based Explanations in Ecological Monitoringcited by 2
- 2025Learning Multimodal AI Algorithms for Amplifying Limited User Input into High-dimensional Control Spacecited by 1
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendationscited by 0
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2025Photorealistic Inpainting for Perturbation-based Explanations in Ecological Monitoring1 Oct 2025
- 2025Learning Multimodal AI Algorithms for Amplifying Limited User Input into High-dimensional Control Space16 May 2025
Similar, not cited
Close in wording, no citation either way
- 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathology
- 2024Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs
- 2026Controllable Diffusion-Based Lesion Inpainting for Scalable Histopathology Data Augmentation
- 2024A Mixture of Experts (MoE) model to improve AI-based computational pathology prediction performance under variable levels of histopathology image blur
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images
- 2026Diffusion Models in Medical Image Inpainting: Challenges, Solution Taxonomy, and Future Directions
- 2024LatentArtiFusion: An Effective and Efficient Histological Artifacts Restoration Framework
- 2023ViT-DAE: Transformer-driven Diffusion Autoencoder for Histopathology Image Analysis