MiMICRI: Towards Domain-centered Counterfactual Explanations of Cardiovascular Image Classification Models
Not on the map. Why?
Abstract (arXiv)
The recent prevalence of publicly accessible, large medical imaging datasets has led to a proliferation of artificial intelligence (AI) models for cardiovascular image classification and analysis. At the same time, the potentially significant impacts of these models have motivated the development of a range of explainable AI (XAI) methods that aim to explain model predictions given certain image inputs. However, many of these methods are not developed or evaluated with domain experts, and explanations are not contextualized in terms of medical expertise or domain knowledge. In this paper, we propose a novel framework and python library, MiMICRI, that provides domain-centered counterfactual explanations of cardiovascular image classification models. MiMICRI helps users interactively select and replace segments of medical images that correspond to morphological structures. From the counterfactuals generated, users can then assess the influence of each segment on model predictions, and validate the model against known medical facts. We evaluate this library with two medical experts. Our evaluation demonstrates that a domain-centered XAI approach can enhance the interpretability of model explanations, and help experts reason about models in terms of relevant domain knowledge. However, concerns were also surfaced about the clinical plausibility of the counterfactuals generated. We conclude with a discussion on the generalizability and trustworthiness of the MiMICRI framework, as well as the implications of our findings on the development of domain-centered XAI methods for model interpretability in healthcare contexts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 84 references that are in the map. First posted on arXiv 24 Apr 2024.
Builds on
44 of 84 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2023Segment Anythingcited by 8,158
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
32 more
- 2017Adversarial Attacks on Neural Network Policiescited by 314
- 2023Segment Anything in Medical Imagescited by 226
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2016Grad-CAM: Why did you say that?cited by 159
- 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
- 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
- 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
- 2019Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptionscited by 81
- 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
- 2022Impossibility Theorems for Feature Attributioncited by 78
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 75
- 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
- 2023Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentationcited by 51
- 2020GANterfactual - Counterfactual Explanations for Medical Non-Experts using Generative Adversarial Learningcited by 50
- 2020CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysiscited by 40
- 2021STEEX: Steering Counterfactual Explanations with Semanticscited by 40
- 2020DECE: Decision Explorer with Counterfactual Explanations for Machine Learning Modelscited by 38
- 2020ViCE: Visual Counterfactual Explanations for Machine Learning Modelscited by 34
- 2020OoDAnalyzer: Interactive Analysis of Out-of-Distribution Samplescited by 33
- 2020Analyzing the Noise Robustness of Deep Neural Networkscited by 31
- 2022Making Heads or Tails: Towards Semantically Consistent Visual Counterfactualscited by 30
- 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
- 2018Recurrent neural networks for aortic image sequence segmentation with sparse annotationscited by 25
- 2020Trust and Medical AI: The challenges we face and the expertise needed to overcome themcited by 21
- 2023Red Teaming Deep Neural Networks with Feature Synthesis Toolscited by 21
- 2022ConceptExplainer: Interactive Explanation for Deep Neural Networks from a Concept Perspectivecited by 18
- 2018Brain Biomarker Interpretation in ASD Using Deep Learning and fMRIcited by 9
- 2021AdViCE: Aggregated Visual Counterfactual Explanations for Machine Learning Model Validationcited by 7
- 2022DASH: Visual Analytics for Debiasing Image Classification via User-Driven Synthetic Data Augmentationcited by 7
- 2019Effect of Superpixel Aggregation on Explanations in LIME -- A Case Study with Biological Datacited by 5
- 2022Interpretable Prediction of Pulmonary Hypertension in Newborns using Echocardiogramscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.