mlsanityData to 7 Oct 2026

MiMICRI: Towards Domain-centered Counterfactual Explanations of Cardiovascular Image Classification Models

arXiv 2404.16174 ↗First posted 24 Apr 2024cs.HC cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The recent prevalence of publicly accessible, large medical imaging datasets has led to a proliferation of artificial intelligence (AI) models for cardiovascular image classification and analysis. At the same time, the potentially significant impacts of these models have motivated the development of a range of explainable AI (XAI) methods that aim to explain model predictions given certain image inputs. However, many of these methods are not developed or evaluated with domain experts, and explanations are not contextualized in terms of medical expertise or domain knowledge. In this paper, we propose a novel framework and python library, MiMICRI, that provides domain-centered counterfactual explanations of cardiovascular image classification models. MiMICRI helps users interactively select and replace segments of medical images that correspond to morphological structures. From the counterfactuals generated, users can then assess the influence of each segment on model predictions, and validate the model against known medical facts. We evaluate this library with two medical experts. Our evaluation demonstrates that a domain-centered XAI approach can enhance the interpretability of model explanations, and help experts reason about models in terms of relevant domain knowledge. However, concerns were also surfaced about the clinical plausibility of the counterfactuals generated. We conclude with a discussion on the generalizability and trustworthiness of the MiMICRI framework, as well as the implications of our findings on the development of domain-centered XAI methods for model interpretability in healthcare contexts.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 84 references that are in the map. First posted on arXiv 24 Apr 2024.

Builds on

44 of 84 references.

References · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2023Segment Anythingcited by 8,158
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  7. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  8. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  9. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  10. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  11. 2018Sanity Checks for Saliency Mapscited by 1,149
  12. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
32 more
  1. 2017Adversarial Attacks on Neural Network Policiescited by 314
  2. 2023Segment Anything in Medical Imagescited by 226
  3. 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
  4. 2016Grad-CAM: Why did you say that?cited by 159
  5. 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
  6. 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
  7. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
  8. 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
  9. 2019Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptionscited by 81
  10. 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
  11. 2022Impossibility Theorems for Feature Attributioncited by 78
  12. 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 75
  13. 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
  14. 2023Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentationcited by 51
  15. 2020GANterfactual - Counterfactual Explanations for Medical Non-Experts using Generative Adversarial Learningcited by 50
  16. 2020CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysiscited by 40
  17. 2021STEEX: Steering Counterfactual Explanations with Semanticscited by 40
  18. 2020DECE: Decision Explorer with Counterfactual Explanations for Machine Learning Modelscited by 38
  19. 2020ViCE: Visual Counterfactual Explanations for Machine Learning Modelscited by 34
  20. 2020OoDAnalyzer: Interactive Analysis of Out-of-Distribution Samplescited by 33
  21. 2020Analyzing the Noise Robustness of Deep Neural Networkscited by 31
  22. 2022Making Heads or Tails: Towards Semantically Consistent Visual Counterfactualscited by 30
  23. 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
  24. 2018Recurrent neural networks for aortic image sequence segmentation with sparse annotationscited by 25
  25. 2020Trust and Medical AI: The challenges we face and the expertise needed to overcome themcited by 21
  26. 2023Red Teaming Deep Neural Networks with Feature Synthesis Toolscited by 21
  27. 2022ConceptExplainer: Interactive Explanation for Deep Neural Networks from a Concept Perspectivecited by 18
  28. 2018Brain Biomarker Interpretation in ASD Using Deep Learning and fMRIcited by 9
  29. 2021AdViCE: Aggregated Visual Counterfactual Explanations for Machine Learning Model Validationcited by 7
  30. 2022DASH: Visual Analytics for Debiasing Image Classification via User-Driven Synthetic Data Augmentationcited by 7
  31. 2019Effect of Superpixel Aggregation on Explanations in LIME -- A Case Study with Biological Datacited by 5
  32. 2022Interpretable Prediction of Pulmonary Hypertension in Newborns using Echocardiogramscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.