IAIA-BL: A Case-based Interpretable Deep Learning Model for Classification of Mass Lesions in Digital Mammography
Not on the map. Why?
Abstract (arXiv)
Interpretability in machine learning models is important in high-stakes decisions, such as whether to order a biopsy based on a mammographic exam. Mammography poses important challenges that are not present in other computer vision tasks: datasets are small, confounding information is present, and it can be difficult even for a radiologist to decide between watchful waiting and biopsy based on a mammogram alone. In this work, we present a framework for interpretable machine learning-based mammography. In addition to predicting whether a lesion is malignant or benign, our work aims to follow the reasoning processes of radiologists in detecting clinically relevant semantic features of each image, such as the characteristics of the mass margins. The framework includes a novel interpretable neural network algorithm that uses case-based reasoning for mammography. Our algorithm can incorporate a combination of data with whole image labelling and data with pixel-wise annotations, leading to better accuracy and interpretability even with a small number of images. Our interpretable models are able to highlight the classification-relevant parts of the image, whereas other methods highlight healthy tissue and confounding information. Our models are decision aids, rather than decision makers, aimed at better overall human-machine collaboration. We do not observe a loss in mass margin classification accuracy over a black box neural network trained on the same data.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). Builds on 22 of its 66 references that are in the map. First posted on arXiv 23 Mar 2021.
Builds on
22 of 66 references.
References · 22
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
- 2020Noise or Signal: The Role of Image Backgrounds in Object Recognitioncited by 342
- 2020Concept Whitening for Interpretable Image Recognitioncited by 225
- 2014A Convolutional Neural Network for Modelling Sentencescited by 163
- 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 141
10 more
- 2019Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screeningcited by 94
- 2020Stratified Rule-Aware Network for Abstract Visual Reasoningcited by 72
- 2018Deep Learning Predicts Hip Fracture using Confounding Patient and Healthcare Variablescited by 50
- 2020Mitigating Gender Bias in Captioning Systemscited by 50
- 2020Assessing the (Un)Trustworthiness of Saliency Maps for Localizing Abnormalities in Medical Imagingcited by 32
- 2018DeepMiner: Discovering Interpretable Representations for Mammogram Classification and Explanationcited by 9
- 2018Removing Confounding Factors Associated Weights in Deep Neural Networks Improves the Prediction Accuracy for Healthcare Applicationscited by 5
- 2018ICADx: Interpretable computer aided diagnosis of breast massescited by 5
- 2016A data augmentation methodology for training machine/deep learning gait recognition algorithmscited by 4
- 2017Context Augmentation for Convolutional Neural Networkscited by 1
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 20; 2024: 13; 2025: 20; 2026: 5.
72 papers.
Sort:
By area:
- 2022Post-hoc Concept Bottleneck Modelscited by 289
- 2021Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypescited by 120
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2023Learning Concise and Descriptive Attributes for Visual Recognitioncited by 73
- 2022Concept-level Debugging of Part-Prototype Networkscited by 52
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2023Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Modelscited by 40
- 2023Learning Support and Trivial Prototypes for Interpretable Image Classificationcited by 38
- 2023This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizationscited by 36
- 2023ProtoSeg: Interpretable Semantic Segmentation with Prototypical Partscited by 33
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
- 2024Interpretable Image Classification with Adaptive Prototype-based Vision Transformerscited by 25
38 more
- 2023ICICLE: Interpretable Class Incremental Continual Learningcited by 24
- 2021ProtoMIL: Multiple Instance Learning with Prototypical Parts for Whole-Slide Image Classificationcited by 22
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
- 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
- 2024LucidPPN: Unambiguous Prototypical Parts Network for User-centric Interpretable Computer Visioncited by 15
- 2024A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysiscited by 14
- 2025Rashomon Sets for Prototypical-Part Networks: Editing Interpretable Models in Real-Timecited by 13
- 2022Counterfactual Explanations for Misclassified Images: How Human and Machine Explanations Differcited by 12
- 2023MProtoNet: A Case-Based Interpretable Model for Brain Tumor Classification with 3D Multi-parametric Magnetic Resonance Imagingcited by 11
- 2023Interpreting and Correcting Medical Image Classification with PIP-Netcited by 11
- 2023Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Frameworkcited by 11
- 2022Improving Clinician Performance in Classification of EEG Patterns on the Ictal-Interictal-Injury Continuum using Interpretable Machine Learningcited by 10
- 2024This Looks Better than That: Better Interpretable Models with ProtoPNeXtcited by 10
- 2023Why is plausibility surprisingly problematic as an XAI criterion?cited by 9
- 2025Uncertainty-Aware Large Language Models for Explainable Disease Diagnosiscited by 9
- 2022INSightR-Net: Interpretable Neural Network for Regression using Similarity-based Comparisons to Prototypical Examplescited by 8
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunitiescited by 8
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2024This actually looks like that: Proto-BagNets for local and global interpretability-by-designcited by 7
- 2023Interpretable Medical Image Classification using Prototype Learning and Privileged Informationcited by 6
- 2024DiffExplainer: Unveiling Black Box Models Via Counterfactual Generationcited by 5
- 2025ProtoECGNet: Case-Based Interpretable Deep Learning for Multi-Label ECG Classification with Contrastive Learningcited by 4
- 2026Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosiscited by 4
- 2023Removing confounding information from fetal ultrasound imagescited by 3
- 2023Improving Prototypical Visual Explanations with Reward Reweighing, Reselection, and Retrainingcited by 3
- 2024Prototype-based Interpretable Breast Cancer Prediction Models: Analysis and Challengescited by 3
- 2025This looks like what? Challenges and Future Research Directions for Part-Prototype Modelscited by 3
- 2025SIDE: Sparse Information Disentanglement for Explainable Artificial Intelligencecited by 3
- 2023Deep Prototypical-Parts Ease Morphological Kidney Stone Identification and are Competitively Robust to Photometric Perturbationscited by 2
- 2023Unlearning Spurious Correlations in Chest X-ray Classificationcited by 2
- 2025Personalized Interpretability -- Interactive Alignment of Prototypical Parts Networkscited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2025Debugging Concept Bottleneck Models through Removal and Retrainingcited by 2
- 2026Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methodscited by 2
- 2021Ethical Implementation of Artificial Intelligence to Select Embryos in In Vitro Fertilizationcited by 1
- 2022Interpretable Deep Learning Classifier by Detection of Prototypical Parts on Kidney Stones Imagescited by 1
- 2022XADLiME: eXplainable Alzheimer's Disease Likelihood Map Estimation via Clinically-guided Prototype Learningcited by 1
- 2023Distance-Aware eXplanation Based Learningcited by 1
50 most cited of 72 All 72 (JSON)
- 2026Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts20 Jun 2026
- 2026Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methods18 Jun 2026
- 2026Towards Fine-Grained and Verifiable Concept Bottleneck Models14 May 2026
- 2026Adaptive Prototype-based Interpretable Grading of Prostate Cancer5 Mar 2026
- 2026Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosis27 Feb 2026
- 2025ProteinPNet: Prototypical Part Networks for Concept Learning in Spatial Proteomics2 Dec 2025
- 2025CountXplain: Interpretable Cell Counting with Prototype-Based Density Map Estimation24 Nov 2025
- 2025This EEG Looks Like These EEGs: Interpretable Interictal Epileptiform Discharge Detection With ProtoEEG-kNN21 Oct 2025
- 2025Debugging Concept Bottleneck Models through Removal and Retraining23 Sep 2025
- 2025ProtoVQA: An Adaptable Prototypical Framework for Explainable Fine-Grained Visual Question Answering20 Sep 2025
- 2025DoSReMC: Domain Shift Resilient Mammography Classification using Batch Normalization Adaptation21 Aug 2025
- 2025Prototype Learning to Create Refined Interpretable Digital Phenotypes from ECGs2 Aug 2025
38 more
- 2025SIDE: Sparse Information Disentanglement for Explainable Artificial Intelligence25 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis12 Jun 2025
- 2025Personalized Interpretability -- Interactive Alignment of Prototypical Parts Networks5 Jun 2025
- 2025Soft-CAM: Making black box models self-explainable for medical image analysis23 May 2025
- 2025Uncertainty-Aware Large Language Models for Explainable Disease Diagnosis6 May 2025
- 2025SCOPE-MRI: Bankart Lesion Detection as a Case Study in Data Curation and Deep Learning for Challenging Diagnoses29 Apr 2025
- 2025ProtoECGNet: Case-Based Interpretable Deep Learning for Multi-Label ECG Classification with Contrastive Learning11 Apr 2025
- 2025Interpretable Multimodal Learning for Tumor Protein-Metal Binding: Progress, Challenges, and Perspectives4 Apr 2025
- 2025Rashomon Sets for Prototypical-Part Networks: Editing Interpretable Models in Real-Time3 Mar 2025
- 2025Interpretable Concept-based Deep Learning Framework for Multimodal Human Behavior Modeling14 Feb 2025
- 2025This looks like what? Challenges and Future Research Directions for Part-Prototype Models13 Feb 2025
- 2025A Comprehensive Survey on Self-Interpretable Neural Networks26 Jan 2025
- 2024Interpretable Image Classification with Adaptive Prototype-based Vision Transformers28 Oct 2024
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks3 Oct 2024
- 2024The Impact of an XAI-Augmented Approach on Binary Classification with Scarce Data1 Jul 2024
- 2024DiffExplainer: Unveiling Black Box Models Via Counterfactual Generation21 Jun 2024
- 2024This actually looks like that: Proto-BagNets for local and global interpretability-by-design21 Jun 2024
- 2024This Looks Better than That: Better Interpretable Models with ProtoPNeXt20 Jun 2024
- 2024FPN-IAIA-BL: A Multi-Scale Interpretable Deep Learning Model for Classification of Mass Margins in Digital Mammography10 Jun 2024
- 2024A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis23 May 2024
- 2024LucidPPN: Unambiguous Prototypical Parts Network for User-centric Interpretable Computer Vision23 May 2024
- 2024Prototype-based Interpretable Breast Cancer Prediction Models: Analysis and Challenges29 Mar 2024
- 2024ProtoP-OD: Explainable Object Detection with Prototypical Parts29 Feb 2024
- 2024XAI for Skin Cancer Detection with Prototypes and Non-Expert Supervision2 Feb 2024
- 2024Enabling Collaborative Clinical Diagnosis of Infectious Keratitis by Integrating Expert Knowledge and Interpretable Data-driven Intelligence14 Jan 2024
- 2023Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Framework18 Nov 2023
- 2023This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizations28 Oct 2023
- 2023Interpretable Medical Image Classification using Prototype Learning and Privileged Information24 Oct 2023
- 2023Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models4 Oct 2023
- 2023Distance-Aware eXplanation Based Learning11 Sep 2023
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanations16 Aug 2023
- 2023Learning Concise and Descriptive Attributes for Visual Recognition7 Aug 2023
- 2023Unlearning Spurious Correlations in Chest X-ray Classification2 Aug 2023
- 2023Interpreting and Correcting Medical Image Classification with PIP-Net19 Jul 2023
- 2023Improving Prototypical Visual Explanations with Reward Reweighing, Reselection, and Retraining8 Jul 2023
- 2023Prototype Learning for Explainable Brain Age Prediction16 Jun 2023
- 2023When a CBR in Hand is Better than Twins in the Bush9 May 2023
50 newest of 72 All 72 (JSON)
- 2022Post-hoc Concept Bottleneck Modelscited by 289
- 2021Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypescited by 120
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2022Concept-level Debugging of Part-Prototype Networkscited by 52
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2023Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Modelscited by 40
- 2023Learning Support and Trivial Prototypes for Interpretable Image Classificationcited by 38
- 2023This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizationscited by 36
- 2023ProtoSeg: Interpretable Semantic Segmentation with Prototypical Partscited by 33
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
- 2024Interpretable Image Classification with Adaptive Prototype-based Vision Transformerscited by 25
- 2023ICICLE: Interpretable Class Incremental Continual Learningcited by 24
12 most cited of 69 All 69 (JSON)
- 2026Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts20 Jun 2026
- 2026Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methods18 Jun 2026
- 2026Towards Fine-Grained and Verifiable Concept Bottleneck Models14 May 2026
- 2026Adaptive Prototype-based Interpretable Grading of Prostate Cancer5 Mar 2026
- 2026Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosis27 Feb 2026
- 2025ProteinPNet: Prototypical Part Networks for Concept Learning in Spatial Proteomics2 Dec 2025
- 2025CountXplain: Interpretable Cell Counting with Prototype-Based Density Map Estimation24 Nov 2025
- 2025This EEG Looks Like These EEGs: Interpretable Interictal Epileptiform Discharge Detection With ProtoEEG-kNN21 Oct 2025
- 2025Debugging Concept Bottleneck Models through Removal and Retraining23 Sep 2025
- 2025DoSReMC: Domain Shift Resilient Mammography Classification using Batch Normalization Adaptation21 Aug 2025
- 2025Prototype Learning to Create Refined Interpretable Digital Phenotypes from ECGs2 Aug 2025
- 2025SIDE: Sparse Information Disentanglement for Explainable Artificial Intelligence25 Jul 2025
12 newest of 69 All 69 (JSON)