# Interpretable Medical Image Classification using Prototype Learning and Privileged Information

arXiv: https://arxiv.org/abs/2310.15741 · HTML: https://mlsanity.com/paper/2310.15741/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 25 references that are in the map.
- First posted on arXiv 24 Oct 2023.

## Builds on (most cited first, 13 of 13)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Prototypical Networks for Few-shot Learning](https://mlsanity.com/paper/1703.05175/) (2017)
- [Learning Deep Features for Discriminative Localization](https://mlsanity.com/paper/1512.04150/) (2015)
- [This Looks Like That: Deep Learning for Interpretable Image Recognition](https://mlsanity.com/paper/1806.10574/) (2018)
- [Dynamic Routing Between Capsules](https://mlsanity.com/paper/1710.09829/) (2017)
- [Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictions](https://mlsanity.com/paper/1710.04806/) (2017)
- [Attribute Prototype Network for Zero-Shot Learning](https://mlsanity.com/paper/2008.08290/) (2020)
- [Transferrable Prototypical Networks for Unsupervised Domain Adaptation](https://mlsanity.com/paper/1904.11227/) (2019)
- [IAIA-BL: A Case-based Interpretable Deep Learning Model for Classification of Mass Lesions in Digital Mammography](https://mlsanity.com/paper/2103.12308/) (2021)
- [An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification](https://mlsanity.com/paper/1806.00712/) (2018)
- [Brain Tumor Type Classification via Capsule Networks](https://mlsanity.com/paper/1802.10200/) (2018)
- [Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning](https://mlsanity.com/paper/1704.08797/) (2017)
- [TumorNet: Lung Nodule Characterization Using Multi-View Convolutional Neural Network with Gaussian Process](https://mlsanity.com/paper/1703.00645/) (2017)

## Built on by (most cited first, 6 of 6)

- [Evaluating the Explainability of Attributes and Prototypes for a Medical Classification Model](https://mlsanity.com/paper/2404.09917/) (2024)
- [LCE: A Framework for Explainability of DNNs for Ultrasound Image Based on Concept Discovery](https://mlsanity.com/paper/2408.09899/) (2024)
- [FunnyNodules: A Customizable Medical Dataset Tailored for Evaluating Explainable AI](https://mlsanity.com/paper/2511.15481/) (2025)
- [PIME: Prototype-based Interpretable MCTS-Enhanced Brain Network Analysis for Disorder Diagnosis](https://mlsanity.com/paper/2602.21046/) (2026)
- [X-SiT: Inherently Interpretable Surface Vision Transformers for Dementia Diagnosis](https://mlsanity.com/paper/2506.20267/) (2025)
- [Multimodal Feature Prototype Learning for Interpretable and Discriminative Cancer Survival Prediction](https://mlsanity.com/paper/2510.06113/) (2025)

## Abstract (arXiv)

Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information available during the training process can be used to create an understandable and powerful model. We propose an innovative solution called Proto-Caps that leverages the benefits of capsule networks, prototype learning and the use of privileged information. Evaluating the proposed solution on the LIDC-IDRI dataset shows that it combines increased interpretability with above state-of-the-art prediction performance. Compared to the explainable baseline model, our method achieves more than 6 % higher accuracy in predicting both malignancy (93.0 %) and mean characteristic features of lung nodules. Simultaneously, the model provides case-based reasoning with prototype representations that allow visual validation of radiologist-defined attributes.