On the Interpretability of Part-Prototype Based Classifiers: A Human Centric Analysis
Not on the map. Why?
Abstract (arXiv)
Part-prototype networks have recently become methods of interest as an interpretable alternative to many of the current black-box image classifiers. However, the interpretability of these methods from the perspective of human users has not been sufficiently explored. In this work, we have devised a framework for evaluating the interpretability of part-prototype-based models from a human perspective. The proposed framework consists of three actionable metrics and experiments. To demonstrate the usefulness of our framework, we performed an extensive set of experiments using Amazon Mechanical Turk. They not only show the capability of our framework in assessing the interpretability of various part-prototype-based models, but they also are, to the best of our knowledge, the most comprehensive work on evaluating such methods in a unified framework.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 10 Oct 2023.
Builds on
14 of 36 references.
References · 14
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
- 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 214
- 2021Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypescited by 120
- 2021HIVE: Evaluating the Human Interpretability of Visual Explanationscited by 105
- 2021What I Cannot Predict, I Do Not Understand: A Human-Centered Evaluation Framework for Explainability Methodscited by 98
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2018How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanationcited by 72
- 2021This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networkscited by 65
- 2022Concept-level Debugging of Part-Prototype Networkscited by 52
2 more
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 3; 2026: 2.
11 papers.
- 2024Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspectivecited by 9
- 2024This actually looks like that: Proto-BagNets for local and global interpretability-by-designcited by 7
- 2025Formal Abductive Latent Explanations for Prototype-Based Networkscited by 5
- 2024Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentationcited by 4
- 2023Robust Text Classification: Analyzing Prototype-Based Networkscited by 3
- 2024This Probably Looks Exactly Like That: An Invertible Prototypical Networkcited by 3
- 2025This looks like what? Challenges and Future Research Directions for Part-Prototype Modelscited by 3
- 2023Model-agnostic Body Part Relevance Assessment for Pedestrian Detectioncited by 0
- 2025Keypoint Counting Classifiers: Turning Vision Transformers into Self-Explainable Models Without Trainingcited by 0
- 2026Metonymy in vision models undermines attention-based interpretabilitycited by 0
- 2026OPTIMUS-Prime: Minimal and Sufficient Concept Explanations for Deep Vision Modelscited by 0
- 2026OPTIMUS-Prime: Minimal and Sufficient Concept Explanations for Deep Vision Models5 Jun 2026
- 2026Metonymy in vision models undermines attention-based interpretability7 May 2026
- 2025Keypoint Counting Classifiers: Turning Vision Transformers into Self-Explainable Models Without Training19 Dec 2025
- 2025Formal Abductive Latent Explanations for Prototype-Based Networks20 Nov 2025
- 2025This looks like what? Challenges and Future Research Directions for Part-Prototype Models13 Feb 2025
- 2024Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentation14 Sep 2024
- 2024This Probably Looks Exactly Like That: An Invertible Prototypical Network16 Jul 2024
- 2024This actually looks like that: Proto-BagNets for local and global interpretability-by-design21 Jun 2024
- 2024Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective9 Jan 2024
- 2023Model-agnostic Body Part Relevance Assessment for Pedestrian Detection27 Nov 2023
- 2023Robust Text Classification: Analyzing Prototype-Based Networks11 Nov 2023