Comprehensive Evaluation of Prototype Neural Networks
Not on the map. Why?
Abstract (arXiv)
Prototype models are an important method for explainable artificial intelligence (XAI) and interpretable machine learning. In this paper, we perform an in-depth analysis of a set of prominent prototype models including ProtoPNet, ProtoPool and PIPNet. For their assessment, we apply a comprehensive set of metrics. In addition to applying standard metrics from literature, we propose several new metrics to further complement the analysis of model interpretability. In our experimentation, we apply the set of prototype models on a diverse set of datasets including fine-grained classification, Non-IID settings and multi-label classification to further contrast the performance. Furthermore, we also provide our code as an open-source library (https://github.com/uos-sis/quanproto), which facilitates simple application of the metrics itself, as well as extensibility -- providing the option for easily adding new metrics and models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 79 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
48 of 79 references.
References · 48
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2020Concept Bottleneck Modelscited by 1,032
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 367
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2020A Survey on Neural Network Interpretabilitycited by 291
36 more
- 2018Techniques for Interpretable Machine Learningcited by 238
- 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
- 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 214
- 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
- 2021Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypescited by 120
- 2021HIVE: Evaluating the Human Interpretability of Visual Explanationscited by 105
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 98
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2020ProtoPShare: Prototype Sharing for Interpretable Image Classification and Similarity Discoverycited by 89
- 2021The effectiveness of feature attribution methods and its correlation with automatic evaluation scorescited by 88
- 2020Interpretability of machine learning based prediction models in healthcarecited by 75
- 2021XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanationscited by 73
- 2019Interpretable and Steerable Sequence Learning via Prototypescited by 72
- 2019Interpretable Image Recognition with Hierarchical Prototypescited by 65
- 2021This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networkscited by 65
- 2022ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognitioncited by 63
- 2019Visualizing Deep Networks by Optimizing with Integrated Gradientscited by 59
- 2020This Looks Like That, Because ... Explaining Prototypes for Interpretable Image Recognitioncited by 50
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2023Learning Support and Trivial Prototypes for Interpretable Image Classificationcited by 38
- 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
- 2023This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizationscited by 36
- 2022ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Modelcited by 34
- 2023ProtoSeg: Interpretable Semantic Segmentation with Prototypical Partscited by 33
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
- 2023PDiscoNet: Semantically consistent part discovery for fine-grained recognitioncited by 21
- 2023The Co-12 Recipe for Evaluating Interpretable Part-Prototype Image Classifierscited by 15
- 2024LucidPPN: Unambiguous Prototypical Parts Network for User-centric Interpretable Computer Visioncited by 15
- 2024This Looks Better than That: Better Interpretable Models with ProtoPNeXtcited by 11
- 2021Representation Learning via Consistent Assignment of Views to Clusterscited by 8
- 2023Sanity checks for patch visualisation in prototype-based image classificationcited by 8
- 2024An Overview of Prototype Formulations for Interpretable Deep Learningcited by 5
- 2024This Probably Looks Exactly Like That: An Invertible Prototypical Networkcited by 3
- 2024CaBRNet, an open-source library for developing and evaluating Case-Based Reasoning Modelscited by 3
- 2025This looks like what? Challenges and Future Research Directions for Part-Prototype Modelscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025ProtoMask: Segmentation-Guided Prototype Learningcited by 0
- 2025ProtoMask: Segmentation-Guided Prototype Learning1 Oct 2025