mlsanityData to 7 Oct 2026

Semantic Prototypes: Enhancing Transparency Without Black Boxes

arXiv 2407.15871 ↗First posted 18 Jul 2024cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

As machine learning (ML) models and datasets increase in complexity, the demand for methods that enhance explainability and interpretability becomes paramount. Prototypes, by encapsulating essential characteristics within data, offer insights that enable tactical decision-making and enhance transparency. Traditional prototype methods often rely on sub-symbolic raw data and opaque latent spaces, reducing explainability and increasing the risk of misinterpretations. This paper presents a novel framework that utilizes semantic descriptions to define prototypes and provide clear explanations, effectively addressing the shortcomings of conventional methods. Our approach leverages concept-based descriptions to cluster data on the semantic level, ensuring that prototypes not only represent underlying properties intuitively but are also straightforward to interpret. Our method simplifies the interpretative process and effectively bridges the gap between complex data structures and human cognitive processes, thereby enhancing transparency and fostering trust. Our approach outperforms existing widely-used prototype methods in facilitating human understanding and informativeness, as validated through a user survey.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 18 Jul 2024.

Builds on

15 of 44 references.

References · 15

  1. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  2. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  3. 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
  4. 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 213
  5. 2018Explaining Explanations in AIcited by 136
  6. 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
  7. 2020Right for the Right Concept: Revising Neuro-Symbolic Concepts by Interacting with their Explanationscited by 94
  8. 2020ProtoPShare: Prototype Sharing for Interpretable Image Classification and Similarity Discoverycited by 89
  9. 2021This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networkscited by 65
  10. 2022ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognitioncited by 63
  11. 2022"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interactioncited by 63
  12. 2020This Looks Like That, Because ... Explaining Prototypes for Interpretable Image Recognitioncited by 50
3 more
  1. 2023Choose your Data Wisely: A Framework for Semantic Counterfactualscited by 7
  2. 2024Structure Your Data: Towards Semantic Graph Counterfactualscited by 6
  3. 2020Towards Deep Machine Reasoning: a Prototype-based Deep Neural Network with Decision Tree Inferencecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.