Human-interpretable model explainability on high-dimensional data
Not on the map. Why?
Abstract (arXiv)
The importance of explainability in machine learning continues to grow, as both neural-network architectures and the data they model become increasingly complex. Unique challenges arise when a model's input features become high dimensional: on one hand, principled model-agnostic approaches to explainability become too computationally expensive; on the other, more efficient explainability algorithms lack natural interpretations for general users. In this work, we introduce a framework for human-interpretable explainability on high-dimensional data, consisting of two modules. First, we apply a semantically meaningful latent representation, both to reduce the raw dimensionality of the data, and to ensure its human interpretability. These latent features can be learnt, e.g. explicitly as disentangled representations or implicitly through image-to-image translation, or they can be based on any computable quantities the user chooses. Second, we adapt the Shapley paradigm for model-agnostic explainability to operate on these latent features. This leads to interpretable model explanations that are both theoretically controlled and computationally tractable. We benchmark our approach on synthetic data and demonstrate its effectiveness on several image-classification tasks.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 2; 2024: 0; 2025: 2; 2026: 1.
8 papers.
- 2021Grouped Feature Importance and Combined Features Effect Plotcited by 14
- 2023Does Your Model Think Like an Engineer? Explainable AI for Bearing Fault Detection with Deep Learningcited by 7
- 2022Combining Counterfactuals With Shapley Values To Explain Image Modelscited by 4
- 2023The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Researchcited by 4
- 2022Latent SHAP: Toward Practical Human-Interpretable Explanationscited by 3
- 2025FINCH: Locally Visualizing Higher-Order Feature Interactions in Black Box Modelscited by 2
- 2025The hunt for new pulsating ultraluminous X-ray sources: a clustering approachcited by 1
- 2026ShapShift: Explaining Model Prediction Shifts with Subgroup Conditional Shapley Valuescited by 0
- 2026ShapShift: Explaining Model Prediction Shifts with Subgroup Conditional Shapley Values13 Apr 2026
- 2025The hunt for new pulsating ultraluminous X-ray sources: a clustering approach20 Jul 2025
- 2025FINCH: Locally Visualizing Higher-Order Feature Interactions in Black Box Models17 Feb 2025
- 2023Does Your Model Think Like an Engineer? Explainable AI for Bearing Fault Detection with Deep Learning19 Oct 2023
- 2023The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Research11 Oct 2023
- 2022Latent SHAP: Toward Practical Human-Interpretable Explanations27 Nov 2022
- 2022Combining Counterfactuals With Shapley Values To Explain Image Models14 Jun 2022
- 2021Grouped Feature Importance and Combined Features Effect Plot23 Apr 2021