SLISEMAP: Supervised dimensionality reduction through local explanations
Not on the map. Why?
Abstract (arXiv)
Existing methods for explaining black box learning models often focus on building local explanations of model behaviour for a particular data item. It is possible to create global explanations for all data items, but these explanations generally have low fidelity for complex black box models. We propose a new supervised manifold visualisation method, SLISEMAP, that simultaneously finds local explanations for all data items and builds a (typically) two-dimensional global visualisation of the black box model such that data items with similar local explanations are projected nearby. We provide a mathematical derivation of our problem and an open source implementation implemented using the GPU-optimised PyTorch library. We compare SLISEMAP to multiple popular dimensionality reduction methods and find that SLISEMAP is able to utilise labelled data to create embeddings with consistent local white box models. We also compare SLISEMAP to other model-agnostic local explanation methods and show that SLISEMAP provides comparable explanations and that the visualisations can give a broader understanding of black box regression and classification models.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 16 of its 64 references that are in the map. First posted on arXiv 12 Jan 2022.
Builds on
16 of 64 references.
References · 16
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2014OpenML: networked science in machine learningcited by 523
- 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 364
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
4 more
- 2019SenseBERT: Driving Some Sense into BERTcited by 73
- 2016Auditing Black-box Models for Indirect Influencecited by 41
- 2018Defining Locality for Surrogates in Post-hoc Interpretablitycited by 33
- 2017Interpreting Classifiers through Attribute Interactions in Datasetscited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 1; 2026: 1.
7 papers.
- 2024Incremental XAI: Memorable Understanding of AI with Incremental Explanationscited by 8
- 2024The Art of Deception: Robust Backdoor Attack using Dynamic Stacking of Triggerscited by 3
- 2024Developing Guidelines for Functionally-Grounded Evaluation of Explainable Artificial Intelligence using Tabular Datacited by 2
- 2026Spectral Geometry and Bosonic-Bloch Probes: Explorations in Quantum Learningcited by 1
- 2023Using Slisemap to interpret physical datacited by 0
- 2024Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial Braincited by 0
- 2025Conditional Multidimensional Scaling with Incomplete Conditioning Datacited by 0
- 2026Spectral Geometry and Bosonic-Bloch Probes: Explorations in Quantum Learning30 Jun 2026
- 2025Conditional Multidimensional Scaling with Incomplete Conditioning Data20 Sep 2025
- 2024Developing Guidelines for Functionally-Grounded Evaluation of Explainable Artificial Intelligence using Tabular Data30 Sep 2024
- 2024Incremental XAI: Memorable Understanding of AI with Incremental Explanations10 Apr 2024
- 2024Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial Brain7 Feb 2024
- 2024The Art of Deception: Robust Backdoor Attack using Dynamic Stacking of Triggers3 Jan 2024
- 2023Using Slisemap to interpret physical data24 Oct 2023