GRAPHSHAP: Explaining Identity-Aware Graph Classifiers Through the Language of Motifs
Not on the map. Why?
Abstract (arXiv)
Most methods for explaining black-box classifiers (e.g. on tabular data, images, or time series) rely on measuring the impact that removing/perturbing features has on the model output. This forces the explanation language to match the classifier's feature space. However, when dealing with graph data, in which the basic features correspond to the edges describing the graph structure, this matching between features space and explanation language might not be appropriate. Decoupling the feature space (edges) from a desired high-level explanation language (such as motifs) is thus a major challenge towards developing actionable explanations for graph classification tasks. In this paper we introduce GRAPHSHAP, a Shapley-based approach able to provide motif-based explanations for identity-aware graph classifiers, assuming no knowledge whatsoever about the model or its training data: the only requirement is that the classifier can be queried as a black-box at will. For the sake of computational efficiency we explore a progressive approximation strategy and show how a simple kernel can efficiently approximate explanation scores, thus allowing GRAPHSHAP to scale on scenarios with a large explanation space (i.e. large number of motifs). We showcase GRAPHSHAP on a real-world brain-network dataset consisting of patients affected by Autism Spectrum Disorder and a control group. Our experiments highlight how the classification provided by a black-box model can be effectively explained by few connectomics patterns.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 17 Feb 2022.
Builds on
29 of 42 references.
References · 29
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2019The many Shapley values for model explanationcited by 341
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
17 more
- 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2021Identity-aware Graph Neural Networkscited by 197
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 182
- 2019Explainability Techniques for Graph Convolutional Networkscited by 160
- 2020Interpreting Graph Neural Networks for NLP With Differentiable Edge Maskingcited by 152
- 2020Higher-Order Explanations of Graph Neural Networks via Relevant Walkscited by 138
- 2020True to the Model or True to the Data?cited by 123
- 2021Sampling Permutations for Shapley Value Estimationcited by 101
- 2019Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Surveycited by 93
- 2017Distill-and-Compare: Auditing Black-Box Models Using Transparent Model Distillationcited by 62
- 2020RelEx: A Model-Agnostic Relational Model Explainercited by 53
- 2021Counterfactual Graphs for Explainable Classification of Brain Networkscited by 33
- 2020Explainable Classification of Brain Networks via Contrast Subgraphscited by 26
- 2020FairLens: Auditing Black-box Clinical Decision Support Systemscited by 23
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 3; 2025: 1; 2026: 1.
6 papers.
- 2024GNNShap: Scalable and Accurate GNN Explanation using Shapley Valuescited by 12
- 2022L2XGNN: Learning to Explain Graph Neural Networkscited by 7
- 2024Utilizing Description Logics for Global Explanations of Heterogeneous Graph Neural Networkscited by 3
- 2024Global Concept Explanations for Graphs by Contrastive Learningcited by 2
- 2025DistShap: Scalable GNN Explanations with Distributed Shapley Valuescited by 0
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainabilitycited by 0
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2025DistShap: Scalable GNN Explanations with Distributed Shapley Values27 Jun 2025
- 2024Utilizing Description Logics for Global Explanations of Heterogeneous Graph Neural Networks21 May 2024
- 2024Global Concept Explanations for Graphs by Contrastive Learning25 Apr 2024
- 2024GNNShap: Scalable and Accurate GNN Explanation using Shapley Values9 Jan 2024
- 2022L2XGNN: Learning to Explain Graph Neural Networks28 Sep 2022