Evaluating Explainability for Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
As post hoc explanations are increasingly used to understand the behavior of graph neural networks (GNNs), it becomes crucial to evaluate the quality and reliability of GNN explanations. However, assessing the quality of GNN explanations is challenging as existing graph datasets have no or unreliable ground-truth explanations for a given task. Here, we introduce a synthetic graph data generator, ShapeGGen, which can generate a variety of benchmark datasets (e.g., varying graph sizes, degree distributions, homophilic vs. heterophilic graphs) accompanied by ground-truth explanations. Further, the flexibility to generate diverse synthetic datasets and corresponding ground-truth explanations allows us to mimic the data generated by various real-world applications. We include ShapeGGen and several real-world graph datasets into an open-source graph explainability library, GraphXAI. In addition to synthetic and real-world graph datasets with ground-truth explanations, GraphXAI provides data loaders, data processing functions, visualizers, GNN model implementations, and evaluation metrics to benchmark the performance of GNN explainability methods.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). Builds on 28 of its 54 references that are in the map. First posted on arXiv 19 Aug 2022.
Builds on
28 of 54 references.
References · 28
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
16 more
- 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 241
- 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2019Explainability Techniques for Graph Convolutional Networkscited by 160
- 2020Interpreting Graph Neural Networks for NLP With Differentiable Edge Maskingcited by 152
- 2021Towards a Unified Framework for Fair and Stable Graph Representation Learningcited by 128
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 118
- 2020Node Similarity Preserving Graph Convolutional Networkscited by 112
- 2021DIG: A Turnkey Library for Diving into Graph Deep Learning Researchcited by 76
- 2020A Large-Scale Database for Graph Representation Learningcited by 54
- 2021Graph Robustness Benchmark: Benchmarking the Adversarial Robustness of Graph Machine Learningcited by 44
- 2020Network Medicine Framework for Identifying Drug Repurposing Opportunities for COVID-19cited by 38
- 2021Probing GNN Explainers: A Rigorous Theoretical and Empirical Analysis of GNN Explanation Methodscited by 36
- 2021Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge Graphscited by 21
- 2020Contrastive Graph Neural Network Explanationcited by 20
Built on by
Citing papers per year: 2022: 4; 2023: 20; 2024: 22; 2025: 23; 2026: 16.
85 papers.
Sort:
By area:
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 128
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 64
- 2023Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistencycited by 42
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehensioncited by 30
- 2023Counterfactual Learning on Graphs: A Surveycited by 22
- 2024PowerGraph: A power grid benchmark dataset for graph neural networkscited by 19
- 2023Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networkscited by 16
- 2025No Metric to Rule Them All: Toward Principled Evaluations of Graph-Learning Datasetscited by 16
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networkscited by 12
- 2022On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approachcited by 11
38 more
- 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarkingcited by 11
- 2024Explaining Graph Neural Networks via Structure-aware Interaction Indexcited by 10
- 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspectivecited by 10
- 2023GInX-Eval: Towards In-Distribution Evaluation of Graph Neural Network Explanationscited by 9
- 2023Exploring Causal Learning through Graph Neural Networks: An In-depth Reviewcited by 8
- 2024Graph Neural Network Causal Explanation via Neural Causal Modelscited by 8
- 2022Towards Training GNNs using Explanation Directed Message Passingcited by 7
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
- 2023Saliency-Bench: A Comprehensive Benchmark for Evaluating Visual Explanationscited by 6
- 2025Rethinking Explainability in the Era of Multimodal AIcited by 6
- 2023How Faithful are Self-Explainable GNNs?cited by 5
- 2024Explainable Graph Neural Networks Under Firecited by 5
- 2024The FIX Benchmark: Extracting Features Interpretable to eXpertscited by 5
- 2023Robust Ante-hoc Graph Explainer using Bilevel Optimizationcited by 4
- 2023Generative Explanations for Graph Neural Network: Methods and Evaluationscited by 4
- 2025Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representationscited by 4
- 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Datacited by 4
- 2023AttributionLab: Faithfulness of Feature Attribution Under Controllable Environmentscited by 3
- 2023Graph AI in Medicinecited by 3
- 2024Iterative Graph Neural Network Enhancement via Frequent Subgraph Mining of Explanationscited by 3
- 2026GNN Explanations that do not Explain and How to find Themcited by 3
- 2026Explainable AI for Jet Tagging: A Comparative Study of GNNExplainer, GNNShap, and GradCAM for Jet Tagging in the Lund Jet Planecited by 3
- 2023Unstructured and structured data: Can we have the best of both worlds with large language models?cited by 2
- 2023Evaluating Link Prediction Explanations for Graph Neural Networkscited by 2
- 2024Generating Human Understandable Explanations for Node Embeddingscited by 2
- 2024Revisiting FunnyBirds evaluation framework for prototypical parts networkscited by 2
- 2024DRExplainer: Quantifiable Interpretability in Drug Response Prediction with Directed Graph Convolutional Networkcited by 2
- 2024Interpreting Temporal Graph Neural Networks with Koopman Theorycited by 2
- 2024Machines and Mathematical Mutations: Using GNNs to Characterize Quiver Mutation Classescited by 2
- 2025Is Your Explanation Reliable: Confidence-Aware Explanation on Graph Neural Networkscited by 2
- 2026ATEX-CF: Attack-Informed Counterfactual Explanations for Graph Neural Networkscited by 2
- 2023Advancing Biomedicine with Graph Representation Learning: Recent Progress, Challenges, and Future Directionscited by 1
- 2023Is Task-Agnostic Explainable AI a Myth?cited by 1
- 2023A Unified Pre-training and Adaptation Framework for Combinatorial Optimization on Graphscited by 1
- 2023Explainability-Based Adversarial Attack on Graphs Through Edge Perturbationcited by 1
- 2024Discovering robust biomarkers of psychiatric disorders from resting-state functional MRI via graph neural networks: A systematic reviewcited by 1
- 2024Towards Understanding Sensitive and Decisive Patterns in Explainable AI: A Case Study of Model Interpretation in Geometric Deep Learningcited by 1
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Conceptscited by 1
50 most cited of 85 All 85 (JSON)
- 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing30 Sep 2026
- 2026GNN4PPM: Multi-Target Predictive Process Monitoring with Relational Graph Convolutional Networks13 Sep 2026
- 2026Graph Machine Learning: An Opportunity for Power Systems17 Aug 2026
- 2026Faithful, Sufficient and Understandable: Rethinking Graph Counterfactual Explanations via Discrete Diffusion Inversion12 Aug 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026Auto-Configured Explainable Graph Neural Networks for Multi-Site Pollution Prediction23 Jun 2026
- 2026A Completion-Aware Framework for Impactful Counterfactual Explainability in Graph Neural Networks20 Jun 2026
- 2026TN-SHAP-G: Graph-Structured Tensor Network Surrogates for Shapley Values and Interactions1 Jun 2026
- 2026LLM Agents Make Collective Belief Dynamics Programmable: Challenges and Research Directions19 May 2026
- 2026B-cos GNNs: Faithful Explanations through Dynamic Linearity19 May 2026
- 2026AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks14 May 2026
- 2026Estimating Subgraph Importance with Structural Prior Domain Knowledge12 May 2026
38 more
- 2026Explainable AI for Jet Tagging: A Comparative Study of GNNExplainer, GNNShap, and GradCAM for Jet Tagging in the Lund Jet Plane28 Apr 2026
- 2026Archetypal Graph Generative Models: Explainable and Identifiable Communities via Anchor-Dominant Convex Hulls24 Feb 2026
- 2026ATEX-CF: Attack-Informed Counterfactual Explanations for Graph Neural Networks5 Feb 2026
- 2026GNN Explanations that do not Explain and How to find Them28 Jan 2026
- 2025QGShap: Quantum Acceleration for Faithful GNN Explanations1 Dec 2025
- 2025QGraphLIME - Explaining Quantum Graph Neural Networks7 Oct 2025
- 2025Graph-based Integrated Gradients for Explaining Graph Neural Networks9 Sep 2025
- 2025Topology-Aware Graph Reinforcement Learning for Dynamic Routing in Cloud Networks5 Sep 2025
- 2025GRainsaCK: a Comprehensive Software Library for Benchmarking Explanations of Link Prediction Tasks on Knowledge Graphs12 Aug 2025
- 2025Discrete Diffusion-Based Model-Level Explanation of Heterogeneous GNNs with Node Features11 Aug 2025
- 2025Explaining GNN Explanations with Edge Gradients1 Aug 2025
- 2025Rethinking Explainability in the Era of Multimodal AI16 Jun 2025
- 2025RAW-Explainer: Post-hoc Explanations of Graph Neural Networks on Knowledge Graphs14 Jun 2025
- 2025XAI-Units: Benchmarking Explainability Methods with Unit Tests1 Jun 2025
- 2025Is Your Explanation Reliable: Confidence-Aware Explanation on Graph Neural Networks31 May 2025
- 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Data28 May 2025
- 2025MetaGMT: Improving Actionable Interpretability of Graph Multilinear Networks via Meta-Learning Filtration26 May 2025
- 2025Towards Comprehensive and Prerequisite-Free Explainer for Graph Neural Networks20 May 2025
- 2025A method for the systematic generation of graph XAI benchmarks via Weisfeiler-Leman coloring18 May 2025
- 2025PointExplainer: Towards Transparent Parkinson's Disease Diagnosis4 May 2025
- 2025Interpretable graph-based models on multimodal biomedical data integration: A technical review and benchmarking3 May 2025
- 2025STX-Search: Explanation Search for Continuous Dynamic Spatio-Temporal Models6 Mar 2025
- 2025GNN-XAR: A Graph Neural Network for Explainable Activity Recognition in Smart Homes25 Feb 2025
- 2025Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representations23 Feb 2025
- 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspective4 Feb 2025
- 2025No Metric to Rule Them All: Toward Principled Evaluations of Graph-Learning Datasets4 Feb 2025
- 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networks28 Jan 2025
- 2024BetaExplainer: A Probabilistic Method to Explain Graph Neural Networks16 Dec 2024
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learning30 Nov 2024
- 2024The GECo algorithm for Graph Neural Networks Explanation18 Nov 2024
- 2024Machines and Mathematical Mutations: Using GNNs to Characterize Quiver Mutation Classes12 Nov 2024
- 2024Do graph neural network states contain graph properties?4 Nov 2024
- 2024Interpreting Temporal Graph Neural Networks with Koopman Theory17 Oct 2024
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Concepts10 Oct 2024
- 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehension4 Oct 2024
- 2024The FIX Benchmark: Extracting Features Interpretable to eXperts20 Sep 2024
- 2024DRExplainer: Quantifiable Interpretability in Drug Response Prediction with Directed Graph Convolutional Network22 Aug 2024
- 2024Revisiting FunnyBirds evaluation framework for prototypical parts networks21 Aug 2024
50 newest of 85 All 85 (JSON)
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 128
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 64
- 2023Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistencycited by 42
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehensioncited by 30
- 2023Counterfactual Learning on Graphs: A Surveycited by 22
- 2024PowerGraph: A power grid benchmark dataset for graph neural networkscited by 19
- 2023Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networkscited by 16
- 2025No Metric to Rule Them All: Toward Principled Evaluations of Graph-Learning Datasetscited by 16
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2025Exact Computation of Any-Order Shapley Interactions for Graph Neural Networkscited by 12
- 2022On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approachcited by 11
12 most cited of 82 All 82 (JSON)
- 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing30 Sep 2026
- 2026GNN4PPM: Multi-Target Predictive Process Monitoring with Relational Graph Convolutional Networks13 Sep 2026
- 2026Graph Machine Learning: An Opportunity for Power Systems17 Aug 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026Auto-Configured Explainable Graph Neural Networks for Multi-Site Pollution Prediction23 Jun 2026
- 2026A Completion-Aware Framework for Impactful Counterfactual Explainability in Graph Neural Networks20 Jun 2026
- 2026TN-SHAP-G: Graph-Structured Tensor Network Surrogates for Shapley Values and Interactions1 Jun 2026
- 2026B-cos GNNs: Faithful Explanations through Dynamic Linearity19 May 2026
- 2026AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks14 May 2026
- 2026Estimating Subgraph Importance with Structural Prior Domain Knowledge12 May 2026
- 2026Explainable AI for Jet Tagging: A Comparative Study of GNNExplainer, GNNShap, and GradCAM for Jet Tagging in the Lund Jet Plane28 Apr 2026
- 2026Archetypal Graph Generative Models: Explainable and Identifiable Communities via Anchor-Dominant Convex Hulls24 Feb 2026
12 newest of 82 All 82 (JSON)