GNNExplainer: Generating Explanations for Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating both graph structure and feature information leads to complex models, and explaining predictions made by GNNs remains unsolved. Here we propose GNNExplainer, the first general, model-agnostic approach for providing interpretable explanations for predictions of any GNN-based model on any graph-based machine learning task. Given an instance, GNNExplainer identifies a compact subgraph structure and a small subset of node features that have a crucial role in GNN's prediction. Further, GNNExplainer can generate consistent and concise explanations for an entire class of instances. We formulate GNNExplainer as an optimization task that maximizes the mutual information between a GNN's prediction and distribution of possible subgraph structures. Experiments on synthetic and real-world graphs show that our approach can identify important graph structures as well as node features, and outperforms baselines by 17.1% on average. GNNExplainer provides a variety of benefits, from the ability to visualize semantically relevant structures to interpretability, to giving insights into errors of faulty GNNs.
Key facts. Cited by 737 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 84; 2022: 125; 2023: 134; 2024: 152; 2025: 128; 2026: 114.
737 papers.
Sort:
By area:
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 281
- 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 261
- 2021Identity-aware Graph Neural Networkscited by 198
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 188
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
38 more
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 119
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 118
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
- 2022XAI for Transformers: Better Explanations through Conservative Propagationcited by 100
- 2022Out-Of-Distribution Generalization on Graphs: A Surveycited by 97
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2022Decoupling the Depth and Scope of Graph Neural Networkscited by 94
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Graph Neural Networks in Network Neurosciencecited by 92
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2022Evaluating Explainability for Graph Neural Networkscited by 87
- 2022Debiasing Graph Neural Networks via Learning Disentangled Causal Substructurecited by 83
- 2021Graph Representation Learning in Biomedicinecited by 80
- 2022Learning and Evaluating Graph Neural Network Explanations based on Counterfactual and Factual Reasoningcited by 79
- 2021DIG: A Turnkey Library for Diving into Graph Deep Learning Researchcited by 76
- 2021Towards Self-Explainable Graph Neural Networkcited by 75
- 2021Robust Counterfactual Explanations on Graph Neural Networkscited by 72
- 2021Generalizing Graph Neural Networks on Out-Of-Distribution Graphscited by 71
- 2022Graph Rationalization with Environment-based Augmentationscited by 70
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 65
- 2021GraphSVX: Shapley Value Explanations for Graph Neural Networkscited by 64
- 2024Human-inspired Episodic Memory for Infinite Context LLMscited by 62
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 61
- 2022Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysiscited by 59
- 2022GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networkscited by 58
- 2022Let Invariant Rationale Discovery Inspire Graph Contrastive Learningcited by 57
- 2023Interpretable Neural-Symbolic Concept Reasoningcited by 57
- 2024A Comprehensive Survey on Graph Reduction: Sparsification, Coarsening, and Condensationcited by 57
- 2021E-GraphSAGE: A Graph Neural Network based Intrusion Detection System for IoTcited by 56
- 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
- 2025PyG 2.0: Scalable Learning on Real World Graphscited by 52
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2022KerGNNs: Interpretable Graph Neural Networks with Graph Kernelscited by 50
- 2022CLEAR: Generative Counterfactual Explanations on Graphscited by 48
- 2023Histopathology Whole Slide Image Analysis with Heterogeneous Graph Representation Learningcited by 47
- 2021Improving Subgraph Recognition with Variational Graph Information Bottleneckcited by 45
50 most cited of 737 All 737 (JSON)
- 2026xLightGCN: Explainable Graph Neural Network Based Recommendation Systems with Most Influential Peers14 Oct 2026
- 2026Beyond Trained Models: Compiling GNNs for a Sound Explainer Benchmark2 Oct 2026
- 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing30 Sep 2026
- 2026Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphs29 Sep 2026
- 2026RACE: Relation-Level Counterfactual Explanations for Heterogeneous Graph Neural Networks29 Sep 2026
- 2026GraphSelect for Budgeted Representation Selection in Multimodal Graph Inference27 Sep 2026
- 2026SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion23 Sep 2026
- 2026HYDRA: Proactive Android Malware Drift Adaptation via Hierarchical Graph Contrastive Learning22 Sep 2026
- 2026DefaultGNN: A Dual-Perspective GNN Framework for Predicting Corporate Default from Buyer-Seller Transaction Networks22 Sep 2026
- 2026Temporal Generalization and Explanation Stability of Control Flow Graph Neural Networks for Malware Detection21 Sep 2026
- 2026An Accurate and Interpretable Hyper Graph Neural Network for GBM Survival Prediction19 Sep 2026
- 2026Fragment-Aware Vision Transformers for Fresco-Fragment Style Classification17 Sep 2026
38 more
- 2026GraphFAS: A Distributed System for Automated Graph Feature Generation and Selection in Industrial Transaction Networks8 Sep 2026
- 2026SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis4 Sep 2026
- 2026VINCENT: Validated Interaction Network for Cross-drug Explanation of Therapeutics26 Aug 2026
- 2026Generating Intervention Hypotheses using Explainable Explanations on Graphs: G2I, a Two-Stage Greedy Framework24 Aug 2026
- 2026ChequeMark: An Ensemble Machine Learning Framework for After-Hours Business Deposit Fraud Detection21 Aug 2026
- 2026Communicating Credit Risk with Large Language Models: Evaluation of Explanations from Standard and Alternative Data-Based Models18 Aug 2026
- 2026NICE: Scale-Stable Perturbations for Graph Neural Network Explanations via Noise Corruption17 Aug 2026
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference13 Aug 2026
- 2026Multi-Granular Rationale-Guided Molecular LLM for Property Prediction11 Aug 2026
- 2026Explaining spatial information flow in short-term traffic forecasting models using a gated graph attention network9 Aug 2026
- 2026Can Graph Learning Learn Circuits?9 Aug 2026
- 2026Patients-like-me: A Variational LM--GNN Framework for Explainable Clinical Prediction4 Aug 2026
- 2026How Much Does Message Passing Matter? A Drop-In Study of GNN Layers for Neural Network Graph Regression29 Jul 2026
- 2026Automorphism-Induced Non-Canonicity in Top-k Explanations of Graph Neural Networks28 Jul 2026
- 2026DeepFaith: Evidence-Grounded LLMs for Faithful Incident Reporting in Multi-Stage APT Defense27 Jul 2026
- 2026A Polynomial Architecture-Attribution Co-Design Framework for Exact Aumann-Shapley Attribution in GNNs23 Jul 2026
- 2026CDS: Counterfactual Directionality Score for Structured Interventions in Spatial Graphs15 Jul 2026
- 2026Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools14 Jul 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026Two Black Boxes, One Solver: Encoder Probing and Decoder Attribution for Neural Multi-Attribute VRP under Hard-Mask and Recourse Decoders5 Jul 2026
- 2026Towards the Explainability of Temporal Graph Networks via Memory Backtracking and Topological Attribution4 Jul 2026
- 2026An Additive MLP-GNN Framework for Characterizing Chemical and Structural Contributions to Aqueous Solubility2 Jul 2026
- 2026Beyond Heatmaps: Unsupervised Concept-Graph Reasoning for Interpretable Visual Explanation1 Jul 2026
- 2026FedLAB: Traceable Semantic Codebooks for Federated Multimodal Graph Foundation Learning30 Jun 2026
- 2026GRAFT: Biological Graph and Hypergraph Benchmarks for Linked Gene Expression and Phenotypic Trait Prediction in Arabidopsis thaliana25 Jun 2026
- 2026Clue-Guided Money Laundering Group Discovery24 Jun 2026
- 2026Auto-Configured Explainable Graph Neural Networks for Multi-Site Pollution Prediction23 Jun 2026
- 2026A Completion-Aware Framework for Impactful Counterfactual Explainability in Graph Neural Networks20 Jun 2026
- 2026CIExplainer++: Generating Causal and Interpretable Explanations for Graph Neural Networks17 Jun 2026
- 2026SEAGAN: domain-Specific and Edge-Aware Graph Attention Network for Dynamic Plant Processes17 Jun 2026
- 2026Where Black-box Drug-Target Interaction Prediction Models Look: Cross-Method Explainability12 Jun 2026
- 2026Explaining Black-Box Language Models: Learning to Optimize Linguistically-Structured Word Subsets7 Jun 2026
- 2026AttackPathGNN: Cross-function vulnerability detection in smart contracts using state interference graphs and conjunction pooling4 Jun 2026
- 2026Beyond Soft Masks: Hard-Perturbation Mixup Explainer for Robust GNN Explainability4 Jun 2026
- 2026HiSE: A Lightweight Hierarchical Semantic Explainer for Heterogeneous Graph Neural Networks2 Jun 2026
- 2026Normalized Relevance Measure as a Unifying Framework to Explain Neural Network Latent Structures30 May 2026
- 2026Can Subgraph Explanations Be Weaponized to Steal Graph Neural Networks?28 May 2026
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning27 May 2026
50 newest of 737 All 737 (JSON)
- 2024LLM-Powered Explanations: Unraveling Recommendations Through Subgraph Reasoningcited by 10
- 2025A Graph Talks, But Who's Listening? Rethinking Evaluations for Graph-Language Modelscited by 2
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layercited by 1
- 2024GNNAnatomy: Rethinking Model-Level Explanations for Graph Neural Networkscited by 0
- 2026Concept Graph Convolutions: Message Passing in the Concept Spacecited by 0
- 2026Concept Graph Convolutions: Message Passing in the Concept Space22 Apr 2026
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layer2 Mar 2026
- 2025A Graph Talks, But Who's Listening? Rethinking Evaluations for Graph-Language Models28 Aug 2025
- 2024LLM-Powered Explanations: Unraveling Recommendations Through Subgraph Reasoning22 Jun 2024
- 2024GNNAnatomy: Rethinking Model-Level Explanations for Graph Neural Networks6 Jun 2024
- 2025Multi-Agent Framework for Threat Mitigation and Resilience in AI-Based Systemscited by 2
- 2026Improving Molecular Property Prediction in Small Language Models Using Graph-based Toolscited by 1
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inferencecited by 1
- 2025EvoMail: Self-Evolving Cognitive Agents for Adaptive Spam and Phishing Email Defensecited by 0
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference13 Aug 2026
- 2026Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools14 Jul 2026
- 2025Multi-Agent Framework for Threat Mitigation and Resilience in AI-Based Systems29 Dec 2025
- 2025EvoMail: Self-Evolving Cognitive Agents for Adaptive Spam and Phishing Email Defense25 Sep 2025
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspectivecited by 16
- 2025Advancing network resilience theories with symbolized reinforcement learningcited by 1
- 2026DeepXplain: XAI-Guided Autonomous Defense Against Multi-Stage APT Campaignscited by 1
- 2024REVEAL-IT: REinforcement learning with Visibility of Evolving Agent poLicy for InTerpretabilitycited by 0
- 2026DeepXplain: XAI-Guided Autonomous Defense Against Multi-Stage APT Campaigns22 Mar 2026
- 2025Advancing network resilience theories with symbolized reinforcement learning4 Jul 2025
- 2024REVEAL-IT: REinforcement learning with Visibility of Evolving Agent poLicy for InTerpretability20 Jun 2024
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspective9 Apr 2024
- 2023Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPscited by 7
- 2022Toward Multiple Specialty Learners for Explaining GNNs via Online Knowledge Distillationcited by 2
- 2023KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillationcited by 2
- 2022PGX: A Multi-level GNN Explanation Framework Based on Separate Knowledge Distillation Processescited by 1
- 2023KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillation2 Oct 2023
- 2023Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs24 Mar 2023
- 2022Toward Multiple Specialty Learners for Explaining GNNs via Online Knowledge Distillation20 Oct 2022
- 2022PGX: A Multi-level GNN Explanation Framework Based on Separate Knowledge Distillation Processes5 Aug 2022
- 2026Can Graph Learning Learn Circuits?9 Aug 2026
- 2025Circuits, Features, and Heuristics in Molecular Transformers10 Dec 2025
- 2025Towards Mechanistic Interpretability of Graph Transformers via Attention Graphs17 Feb 2025
- 2023Inductive Graph Unlearningcited by 31
- 2025Unlearning Algorithmic Biases over Graphscited by 0
- 2025Unlearning Algorithmic Biases over Graphs20 May 2025
- 2023Inductive Graph Unlearning6 Apr 2023
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 281
- 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 261
- 2021Identity-aware Graph Neural Networkscited by 198
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 188
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
12 most cited of 708 All 708 (JSON)
- 2026xLightGCN: Explainable Graph Neural Network Based Recommendation Systems with Most Influential Peers14 Oct 2026
- 2026Beyond Trained Models: Compiling GNNs for a Sound Explainer Benchmark2 Oct 2026
- 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing30 Sep 2026
- 2026Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphs29 Sep 2026
- 2026RACE: Relation-Level Counterfactual Explanations for Heterogeneous Graph Neural Networks29 Sep 2026
- 2026GraphSelect for Budgeted Representation Selection in Multimodal Graph Inference27 Sep 2026
- 2026SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion23 Sep 2026
- 2026HYDRA: Proactive Android Malware Drift Adaptation via Hierarchical Graph Contrastive Learning22 Sep 2026
- 2026DefaultGNN: A Dual-Perspective GNN Framework for Predicting Corporate Default from Buyer-Seller Transaction Networks22 Sep 2026
- 2026Temporal Generalization and Explanation Stability of Control Flow Graph Neural Networks for Malware Detection21 Sep 2026
- 2026An Accurate and Interpretable Hyper Graph Neural Network for GBM Survival Prediction19 Sep 2026
- 2026Fragment-Aware Vision Transformers for Fresco-Fragment Style Classification17 Sep 2026
12 newest of 708 All 708 (JSON)