ProtGNN: Towards Self-Explaining Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Despite the recent progress in Graph Neural Networks (GNNs), it remains challenging to explain the predictions made by GNNs. Existing explanation methods mainly focus on post-hoc explanations where another explanatory model is employed to provide explanations for a trained GNN. The fact that post-hoc methods fail to reveal the original reasoning process of GNNs raises the need of building GNNs with built-in interpretability. In this work, we propose Prototype Graph Neural Network (ProtGNN), which combines prototype learning with GNNs and provides a new perspective on the explanations of GNNs. In ProtGNN, the explanations are naturally derived from the case-based reasoning process and are actually used during classification. The prediction of ProtGNN is obtained by comparing the inputs to a few learned prototypes in the latent space. Furthermore, for better interpretability and higher efficiency, a novel conditional subgraph sampling module is incorporated to indicate which part of the input graph is most similar to each prototype in ProtGNN+. Finally, we evaluate our method on a wide range of datasets and perform concrete case studies. Extensive results show that ProtGNN and ProtGNN+ can provide inherent interpretability while achieving accuracy on par with the non-interpretable counterparts.
Key facts. Cited by 96 papers in the map (data through 14 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 2 Dec 2021.
Builds on
25 of 39 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
- 2020Parameterized Explainer for Graph Neural Networkcited by 426
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 384
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 281
13 more
- 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 211
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2019Explainability Techniques for Graph Convolutional Networkscited by 161
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2020Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networkscited by 153
- 2020Interpreting Graph Neural Networks for NLP With Differentiable Edge Maskingcited by 153
- 2020Backdoor Attacks to Graph Neural Networkscited by 128
- 2019Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspectivecited by 73
- 2019Interpretable and Steerable Sequence Learning via Prototypescited by 72
- 2021GraphMI: Extracting Private Graph Data from Graph Neural Networkscited by 50
- 2018Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Insteadcited by 40
- 2019Layerwise Relevance Visualization in Convolutional Text Graph Classifierscited by 32
Built on by
Citing papers per year: 2021: 1; 2022: 16; 2023: 27; 2024: 16; 2025: 20; 2026: 16.
96 papers.
Sort:
By area:
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2022Hierarchical Graph Transformer with Adaptive Node Samplingcited by 72
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 65
- 2024A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challengescited by 54
- 2023Unnoticeable Backdoor Attacks on Graph Neural Networkscited by 45
- 2023Backdoor Defense via Deconfounded Representation Learningcited by 38
- 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 35
- 2023ProtoSeg: Interpretable Semantic Segmentation with Prototypical Partscited by 33
- 2023A Survey on Explainability of Graph Neural Networkscited by 29
38 more
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
- 2022Model Inversion Attacks against Graph Neural Networkscited by 26
- 2023Learning Subpocket Prototypes for Generalizable Structure-based Drug Designcited by 25
- 2023ICICLE: Interpretable Class Incremental Continual Learningcited by 24
- 2023Interpretable Prototype-based Graph Information Bottleneckcited by 23
- 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
- 2022BrainIB: Interpretable Brain Network-based Psychiatric Diagnosis with Graph Information Bottleneckcited by 17
- 2023CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosiscited by 16
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 16
- 2024LucidPPN: Unambiguous Prototypical Parts Network for User-centric Interpretable Computer Visioncited by 15
- 2022Towards Prototype-Based Self-Explainable Graph Neural Networkcited by 14
- 2022Towards Faithful and Consistent Explanations for Graph Neural Networkscited by 13
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasonscited by 12
- 2023Probing Graph Representationscited by 10
- 2023An Equivariant Generative Framework for Molecular Graph-Structure Co-Designcited by 10
- 2023Prototype-Based Interpretability for Legal Citation Predictioncited by 9
- 2024Self-Explainable Temporal Graph Networks based on Graph Information Bottleneckcited by 9
- 2022ProGReST: Prototypical Graph Regression Soft Trees for Molecular Property Predictioncited by 8
- 2024Unveiling Global Interactive Patterns across Graphs: Towards Interpretable Graph Neural Networkscited by 8
- 2022L2XGNN: Learning to Explain Graph Neural Networkscited by 7
- 2022MEGAN: Multi-Explanation Graph Attention Networkcited by 7
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
- 2025Recent Advances in Malware Detection: Graph Learning and Explainabilitycited by 7
- 2022DT+GNN: A Fully Explainable Graph Neural Network using Decision Treescited by 6
- 2023Faithful and Consistent Graph Neural Network Explanations with Rationale Alignmentcited by 6
- 2022Privacy and Transparency in Graph Machine Learning: A Unified Perspectivecited by 5
- 2023Interpretable Graph Neural Networks for Tabular Datacited by 5
- 2023How Faithful are Self-Explainable GNNs?cited by 5
- 2025SoREX: Towards Self-Explainable Social Recommendation with Relevant Ego-Path Extractioncited by 5
- 2026GNN Explanations that do not Explain and How to find Themcited by 5
- 2023Robust Ante-hoc Graph Explainer using Bilevel Optimizationcited by 4
- 2023Prototypes as Explanation for Time Series Anomaly Detectioncited by 4
- 2023Interpretable Graph Networks Formulate Universal Algebra Conjecturescited by 4
- 2023Bridging Trustworthiness and Open-World Learning: An Exploratory Neural Approach for Enhancing Interpretability, Generalization, and Robustnesscited by 4
- 2024Towards Few-shot Self-explaining Graph Neural Networkscited by 4
- 2025From GNNs to Trees: Multi-Granular Interpretability for Graph Neural Networkscited by 4
- 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Datacited by 4
- 2025SIDE: Sparse Information Disentanglement for Explainable Artificial Intelligencecited by 4
50 most cited of 96 All 96 (JSON)
- 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing30 Sep 2026
- 2026Self-Explainable Multi-Label Graph Neural Network for Correlated Evidence Attribution27 Aug 2026
- 2026A Generalized Tikhonov Layer for Interpretable-by-design Graph Neural Networks27 May 2026
- 2026ST-TGExplainer: Disentangling Stability and Transition Patterns for Temporal GNN Interpretability19 May 2026
- 2026AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks14 May 2026
- 2026Why Self-Inconsistency Arises in GNN Explanations and How to Exploit It8 May 2026
- 2026GRAFT: Auditing Graph Neural Networks via Global Feature Attribution5 May 2026
- 2026Aitchison Embeddings for Learning Compositional Graph Representations1 May 2026
- 2026Concept Graph Convolutions: Message Passing in the Concept Space22 Apr 2026
- 2026Subgraph Concept Networks: Concept Levels in Graph Classification20 Apr 2026
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learning13 Apr 2026
- 2026P2GNN: Two Prototype Sets to boost GNN Performance10 Mar 2026
38 more
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layer2 Mar 2026
- 2026PIME: Prototype-based Interpretable MCTS-Enhanced Brain Network Analysis for Disorder Diagnosis24 Feb 2026
- 2026GNN Explanations that do not Explain and How to find Them28 Jan 2026
- 2026Combating Spurious Correlations in Graph Interpretability via Self-Reflection16 Jan 2026
- 2025A graph generation pipeline for critical infrastructures based on heuristics, images and depth data8 Dec 2025
- 2025ARM-Explainer -- Explaining and improving graph neural network predictions for the maximum clique problem using node features and association rule mining28 Nov 2025
- 2025PruneGCRN: Minimizing and explaining spatio-temporal problems through node pruning12 Oct 2025
- 2025Instance Relation Learning Network with Label Knowledge Propagation for Few-shot Multi-label Intent Detection9 Oct 2025
- 2025SoREX: Towards Self-Explainable Social Recommendation with Relevant Ego-Path Extraction30 Sep 2025
- 2025SEASONED: Semantic-Enhanced Self-Counterfactual Explainable Detection of Adversarial Exploiter Contracts6 Sep 2025
- 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependencies15 Aug 2025
- 2025SIDE: Sparse Information Disentanglement for Explainable Artificial Intelligence25 Jul 2025
- 2025Explainable Graph Neural Networks via Structural Externalities19 Jul 2025
- 2025Comprehensive Evaluation of Prototype Neural Networks9 Jul 2025
- 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Data28 May 2025
- 2025Framework GNN-AID: Graph Neural Network Analysis Interpretation and Defense6 May 2025
- 2025From GNNs to Trees: Multi-Granular Interpretability for Graph Neural Networks1 May 2025
- 2025Interpretable High-order Knowledge Graph Neural Network for Predicting Synthetic Lethality in Human Cancers8 Mar 2025
- 2025Recent Advances in Malware Detection: Graph Learning and Explainability14 Feb 2025
- 2025This looks like what? Challenges and Future Research Directions for Part-Prototype Models13 Feb 2025
- 2025Explain Yourself, Briefly! Self-Explaining Neural Networks with Concise Sufficient Reasons5 Feb 2025
- 2025scBIT: Integrating Single-cell Transcriptomic Data into fMRI-based Prediction for Alzheimer's Disease Diagnosis4 Feb 2025
- 2025A Comprehensive Survey on Self-Interpretable Neural Networks26 Jan 2025
- 2025Personalized Layer Selection for Graph Neural Networks24 Jan 2025
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learning30 Nov 2024
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Concepts10 Oct 2024
- 2024Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process2 Oct 2024
- 2024PAGE: Parametric Generative Explainer for Graph Neural Network26 Aug 2024
- 2024Interpretable Graph Neural Networks for Heterogeneous Tabular Data14 Aug 2024
- 2024Towards Few-shot Self-explaining Graph Neural Networks14 Aug 2024
- 2024Graph Dimension Attention Networks for Enterprise Credit Assessment16 Jul 2024
- 2024SES: Bridging the Gap Between Explainability and Prediction of Graph Neural Networks16 Jul 2024
- 2024Unveiling Global Interactive Patterns across Graphs: Towards Interpretable Graph Neural Networks2 Jul 2024
- 2024Temporal Prototype-Aware Learning for Active Voltage Control on Power Distribution Networks25 Jun 2024
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs21 Jun 2024
- 2024Self-Explainable Temporal Graph Networks based on Graph Information Bottleneck19 Jun 2024
- 2024Motif-driven Subgraph Structure Learning for Graph Classification13 Jun 2024
- 2024LucidPPN: Unambiguous Prototypical Parts Network for User-centric Interpretable Computer Vision23 May 2024
50 newest of 96 All 96 (JSON)
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2022Hierarchical Graph Transformer with Adaptive Node Samplingcited by 72
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 65
- 2024A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challengescited by 54
- 2023Unnoticeable Backdoor Attacks on Graph Neural Networkscited by 45
- 2023Backdoor Defense via Deconfounded Representation Learningcited by 38
- 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 35
- 2023ProtoSeg: Interpretable Semantic Segmentation with Prototypical Partscited by 33
- 2023A Survey on Explainability of Graph Neural Networkscited by 29
12 most cited of 93 All 93 (JSON)
- 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing30 Sep 2026
- 2026Self-Explainable Multi-Label Graph Neural Network for Correlated Evidence Attribution27 Aug 2026
- 2026A Generalized Tikhonov Layer for Interpretable-by-design Graph Neural Networks27 May 2026
- 2026ST-TGExplainer: Disentangling Stability and Transition Patterns for Temporal GNN Interpretability19 May 2026
- 2026AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks14 May 2026
- 2026Why Self-Inconsistency Arises in GNN Explanations and How to Exploit It8 May 2026
- 2026GRAFT: Auditing Graph Neural Networks via Global Feature Attribution5 May 2026
- 2026Aitchison Embeddings for Learning Compositional Graph Representations1 May 2026
- 2026Subgraph Concept Networks: Concept Levels in Graph Classification20 Apr 2026
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learning13 Apr 2026
- 2026P2GNN: Two Prototype Sets to boost GNN Performance10 Mar 2026
- 2026PIME: Prototype-based Interpretable MCTS-Enhanced Brain Network Analysis for Disorder Diagnosis24 Feb 2026
12 newest of 93 All 93 (JSON)