Global Explainability of GNNs via Logic Combination of Learned Concepts
Not on the map. Why?
Abstract (arXiv)
While instance-level explanation of GNN is a well-studied problem with plenty of approaches being developed, providing a global explanation for the behaviour of a GNN is much less explored, despite its potential in interpretability and debugging. Existing solutions either simply list local explanations for a given class, or generate a synthetic prototypical graph with maximal score for a given class, completely missing any combinatorial aspect that the GNN could have learned. In this work, we propose GLGExplainer (Global Logic-based GNN Explainer), the first Global Explainer capable of generating explanations as arbitrary Boolean combinations of learned graphical concepts. GLGExplainer is a fully differentiable architecture that takes local explanations as inputs and combines them into a logic formula over graphical concepts, represented as clusters of local explanations. Contrary to existing solutions, GLGExplainer provides accurate and human-interpretable global explanations that are perfectly aligned with ground-truth explanations (on synthetic data) or match existing domain knowledge (on real-world data). Extracted formulas are faithful to the model predictions, to the point of providing insights into some occasionally incorrect rules learned by the model, making GLGExplainer a promising diagnostic tool for learned GNNs.
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 31 of its 46 references that are in the map. First posted on arXiv 13 Oct 2022.
Builds on
31 of 46 references.
References · 31
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2020Concept Bottleneck Modelscited by 1,022
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
19 more
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
- 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2022Evaluating Explainability for Graph Neural Networkscited by 85
- 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2021GLocalX -- From Local to Global Explanations of Black Box AI Modelscited by 48
- 2021Logic Explained Networkscited by 45
- 2021GCExplainer: Human-in-the-Loop Concept-based Explanations for Graph Neural Networkscited by 35
- 2022OrphicX: A Causality-Inspired Latent Variable Model for Interpreting Graph Neural Networkscited by 33
- 2022Encoding Concepts in Graph Neural Networkscited by 18
- 2021Algorithmic Concept-based Explainable Reasoningcited by 12
- 2021An Efficient Procedure for Mining Egocentric Temporal Motifscited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 17; 2024: 19; 2025: 13; 2026: 14.
64 papers.
Sort:
By area:
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 60
- 2023Interpretable Neural-Symbolic Concept Reasoningcited by 56
- 2023The expressive power of pooling in Graph Neural Networkscited by 35
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2023A Survey on Explainability of Graph Neural Networkscited by 28
- 2023Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networkscited by 16
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarkingcited by 11
- 2024GOAt: Explaining Graph Neural Networks via Graph Output Attributioncited by 10
- 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspectivecited by 10
- 2024A Logic for Reasoning About Aggregate-Combine Graph Neural Networkscited by 9
- 2023Factorized Explainer for Graph Neural Networkscited by 8
38 more
- 2024MAGE: Model-Level Graph Neural Networks Explanations via Motif-based Graph Generationcited by 7
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
- 2023State of the Art and Potentialities of Graph-level Learningcited by 6
- 2024Logical Distillation of Graph Neural Networkscited by 6
- 2025From Nodes to Narratives: Explaining Graph Neural Networks with LLMs and Graph Contextcited by 6
- 2023How Faithful are Self-Explainable GNNs?cited by 5
- 2024Faithful and Accurate Self-Attention Attribution for Message Passing Neural Networks via the Computation Tree Viewpointcited by 5
- 2023Interpretable Graph Networks Formulate Universal Algebra Conjecturescited by 4
- 2023Generative Explanations for Graph Neural Network: Methods and Evaluationscited by 4
- 2024Improving deep learning with prior knowledge and cognitive models: A survey on enhancing explainability, adversarial robustness and zero-shot learningcited by 4
- 2024Towards Few-shot Self-explaining Graph Neural Networkscited by 4
- 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Datacited by 4
- 2023Globally Interpretable Graph Learning via Distribution Matchingcited by 3
- 2024Utilizing Description Logics for Global Explanations of Heterogeneous Graph Neural Networkscited by 3
- 2024xAI-Drop: Don't Use What You Cannot Explaincited by 3
- 2026GNN Explanations that do not Explain and How to find Themcited by 3
- 2023Unstructured and structured data: Can we have the best of both worlds with large language models?cited by 2
- 2023On the Robustness of Post-hoc GNN Explainers to Label Noisecited by 2
- 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Conceptscited by 2
- 2024Global Concept Explanations for Graphs by Contrastive Learningcited by 2
- 2024Interpreting Temporal Graph Neural Networks with Koopman Theorycited by 2
- 2025GnnXemplar: Exemplars to Explanations -- Natural Language Rules for Global GNN Interpretabilitycited by 2
- 2026Local-to-Global Logical Explanations for Deep Vision Modelscited by 2
- 2026Differentiable Rule Induction from Raw Sequence Inputscited by 2
- 2024Explainable Malware Detection with Tailored Logic Explained Networkscited by 1
- 2024Introducing Diminutive Causal Structure into Graph Representation Learningcited by 1
- 2024Interactive Explainable Anomaly Detection for Industrial Settingscited by 1
- 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependenciescited by 1
- 2025Sound Logical Explanations for Mean Aggregation Graph Neural Networkscited by 1
- 2026Beyond Message Passing: A Symbolic Alternative for Expressive and Interpretable Graph Learningcited by 1
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layercited by 1
- 2023Empowering Counterfactual Reasoning over Graph Neural Networks through Inductivitycited by 0
- 2023A Modal Logic for Explaining some Graph Neural Networkscited by 0
- 2024Design Requirements for Human-Centered Graph Neural Network Explanationscited by 0
- 2024PAGE: Parametric Generative Explainer for Graph Neural Networkcited by 0
- 2024Do graph neural network states contain graph properties?cited by 0
- 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstructioncited by 0
- 2025LogicXGNN: Grounded Logical Rules for Explaining Graph Neural Networkscited by 0
50 most cited of 64 All 64 (JSON)
- 2026Controllable GNN Explanations via Multi-Metric Preference Selection26 Sep 2026
- 2026From Abductive Explanations to Global Logical Rules for Node Classification in SGCs17 Aug 2026
- 2026Overcoming Shortcut Learning in Graph Neural Networks through Active Explanation Guidance14 Aug 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026GLARE: A Natural Language Interface for Querying Global Explanations18 Jun 2026
- 2026AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks14 May 2026
- 2026Concept Graph Convolutions: Message Passing in the Concept Space22 Apr 2026
- 2026Subgraph Concept Networks: Concept Levels in Graph Classification20 Apr 2026
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learning13 Apr 2026
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layer2 Mar 2026
- 2026Beyond Message Passing: A Symbolic Alternative for Expressive and Interpretable Graph Learning18 Feb 2026
- 2026Differentiable Rule Induction from Raw Sequence Inputs14 Feb 2026
38 more
- 2026GNN Explanations that do not Explain and How to find Them28 Jan 2026
- 2026Local-to-Global Logical Explanations for Deep Vision Models19 Jan 2026
- 2025LearnAD: Learning Interpretable Rules for Brain Networks in Alzheimer's Disease Classification30 Dec 2025
- 2025Explainable Graph Representation Learning via Graph Pattern Analysis4 Dec 2025
- 2025ARM-Explainer -- Explaining and improving graph neural network predictions for the maximum clique problem using node features and association rule mining28 Nov 2025
- 2025Sound Logical Explanations for Mean Aggregation Graph Neural Networks27 Oct 2025
- 2025Exact Subgraph Isomorphism Network with Mixed L0,2 Norm Constraint for Predictive Graph Mining25 Sep 2025
- 2025GnnXemplar: Exemplars to Explanations -- Natural Language Rules for Global GNN Interpretability22 Sep 2025
- 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependencies15 Aug 2025
- 2025From Nodes to Narratives: Explaining Graph Neural Networks with LLMs and Graph Context9 Aug 2025
- 2025WILTing Trees: Interpreting the Distance Between MPNN Embeddings30 May 2025
- 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Data28 May 2025
- 2025LogicXGNN: Grounded Logical Rules for Explaining Graph Neural Networks25 Mar 2025
- 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstruction12 Mar 2025
- 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspective4 Feb 2025
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learning30 Nov 2024
- 2024Do graph neural network states contain graph properties?4 Nov 2024
- 2024Interpreting Temporal Graph Neural Networks with Koopman Theory17 Oct 2024
- 2024Interactive Explainable Anomaly Detection for Industrial Settings1 Oct 2024
- 2024PAGE: Parametric Generative Explainer for Graph Neural Network26 Aug 2024
- 2024Towards Few-shot Self-explaining Graph Neural Networks14 Aug 2024
- 2024xAI-Drop: Don't Use What You Cannot Explain29 Jul 2024
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs21 Jun 2024
- 2024Introducing Diminutive Causal Structure into Graph Representation Learning13 Jun 2024
- 2024Logical Distillation of Graph Neural Networks11 Jun 2024
- 2024Faithful and Accurate Self-Attention Attribution for Message Passing Neural Networks via the Computation Tree Viewpoint7 Jun 2024
- 2024Utilizing Description Logics for Global Explanations of Heterogeneous Graph Neural Networks21 May 2024
- 2024MAGE: Model-Level Graph Neural Networks Explanations via Motif-based Graph Generation21 May 2024
- 2024Design Requirements for Human-Centered Graph Neural Network Explanations11 May 2024
- 2024Explainable Malware Detection with Tailored Logic Explained Networks5 May 2024
- 2024A Logic for Reasoning About Aggregate-Combine Graph Neural Networks30 Apr 2024
- 2024Global Concept Explanations for Graphs by Contrastive Learning25 Apr 2024
- 2024Improving deep learning with prior knowledge and cognitive models: A survey on enhancing explainability, adversarial robustness and zero-shot learning11 Mar 2024
- 2024GOAt: Explaining Graph Neural Networks via Graph Output Attribution26 Jan 2024
- 2023Factorized Explainer for Graph Neural Networks9 Dec 2023
- 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Concepts25 Nov 2023
- 2023Generative Explanations for Graph Neural Network: Methods and Evaluations9 Nov 2023
- 2023Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networks3 Oct 2023
50 newest of 64 All 64 (JSON)
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 60
- 2023Interpretable Neural-Symbolic Concept Reasoningcited by 56
- 2023The expressive power of pooling in Graph Neural Networkscited by 35
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2023A Survey on Explainability of Graph Neural Networkscited by 28
- 2023Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networkscited by 16
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarkingcited by 11
- 2024GOAt: Explaining Graph Neural Networks via Graph Output Attributioncited by 10
- 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspectivecited by 10
- 2024A Logic for Reasoning About Aggregate-Combine Graph Neural Networkscited by 9
- 2023Factorized Explainer for Graph Neural Networkscited by 8
12 most cited of 62 All 62 (JSON)
- 2026Controllable GNN Explanations via Multi-Metric Preference Selection26 Sep 2026
- 2026From Abductive Explanations to Global Logical Rules for Node Classification in SGCs17 Aug 2026
- 2026Overcoming Shortcut Learning in Graph Neural Networks through Active Explanation Guidance14 Aug 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026GLARE: A Natural Language Interface for Querying Global Explanations18 Jun 2026
- 2026AIMing for Standardised Explainability Evaluation in GNNs: A Framework and Case Study on Graph Kernel Networks14 May 2026
- 2026Subgraph Concept Networks: Concept Levels in Graph Classification20 Apr 2026
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learning13 Apr 2026
- 2026Beyond Message Passing: A Symbolic Alternative for Expressive and Interpretable Graph Learning18 Feb 2026
- 2026Differentiable Rule Induction from Raw Sequence Inputs14 Feb 2026
- 2026GNN Explanations that do not Explain and How to find Them28 Jan 2026
- 2026Local-to-Global Logical Explanations for Deep Vision Models19 Jan 2026
12 newest of 62 All 62 (JSON)