mlsanityData to 7 Oct 2026

Global Explainability of GNNs via Logic Combination of Learned Concepts

arXiv 2210.07147 ↗First posted 13 Oct 2022cs.LG cs.AI cs.LOcited by 64

Not on the map. Why?

Abstract (arXiv)

While instance-level explanation of GNN is a well-studied problem with plenty of approaches being developed, providing a global explanation for the behaviour of a GNN is much less explored, despite its potential in interpretability and debugging. Existing solutions either simply list local explanations for a given class, or generate a synthetic prototypical graph with maximal score for a given class, completely missing any combinatorial aspect that the GNN could have learned. In this work, we propose GLGExplainer (Global Logic-based GNN Explainer), the first Global Explainer capable of generating explanations as arbitrary Boolean combinations of learned graphical concepts. GLGExplainer is a fully differentiable architecture that takes local explanations as inputs and combines them into a logic formula over graphical concepts, represented as clusters of local explanations. Contrary to existing solutions, GLGExplainer provides accurate and human-interpretable global explanations that are perfectly aligned with ground-truth explanations (on synthetic data) or match existing domain knowledge (on real-world data). Extracted formulas are faithful to the model predictions, to the point of providing insights into some occasionally incorrect rules learned by the model, making GLGExplainer a promising diagnostic tool for learned GNNs.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 31 of its 46 references that are in the map. First posted on arXiv 13 Oct 2022.

Builds on

31 of 46 references.

References · 31

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  7. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  8. 2020Concept Bottleneck Modelscited by 1,022
  9. 2021How Attentive are Graph Attention Networks?cited by 818
  10. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
  11. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
  12. 2020Parameterized Explainer for Graph Neural Networkcited by 423
19 more
  1. 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
  2. 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
  3. 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
  4. 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
  5. 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
  6. 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
  7. 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
  8. 2021Generative Causal Explanations for Graph Neural Networkscited by 124
  9. 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
  10. 2022Evaluating Explainability for Graph Neural Networkscited by 85
  11. 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
  12. 2021Entropy-based Logic Explanations of Neural Networkscited by 51
  13. 2021GLocalX -- From Local to Global Explanations of Black Box AI Modelscited by 48
  14. 2021Logic Explained Networkscited by 45
  15. 2021GCExplainer: Human-in-the-Loop Concept-based Explanations for Graph Neural Networkscited by 35
  16. 2022OrphicX: A Causality-Inspired Latent Variable Model for Interpreting Graph Neural Networkscited by 33
  17. 2022Encoding Concepts in Graph Neural Networkscited by 18
  18. 2021Algorithmic Concept-based Explainable Reasoningcited by 12
  19. 2021An Efficient Procedure for Mining Egocentric Temporal Motifscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 17; 2024: 19; 2025: 13; 2026: 14.

64 papers.

Sort:

By area:

  1. 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 60
  2. 2023Interpretable Neural-Symbolic Concept Reasoningcited by 56
  3. 2023The expressive power of pooling in Graph Neural Networkscited by 35
  4. 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
  5. 2023A Survey on Explainability of Graph Neural Networkscited by 28
  6. 2023Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networkscited by 16
  7. 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
  8. 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarkingcited by 11
  9. 2024GOAt: Explaining Graph Neural Networks via Graph Output Attributioncited by 10
  10. 2025Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspectivecited by 10
  11. 2024A Logic for Reasoning About Aggregate-Combine Graph Neural Networkscited by 9
  12. 2023Factorized Explainer for Graph Neural Networkscited by 8
38 more
  1. 2024MAGE: Model-Level Graph Neural Networks Explanations via Motif-based Graph Generationcited by 7
  2. 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
  3. 2023State of the Art and Potentialities of Graph-level Learningcited by 6
  4. 2024Logical Distillation of Graph Neural Networkscited by 6
  5. 2025From Nodes to Narratives: Explaining Graph Neural Networks with LLMs and Graph Contextcited by 6
  6. 2023How Faithful are Self-Explainable GNNs?cited by 5
  7. 2024Faithful and Accurate Self-Attention Attribution for Message Passing Neural Networks via the Computation Tree Viewpointcited by 5
  8. 2023Interpretable Graph Networks Formulate Universal Algebra Conjecturescited by 4
  9. 2023Generative Explanations for Graph Neural Network: Methods and Evaluationscited by 4
  10. 2024Improving deep learning with prior knowledge and cognitive models: A survey on enhancing explainability, adversarial robustness and zero-shot learningcited by 4
  11. 2024Towards Few-shot Self-explaining Graph Neural Networkscited by 4
  12. 2025B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Datacited by 4
  13. 2023Globally Interpretable Graph Learning via Distribution Matchingcited by 3
  14. 2024Utilizing Description Logics for Global Explanations of Heterogeneous Graph Neural Networkscited by 3
  15. 2024xAI-Drop: Don't Use What You Cannot Explaincited by 3
  16. 2026GNN Explanations that do not Explain and How to find Themcited by 3
  17. 2023Unstructured and structured data: Can we have the best of both worlds with large language models?cited by 2
  18. 2023On the Robustness of Post-hoc GNN Explainers to Label Noisecited by 2
  19. 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Conceptscited by 2
  20. 2024Global Concept Explanations for Graphs by Contrastive Learningcited by 2
  21. 2024Interpreting Temporal Graph Neural Networks with Koopman Theorycited by 2
  22. 2025GnnXemplar: Exemplars to Explanations -- Natural Language Rules for Global GNN Interpretabilitycited by 2
  23. 2026Local-to-Global Logical Explanations for Deep Vision Modelscited by 2
  24. 2026Differentiable Rule Induction from Raw Sequence Inputscited by 2
  25. 2024Explainable Malware Detection with Tailored Logic Explained Networkscited by 1
  26. 2024Introducing Diminutive Causal Structure into Graph Representation Learningcited by 1
  27. 2024Interactive Explainable Anomaly Detection for Industrial Settingscited by 1
  28. 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependenciescited by 1
  29. 2025Sound Logical Explanations for Mean Aggregation Graph Neural Networkscited by 1
  30. 2026Beyond Message Passing: A Symbolic Alternative for Expressive and Interpretable Graph Learningcited by 1
  31. 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layercited by 1
  32. 2023Empowering Counterfactual Reasoning over Graph Neural Networks through Inductivitycited by 0
  33. 2023A Modal Logic for Explaining some Graph Neural Networkscited by 0
  34. 2024Design Requirements for Human-Centered Graph Neural Network Explanationscited by 0
  35. 2024PAGE: Parametric Generative Explainer for Graph Neural Networkcited by 0
  36. 2024Do graph neural network states contain graph properties?cited by 0
  37. 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstructioncited by 0
  38. 2025LogicXGNN: Grounded Logical Rules for Explaining Graph Neural Networkscited by 0

50 most cited of 64 All 64 (JSON)