Encoding Concepts in Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
The opaque reasoning of Graph Neural Networks induces a lack of human trust. Existing graph network explainers attempt to address this issue by providing post-hoc explanations, however, they fail to make the model itself more interpretable. To fill this gap, we introduce the Concept Encoder Module, the first differentiable concept-discovery approach for graph networks. The proposed approach makes graph networks explainable by design by first discovering graph concepts and then using these to solve the task. Our results demonstrate that this approach allows graph networks to: (i) attain model accuracy comparable with their equivalent vanilla versions, (ii) discover meaningful concepts that achieve high concept completeness and purity scores, (iii) provide high-quality concept-based logic explanations for their prediction, and (iv) support effective interventions at test time: these can increase human trust as well as significantly improve model performance.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 27 Jul 2022.
Builds on
31 of 47 references.
References · 31
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2020Concept Bottleneck Modelscited by 1,022
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
19 more
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2017The (Un)reliability of saliency methodscited by 331
- 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 241
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2020Concept Whitening for Interpretable Image Recognitioncited by 225
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 118
- 2020PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterestcited by 75
- 2021Robust Counterfactual Explanations on Graph Neural Networkscited by 72
- 2020Now You See Me (CME): Concept-based Model Extractioncited by 51
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2021Logic Explained Networkscited by 45
- 2021GCExplainer: Human-in-the-Loop Concept-based Explanations for Graph Neural Networkscited by 35
- 2022Trust in AI: Interpretability is not necessary or sufficient, while black-box interaction is necessary and sufficientcited by 13
- 2020MEME: Generating RNN Model Explanations via Model Extractioncited by 7
Built on by
Citing papers per year: 2022: 4; 2023: 8; 2024: 4; 2025: 0; 2026: 2.
18 papers.
Sort:
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 64
- 2023Interpretable Neural-Symbolic Concept Reasoningcited by 56
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Modelscited by 41
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2022MEGAN: Multi-Explanation Graph Attention Networkcited by 7
- 2022GCondNet: A Novel Method for Improving Neural Networks on Small High-Dimensional Tabular Datacited by 6
- 2023SHARCS: Shared Concept Space for Explainable Multimodal Learningcited by 6
- 2023Interpretable Graph Networks Formulate Universal Algebra Conjecturescited by 4
- 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Conceptscited by 2
- 2024Global Concept Explanations for Graphs by Contrastive Learningcited by 2
- 2024Automated Molecular Concept Generation and Labeling with Large Language Modelscited by 2
6 more
- 2023Quantifying the Intrinsic Usefulness of Attributional Explanations for Graph Neural Networks with Artificial Simulatability Studiescited by 1
- 2023Digital Histopathology with Graph Neural Networks: Concepts and Explanations for Clinicianscited by 1
- 2024Disentangled and Self-Explainable Node Representation Learningcited by 1
- 2023GCI: A (G)raph (C)oncept (I)nterpretation Frameworkcited by 0
- 2026Combating Spurious Correlations in Graph Interpretability via Self-Reflectioncited by 0
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learningcited by 0
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learning13 Apr 2026
- 2026Combating Spurious Correlations in Graph Interpretability via Self-Reflection16 Jan 2026
- 2024Disentangled and Self-Explainable Node Representation Learning28 Oct 2024
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs21 Jun 2024
- 2024Automated Molecular Concept Generation and Labeling with Large Language Models13 Jun 2024
- 2024Global Concept Explanations for Graphs by Contrastive Learning25 Apr 2024
- 2023Digital Histopathology with Graph Neural Networks: Concepts and Explanations for Clinicians4 Dec 2023
- 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Concepts25 Nov 2023
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Models29 Sep 2023
- 2023SHARCS: Shared Concept Space for Explainable Multimodal Learning1 Jul 2023
- 2023Quantifying the Intrinsic Usefulness of Attributional Explanations for Graph Neural Networks with Artificial Simulatability Studies25 May 2023
- 2023Interpretable Graph Networks Formulate Universal Algebra Conjectures17 May 2023
6 more
- 2023Interpretable Neural-Symbolic Concept Reasoning27 Apr 2023
- 2023GCI: A (G)raph (C)oncept (I)nterpretation Framework9 Feb 2023
- 2022MEGAN: Multi-Explanation Graph Attention Network23 Nov 2022
- 2022GCondNet: A Novel Method for Improving Neural Networks on Small High-Dimensional Tabular Data11 Nov 2022
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Study27 Oct 2022
- 2022Global Explainability of GNNs via Logic Combination of Learned Concepts13 Oct 2022
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 64
- 2023Interpretable Neural-Symbolic Concept Reasoningcited by 56
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Modelscited by 41
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 14
- 2022MEGAN: Multi-Explanation Graph Attention Networkcited by 7
- 2022GCondNet: A Novel Method for Improving Neural Networks on Small High-Dimensional Tabular Datacited by 6
- 2023SHARCS: Shared Concept Space for Explainable Multimodal Learningcited by 6
- 2023Interpretable Graph Networks Formulate Universal Algebra Conjecturescited by 4
- 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Conceptscited by 2
- 2024Global Concept Explanations for Graphs by Contrastive Learningcited by 2
- 2024Automated Molecular Concept Generation and Labeling with Large Language Modelscited by 2
12 most cited of 18 All 18 (JSON)
- 2026Exploring Concept Subspace for Self-explainable Text-Attributed Graph Learning13 Apr 2026
- 2026Combating Spurious Correlations in Graph Interpretability via Self-Reflection16 Jan 2026
- 2024Disentangled and Self-Explainable Node Representation Learning28 Oct 2024
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs21 Jun 2024
- 2024Automated Molecular Concept Generation and Labeling with Large Language Models13 Jun 2024
- 2024Global Concept Explanations for Graphs by Contrastive Learning25 Apr 2024
- 2023Digital Histopathology with Graph Neural Networks: Concepts and Explanations for Clinicians4 Dec 2023
- 2023Everybody Needs a Little HELP: Explaining Graphs via Hierarchical Concepts25 Nov 2023
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Models29 Sep 2023
- 2023SHARCS: Shared Concept Space for Explainable Multimodal Learning1 Jul 2023
- 2023Quantifying the Intrinsic Usefulness of Attributional Explanations for Graph Neural Networks with Artificial Simulatability Studies25 May 2023
- 2023Interpretable Graph Networks Formulate Universal Algebra Conjectures17 May 2023
12 newest of 18 All 18 (JSON)