Layerwise Relevance Visualization in Convolutional Text Graph Classifiers
Not on the map. Why?
Abstract (arXiv)
Representations in the hidden layers of Deep Neural Networks (DNN) are often hard to interpret since it is difficult to project them into an interpretable domain. Graph Convolutional Networks (GCN) allow this projection, but existing explainability methods do not exploit this fact, i.e. do not focus their explanations on intermediate states. In this work, we present a novel method that traces and visualizes features that contribute to a classification decision in the visible and hidden layers of a GCN. Our method exposes hidden cross-layer dynamics in the input graph structure. We experimentally demonstrate that it yields meaningful layerwise explanations for a GCN sentence classifier.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 8; 2023: 7; 2024: 5; 2025: 4; 2026: 1.
32 papers.
Sort:
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2022GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural Networkscited by 34
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2021HistoCartography: A Toolkit for Graph Analytics in Digital Pathologycited by 20
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protectioncited by 20
- 2023DEGREE: Decomposition Based Explanation For Graph Neural Networkscited by 18
- 2023Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecastingcited by 16
20 more
- 2024GNNShap: Scalable and Accurate GNN Explanation using Shapley Valuescited by 12
- 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarkingcited by 11
- 2022Towards Explainable Motion Prediction using Heterogeneous Graph Representationscited by 10
- 2022Defending Against Backdoor Attack on Graph Nerual Network by Explainabilitycited by 9
- 2023Graph Neural Networks based Log Anomaly Detection and Explanationcited by 8
- 2024View-based Explanations for Graph Neural Networkscited by 8
- 2022L2XGNN: Learning to Explain Graph Neural Networkscited by 7
- 2022MEGAN: Multi-Explanation Graph Attention Networkcited by 7
- 2024GraphNarrator: Generating Textual Explanations for Graph Neural Networkscited by 7
- 2023ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learningcited by 5
- 2024Explainable Graph Neural Networks Under Firecited by 5
- 2021Towards the Explanation of Graph Neural Networks in Digital Pathology with Information Flowscited by 4
- 2024Generating Robust Counterfactual Witnesses for Graph Neural Networkscited by 4
- 2023Semantic Interpretation and Validation of Graph Attention-based Explanations for GNN Modelscited by 3
- 2023KS-GNNExplainer: Global Model Interpretation Through Instance Explanations On Histopathology imagescited by 1
- 2025Database Views as Explanations for Relational Deep Learningcited by 1
- 2025Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Processcited by 0
- 2025ProteinPNet: Prototypical Part Networks for Concept Learning in Spatial Proteomicscited by 0
- 2025QGShap: Quantum Acceleration for Faithful GNN Explanationscited by 0
- 2026TACENR: Task-Agnostic Contrastive Explanations for Node Representationscited by 0
- 2026TACENR: Task-Agnostic Contrastive Explanations for Node Representations21 Apr 2026
- 2025ProteinPNet: Prototypical Part Networks for Concept Learning in Spatial Proteomics2 Dec 2025
- 2025QGShap: Quantum Acceleration for Faithful GNN Explanations1 Dec 2025
- 2025Database Views as Explanations for Relational Deep Learning11 Sep 2025
- 2025Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Process23 Aug 2025
- 2024GraphNarrator: Generating Textual Explanations for Graph Neural Networks20 Oct 2024
- 2024Explainable Graph Neural Networks Under Fire10 Jun 2024
- 2024Generating Robust Counterfactual Witnesses for Graph Neural Networks30 Apr 2024
- 2024GNNShap: Scalable and Accurate GNN Explanation using Shapley Values9 Jan 2024
- 2024View-based Explanations for Graph Neural Networks4 Jan 2024
- 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarking3 Oct 2023
- 2023Semantic Interpretation and Validation of Graph Attention-based Explanations for GNN Models8 Aug 2023
20 more
- 2023ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learning3 Jul 2023
- 2023Graph Neural Networks based Log Anomaly Detection and Explanation2 Jul 2023
- 2023DEGREE: Decomposition Based Explanation For Graph Neural Networks22 May 2023
- 2023Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecasting16 May 2023
- 2023KS-GNNExplainer: Global Model Interpretation Through Instance Explanations On Histopathology images14 Apr 2023
- 2022Towards Explainable Motion Prediction using Heterogeneous Graph Representations7 Dec 2022
- 2022MEGAN: Multi-Explanation Graph Attention Network23 Nov 2022
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Study27 Oct 2022
- 2022L2XGNN: Learning to Explain Graph Neural Networks28 Sep 2022
- 2022GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural Networks15 Sep 2022
- 2022Defending Against Backdoor Attack on Graph Nerual Network by Explainability7 Sep 2022
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protection20 May 2022
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainability18 Apr 2022
- 2021Towards the Explanation of Graph Neural Networks in Digital Pathology with Information Flows18 Dec 2021
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networks2 Dec 2021
- 2021HistoCartography: A Toolkit for Graph Analytics in Digital Pathology21 Jul 2021
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathology1 Jul 2021
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future27 May 2021
- 2021Benchmarking and Survey of Explanation Methods for Black Box Models25 Feb 2021
- 2021On Explainability of Graph Neural Networks via Subgraph Explorations9 Feb 2021
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2022GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural Networkscited by 34
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2021HistoCartography: A Toolkit for Graph Analytics in Digital Pathologycited by 20
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protectioncited by 20
- 2023DEGREE: Decomposition Based Explanation For Graph Neural Networkscited by 18
- 2023Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecastingcited by 16
12 most cited of 32 All 32 (JSON)
- 2026TACENR: Task-Agnostic Contrastive Explanations for Node Representations21 Apr 2026
- 2025ProteinPNet: Prototypical Part Networks for Concept Learning in Spatial Proteomics2 Dec 2025
- 2025QGShap: Quantum Acceleration for Faithful GNN Explanations1 Dec 2025
- 2025Database Views as Explanations for Relational Deep Learning11 Sep 2025
- 2025Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Process23 Aug 2025
- 2024GraphNarrator: Generating Textual Explanations for Graph Neural Networks20 Oct 2024
- 2024Explainable Graph Neural Networks Under Fire10 Jun 2024
- 2024Generating Robust Counterfactual Witnesses for Graph Neural Networks30 Apr 2024
- 2024GNNShap: Scalable and Accurate GNN Explanation using Shapley Values9 Jan 2024
- 2024View-based Explanations for Graph Neural Networks4 Jan 2024
- 2023GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarking3 Oct 2023
- 2023Semantic Interpretation and Validation of Graph Attention-based Explanations for GNN Models8 Aug 2023
12 newest of 32 All 32 (JSON)