GraphLIME: Local Interpretable Model Explanations for Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph structured data has wide applicability in various domains such as physics, chemistry, biology, computer vision, and social networks, to name a few. Recently, graph neural networks (GNN) were shown to be successful in effectively representing graph structured data because of their good performance and generalization ability. GNN is a deep learning based method that learns a node representation by combining specific nodes and the structural/topological information of a graph. However, like other deep models, explaining the effectiveness of GNN models is a challenging task because of the complex nonlinear transformations made over the iterations. In this paper, we propose GraphLIME, a local interpretable model explanation for graphs using the Hilbert-Schmidt Independence Criterion (HSIC) Lasso, which is a nonlinear feature selection method. GraphLIME is a generic GNN-model explanation framework that learns a nonlinear interpretable model locally in the subgraph of the node being explained. More specifically, to explain a node, we generate a nonlinear interpretable model from its N-hop neighborhood and then compute the K most representative features as the explanations of its prediction using HSIC Lasso. Through experiments on two real-world datasets, the explanations of GraphLIME are found to be of extraordinary degree and more descriptive in comparison to the existing explanation methods.
Key facts. Cited by 209 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 54; 2023: 41; 2024: 42; 2025: 29; 2026: 12.
209 papers.
Sort:
By area:
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 118
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2022XAI for Transformers: Better Explanations through Conservative Propagationcited by 100
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Graph Neural Networks in Network Neurosciencecited by 91
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2022Evaluating Explainability for Graph Neural Networkscited by 85
- 2022Learning and Evaluating Graph Neural Network Explanations based on Counterfactual and Factual Reasoningcited by 78
38 more
- 2021Towards Self-Explainable Graph Neural Networkcited by 75
- 2022Global Explainability of GNNs via Logic Combination of Learned Conceptscited by 64
- 2021GraphSVX: Shapley Value Explanations for Graph Neural Networkscited by 63
- 2022GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networkscited by 57
- 2021Explainability-based Backdoor Attacks Against Graph Neural Networkscited by 42
- 2022GStarX: Explaining Graph Neural Networks with Structure-Aware Cooperative Gamescited by 42
- 2023A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIMEcited by 42
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2023SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimizationcited by 35
- 2021Zorro: Valid, Sparse, and Stable Explanations in Graph Neural Networkscited by 34
- 2022Reinforced Causal Explainer for Graph Neural Networkscited by 34
- 2022GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural Networkscited by 34
- 2022Explaining the Explainers in Graph Neural Networks: a Comparative Studycited by 34
- 2021Counterfactual Graphs for Explainable Classification of Brain Networkscited by 33
- 2021MEG: Generating Molecular Counterfactual Explanations for Deep Graph Networkscited by 32
- 2024Alleviating Structural Distribution Shift in Graph Anomaly Detectioncited by 31
- 2023Joint Learning of Label and Environment Causal Independence for Graph Out-of-Distribution Generalizationcited by 29
- 2023A Survey on Explainability of Graph Neural Networkscited by 28
- 2022Interpretable Geometric Deep Learning via Learnable Randomness Injectioncited by 27
- 2023DAG Matters! GFlowNets Enhanced Explainer For Graph Neural Networkscited by 27
- 2023TempME: Towards the Explainability of Temporal Graph Neural Networks via Motif Discoverycited by 27
- 2022A Survey of Explainable Graph Neural Networks: Taxonomy and Evaluation Metricscited by 26
- 2023PaGE-Link: Path-based Graph Neural Network Explanation for Heterogeneous Link Predictioncited by 25
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanationscited by 22
- 2023Counterfactual Learning on Graphs: A Surveycited by 22
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protectioncited by 20
- 2022FlowX: Towards Explainable Graph Neural Networks via Message Flowscited by 20
- 2024Uncertainty in Graph Neural Networks: A Surveycited by 20
- 2023Explainable Brain Age Prediction using coVariance Neural Networkscited by 19
- 2021Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networkscited by 18
- 2021Jointly Attacking Graph Neural Network and its Explanationscited by 18
- 2023Distill n' Explain: explaining graph neural networks using simple surrogatescited by 18
- 2023DEGREE: Decomposition Based Explanation For Graph Neural Networkscited by 18
- 2021SurvNAM: The machine learning survival model explanationcited by 16
- 2022Private Graph Extraction via Feature Explanationscited by 16
- 2022Characterizing the Influence of Graph Elementscited by 16
- 2021A Meta-Learning Approach for Training Explainable Graph Neural Networkscited by 15
- 2021Explainable Deep Learning in Healthcare: A Methodological Survey from an Attribution Viewcited by 15
50 most cited of 209 All 209 (JSON)
- 2026A unified framework for global and local interpretability using adaptive derivative-ordered random explanation15 Sep 2026
- 2026Neuro-Geospatial Modelling of EEG Affective States Using Literature-Informed Environmental Context21 Aug 2026
- 2026Towards Faithful Graph Explanations with Synergistic Edge Effects via Granular Balls23 Jul 2026
- 2026ConceptSMILE: Auditing the Trustworthiness of Concept-Based Explainable AI10 Jul 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026Towards the Explainability of Temporal Graph Networks via Memory Backtracking and Topological Attribution4 Jul 2026
- 2026CIExplainer++: Generating Causal and Interpretable Explanations for Graph Neural Networks17 Jun 2026
- 2026HiSE: A Lightweight Hierarchical Semantic Explainer for Heterogeneous Graph Neural Networks2 Jun 2026
- 2026Estimating Subgraph Importance with Structural Prior Domain Knowledge12 May 2026
- 2026Graph Reconstruction from Differentially Private GNN Explanations5 May 2026
- 2026Poisoning the Inner Prediction Logic of Graph Neural Networks for Clean-Label Backdoor Attacks5 Mar 2026
- 2026Combating Spurious Correlations in Graph Interpretability via Self-Reflection16 Jan 2026
38 more
- 2025GRExplainer: A Universal Explanation Method for Temporal Graph Neural Networks28 Dec 2025
- 2025QGShap: Quantum Acceleration for Faithful GNN Explanations1 Dec 2025
- 2025InteractiveGNNExplainer: A Visual Analytics Framework for Multi-Faceted Understanding and Probing of Graph Neural Network Predictions17 Nov 2025
- 2025Robust GNN Watermarking via Implicit Perception of Topological Invariants29 Oct 2025
- 2025QGraphLIME - Explaining Quantum Graph Neural Networks7 Oct 2025
- 2025Adaptive Node Feature Selection For Graph Neural Networks3 Oct 2025
- 2025Interpretable Neuropsychiatric Diagnosis via Concept-Guided Graph Neural Networks2 Oct 2025
- 2025GnnXemplar: Exemplars to Explanations -- Natural Language Rules for Global GNN Interpretability22 Sep 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2025Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Process23 Aug 2025
- 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependencies15 Aug 2025
- 2025Hypergraph Neural Network with State Space Models for Node Classification8 Aug 2025
- 2025NAEx: A Plug-and-Play Framework for Explaining Network Alignment5 Aug 2025
- 2025Explainable Graph Neural Networks via Structural Externalities19 Jul 2025
- 2025Exp-Graph: How Connections Learn Facial Attributes in Graph-based Expression Recognition19 Jul 2025
- 2025Explain First, Trust Later: LLM-Augmented Explanations for Graph-Based Crypto Anomaly Detection17 Jun 2025
- 2025How do Probabilistic Graphical Models and Graph Neural Networks Look at Network Data?13 Jun 2025
- 2025FIGNN: Feature-Specific Interpretability for Graph Neural Network Surrogate Models13 Jun 2025
- 2025Explaining Large Language Models with gSMILE27 May 2025
- 2025Statistical Test for Saliency Maps of Graph Neural Networks via Selective Inference22 May 2025
- 2025RISE: Radius of Influence based Subgraph Extraction for 3D Molecular Graph Explanation4 May 2025
- 2025Explaining Vision GNNs: A Semantic and Visual Analysis of Graph-based Image Classification28 Apr 2025
- 2025Which LIME should I trust? Concepts, Challenges, and Solutions31 Mar 2025
- 2025Interpretability of Graph Neural Networks to Assess Effects of Global Change Drivers on Ecological Networks19 Mar 2025
- 2025Adaptive Backdoor Attacks with Reasonable Constraints on Graph Neural Networks12 Mar 2025
- 2025Interpretable High-order Knowledge Graph Neural Network for Predicting Synthetic Lethality in Human Cancers8 Mar 2025
- 2025Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representations23 Feb 2025
- 2025Recent Advances in Malware Detection: Graph Learning and Explainability14 Feb 2025
- 2025Watermarking Graph Neural Networks via Explanations for Ownership Protection9 Jan 2025
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILE20 Dec 2024
- 2024MBExplainer: Multilevel bandit-based explanations for downstream models with augmented graph embeddings1 Nov 2024
- 2024Vision Paper: Designing Graph Neural Networks in Compliance with the European Artificial Intelligence Act29 Oct 2024
- 2024Disentangled and Self-Explainable Node Representation Learning28 Oct 2024
- 2024Demonstration Based Explainable AI for Learning from Demonstration Methods8 Oct 2024
- 2024Redesigning graph filter-based GNNs to relax the homophily assumption13 Sep 2024
- 2024PAGE: Parametric Generative Explainer for Graph Neural Network26 Aug 2024
- 2024DRExplainer: Quantifiable Interpretability in Drug Response Prediction with Directed Graph Convolutional Network22 Aug 2024
- 2024GraphFSA: A Finite State Automaton Framework for Algorithmic Learning on Graphs20 Aug 2024
50 newest of 209 All 209 (JSON)
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 118
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2022XAI for Transformers: Better Explanations through Conservative Propagationcited by 100
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Graph Neural Networks in Network Neurosciencecited by 91
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2022Evaluating Explainability for Graph Neural Networkscited by 85
- 2022Learning and Evaluating Graph Neural Network Explanations based on Counterfactual and Factual Reasoningcited by 78
12 most cited of 205 All 205 (JSON)
- 2026A unified framework for global and local interpretability using adaptive derivative-ordered random explanation15 Sep 2026
- 2026Neuro-Geospatial Modelling of EEG Affective States Using Literature-Informed Environmental Context21 Aug 2026
- 2026Towards Faithful Graph Explanations with Synergistic Edge Effects via Granular Balls23 Jul 2026
- 2026ConceptSMILE: Auditing the Trustworthiness of Concept-Based Explainable AI10 Jul 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026Towards the Explainability of Temporal Graph Networks via Memory Backtracking and Topological Attribution4 Jul 2026
- 2026CIExplainer++: Generating Causal and Interpretable Explanations for Graph Neural Networks17 Jun 2026
- 2026HiSE: A Lightweight Hierarchical Semantic Explainer for Heterogeneous Graph Neural Networks2 Jun 2026
- 2026Estimating Subgraph Importance with Structural Prior Domain Knowledge12 May 2026
- 2026Graph Reconstruction from Differentially Private GNN Explanations5 May 2026
- 2026Poisoning the Inner Prediction Logic of Graph Neural Networks for Clean-Label Backdoor Attacks5 Mar 2026
- 2026Combating Spurious Correlations in Graph Interpretability via Self-Reflection16 Jan 2026
12 newest of 205 All 205 (JSON)