On the Probability of Necessity and Sufficiency of Explaining Graph Neural Networks: A Lower Bound Optimization Approach
Not on the map. Why?
Abstract (arXiv)
The explainability of Graph Neural Networks (GNNs) is critical to various GNN applications, yet it remains a significant challenge. A convincing explanation should be both necessary and sufficient simultaneously. However, existing GNN explaining approaches focus on only one of the two aspects, necessity or sufficiency, or a heuristic trade-off between the two. Theoretically, the Probability of Necessity and Sufficiency (PNS) holds the potential to identify the most necessary and sufficient explanation since it can mathematically quantify the necessity and sufficiency of an explanation. Nevertheless, the difficulty of obtaining PNS due to non-monotonicity and the challenge of counterfactual estimation limit its wide use. To address the non-identifiability of PNS, we resort to a lower bound of PNS that can be optimized via counterfactual estimation, and propose a framework of Necessary and Sufficient Explanation for GNN (NSEG) via optimizing that lower bound. Specifically, we depict the GNN as a structural causal model (SCM), and estimate the probability of counterfactual via the intervention under the SCM. Additionally, we leverage continuous masks with a sampling strategy to optimize the lower bound to enhance the scalability. Empirical results demonstrate that NSEG outperforms state-of-the-art methods, consistently generating the most necessary and sufficient explanations.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 45 of its 84 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
45 of 84 references.
References · 45
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
33 more
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 301
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2021Towards Causal Representation Learningcited by 207
- 2019Explainability Techniques for Graph Convolutional Networkscited by 160
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
- 2021CF-GNNExplainer: Counterfactual Explanations for Graph Neural Networkscited by 118
- 2013Probabilities of Causation: Bounds and Identificationcited by 89
- 2020Scalable Graph Neural Networks via Bidirectional Propagationcited by 87
- 2022Evaluating Explainability for Graph Neural Networkscited by 85
- 2022Learning and Evaluating Graph Neural Network Explanations based on Counterfactual and Factual Reasoningcited by 78
- 2019Neural Network Attributions: A Causal Perspectivecited by 77
- 2021User Preference-aware Fake News Detectioncited by 76
- 2017A causal framework for explaining the predictions of black-box sequence-to-sequence modelscited by 58
- 2022GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networkscited by 57
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2021Knowledge-aware Coupled Graph Neural Network for Social Recommendationcited by 49
- 2021Local Explanations via Necessity and Sufficiency: Unifying Theory and Practicecited by 45
- 2021GCExplainer: Human-in-the-Loop Concept-based Explanations for Graph Neural Networkscited by 35
- 2022Reinforced Causal Explainer for Graph Neural Networkscited by 34
- 2022Causal Explanations and XAIcited by 30
- 2022HAQJSK: Hierarchical-Aligned Quantum Jensen-Shannon Kernels for Graph Classificationcited by 18
- 2022ProtoCLIP: Prototypical Contrastive Language Image Pretrainingcited by 5
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 4.
11 papers.
- 2023Counterfactual Learning on Graphs: A Surveycited by 22
- 2024Feature Attribution with Necessity and Sufficiency via Dual-stage Perturbation Test for Causal Explanationcited by 6
- 2024Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiencycited by 3
- 2024Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiencycited by 2
- 2026ATEX-CF: Attack-Informed Counterfactual Explanations for Graph Neural Networkscited by 2
- 2023Adapting to Change: Robust Counterfactual Explanations in Dynamic Data Landscapescited by 1
- 2025Learning Marked Temporal Point Process Explanations based on Counterfactual and Factual Reasoningcited by 0
- 2025SEASONED: Semantic-Enhanced Self-Counterfactual Explainable Detection of Adversarial Exploiter Contractscited by 0
- 2026Regional Explanations via Causal Sufficiency and Necessitycited by 0
- 2026RACE: Relation-Level Counterfactual Explanations for Heterogeneous Graph Neural Networkscited by 0
- 2026Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphscited by 0
- 2026Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphs29 Sep 2026
- 2026RACE: Relation-Level Counterfactual Explanations for Heterogeneous Graph Neural Networks29 Sep 2026
- 2026Regional Explanations via Causal Sufficiency and Necessity16 Sep 2026
- 2026ATEX-CF: Attack-Informed Counterfactual Explanations for Graph Neural Networks5 Feb 2026
- 2025SEASONED: Semantic-Enhanced Self-Counterfactual Explainable Detection of Adversarial Exploiter Contracts6 Sep 2025
- 2025Learning Marked Temporal Point Process Explanations based on Counterfactual and Factual Reasoning16 Aug 2025
- 2024Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiency21 Jul 2024
- 2024Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiency14 Feb 2024
- 2024Feature Attribution with Necessity and Sufficiency via Dual-stage Perturbation Test for Causal Explanation13 Feb 2024
- 2023Adapting to Change: Robust Counterfactual Explanations in Dynamic Data Landscapes4 Aug 2023
- 2023Counterfactual Learning on Graphs: A Survey3 Apr 2023