CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosis
Not on the map. Why?
Abstract (arXiv)
There is a recent trend to leverage the power of graph neural networks (GNNs) for brain-network based psychiatric diagnosis, which,in turn, also motivates an urgent need for psychiatrists to fully understand the decision behavior of the used GNNs. However, most of the existing GNN explainers are either post-hoc in which another interpretive model needs to be created to explain a well-trained GNN, or do not consider the causal relationship between the extracted explanation and the decision, such that the explanation itself contains spurious correlations and suffers from weak faithfulness. In this work, we propose a granger causality-inspired graph neural network (CI-GNN), a built-in interpretable model that is able to identify the most influential subgraph (i.e., functional connectivity within brain regions) that is causally related to the decision (e.g., major depressive disorder patients or healthy controls), without the training of an auxillary interpretive network. CI-GNN learns disentangled subgraph-level representations α and beta that encode, respectively, the causal and noncausal aspects of original graph under a graph variational autoencoder framework, regularized by a conditional mutual information (CMI) constraint. We theoretically justify the validity of the CMI regulation in capturing the causal relationship. We also empirically evaluate the performance of CI-GNN against three baseline GNNs and four state-of-the-art GNN explainers on synthetic data and three large-scale brain disease datasets. We observe that CI-GNN achieves the best performance in a wide range of metrics and provides more reliable and concise explanations which have clinical evidence.The source code and implementation details of CI-GNN are freely available at GitHub repository (https://github.com/ZKZ-Brain/CI-GNN/).
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 37 of its 85 references that are in the map. First posted on arXiv 4 Jan 2023.
Builds on
37 of 85 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2018MINE: Mutual Information Neural Estimationcited by 680
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 375
25 more
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2019Explainability Techniques for Graph Convolutional Networkscited by 160
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Generalizing Graph Neural Networks on Out-Of-Distribution Graphscited by 69
- 2022Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysiscited by 58
- 2021Improving Subgraph Recognition with Variational Graph Information Bottleneckcited by 45
- 2020Generative causal explanations of black-box classifierscited by 41
- 2018Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Insteadcited by 40
- 2022Reinforced Causal Explainer for Graph Neural Networkscited by 34
- 2022OrphicX: A Causality-Inspired Latent Variable Model for Interpreting Graph Neural Networkscited by 33
- 2021Recognizing Predictive Substructures with Subgraph Information Bottleneckcited by 28
- 2022BrainIB: Interpretable Brain Network-based Psychiatric Diagnosis with Graph Information Bottleneckcited by 17
- 2021BrainNNExplainer: An Interpretable Graph Neural Network Framework for Brain Network based Disease Analysiscited by 13
- 2021Unsupervised Belief Representation Learning with Information-Theoretic Variational Graph Auto-Encoderscited by 12
- 2022Deep reinforcement learning guided graph neural networks for brain network analysiscited by 12
- 2019Brain Network Construction and Classification Toolbox (BrainNetClass)cited by 8
- 2019A Review on Neural Network Models of Schizophrenia and Autism Spectrum Disordercited by 8
- 2019Information Theoretic Feature Transformation Learning for Brain Interfacescited by 4
- 2019Modeling functional resting-state brain networks through neural message passing on the human connectomecited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 6; 2025: 6; 2026: 2.
16 papers.
Sort:
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2024Explaining Graph Neural Networks via Structure-aware Interaction Indexcited by 10
- 2023Exploring Causal Learning through Graph Neural Networks: An In-depth Reviewcited by 8
- 2024LOGIN: A Large Language Model Consulted Graph Neural Network Training Frameworkcited by 8
- 2025BACE: Behavior-Adaptive Connectivity Estimation for Interpretable Graphs of Neural Dynamicscited by 6
- 2025Causal Spherical Hypergraph Networks for Modelling Social Uncertaintycited by 5
- 2023When Graph Neural Network Meets Causality: Opportunities, Methodologies and An Outlookcited by 4
- 2024MHNet: Multi-view High-order Network for Diagnosing Neurodevelopmental Disorders Using Resting-state fMRIcited by 3
- 2024A Survey of Out-of-distribution Generalization for Graph Machine Learning from a Causal Viewcited by 3
- 2024Discovering robust biomarkers of psychiatric disorders from resting-state functional MRI via graph neural networks: A systematic reviewcited by 1
- 2025Beyond Pairwise Connections: Extracting High-Order Functional Brain Network Structures under Global Constraintscited by 1
- 2025Causal Graph Neural Networks for Healthcarecited by 1
4 more
- 2026SphUnc: Hyperspherical Uncertainty Decomposition and Causal Identification via Information Geometrycited by 1
- 2025Neurocircuitry-Inspired Hierarchical Graph Causal Attention Networks for Explainable Depression Identificationcited by 0
- 2025ARM-Explainer -- Explaining and improving graph neural network predictions for the maximum clique problem using node features and association rule miningcited by 0
- 2026Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderScited by 0
- 2026Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderS10 Jun 2026
- 2026SphUnc: Hyperspherical Uncertainty Decomposition and Causal Identification via Information Geometry1 Mar 2026
- 2025ARM-Explainer -- Explaining and improving graph neural network predictions for the maximum clique problem using node features and association rule mining28 Nov 2025
- 2025Neurocircuitry-Inspired Hierarchical Graph Causal Attention Networks for Explainable Depression Identification18 Nov 2025
- 2025Causal Graph Neural Networks for Healthcare4 Nov 2025
- 2025BACE: Behavior-Adaptive Connectivity Estimation for Interpretable Graphs of Neural Dynamics11 Oct 2025
- 2025Beyond Pairwise Connections: Extracting High-Order Functional Brain Network Structures under Global Constraints10 Oct 2025
- 2025Causal Spherical Hypergraph Networks for Modelling Social Uncertainty21 Jun 2025
- 2024A Survey of Out-of-distribution Generalization for Graph Machine Learning from a Causal View15 Sep 2024
- 2024MHNet: Multi-view High-order Network for Diagnosing Neurodevelopmental Disorders Using Resting-state fMRI3 Jul 2024
- 2024A Comprehensive Survey of Foundation Models in Medicine15 Jun 2024
- 2024Explaining Graph Neural Networks via Structure-aware Interaction Index23 May 2024
4 more
- 2024LOGIN: A Large Language Model Consulted Graph Neural Network Training Framework22 May 2024
- 2024Discovering robust biomarkers of psychiatric disorders from resting-state functional MRI via graph neural networks: A systematic review1 May 2024
- 2023When Graph Neural Network Meets Causality: Opportunities, Methodologies and An Outlook19 Dec 2023
- 2023Exploring Causal Learning through Graph Neural Networks: An In-depth Review25 Nov 2023
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2024Explaining Graph Neural Networks via Structure-aware Interaction Indexcited by 10
- 2023Exploring Causal Learning through Graph Neural Networks: An In-depth Reviewcited by 8
- 2024LOGIN: A Large Language Model Consulted Graph Neural Network Training Frameworkcited by 8
- 2025BACE: Behavior-Adaptive Connectivity Estimation for Interpretable Graphs of Neural Dynamicscited by 6
- 2025Causal Spherical Hypergraph Networks for Modelling Social Uncertaintycited by 5
- 2023When Graph Neural Network Meets Causality: Opportunities, Methodologies and An Outlookcited by 4
- 2024MHNet: Multi-view High-order Network for Diagnosing Neurodevelopmental Disorders Using Resting-state fMRIcited by 3
- 2024A Survey of Out-of-distribution Generalization for Graph Machine Learning from a Causal Viewcited by 3
- 2024Discovering robust biomarkers of psychiatric disorders from resting-state functional MRI via graph neural networks: A systematic reviewcited by 1
- 2025Beyond Pairwise Connections: Extracting High-Order Functional Brain Network Structures under Global Constraintscited by 1
- 2025Causal Graph Neural Networks for Healthcarecited by 1
12 most cited of 16 All 16 (JSON)
- 2026Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderS10 Jun 2026
- 2026SphUnc: Hyperspherical Uncertainty Decomposition and Causal Identification via Information Geometry1 Mar 2026
- 2025ARM-Explainer -- Explaining and improving graph neural network predictions for the maximum clique problem using node features and association rule mining28 Nov 2025
- 2025Neurocircuitry-Inspired Hierarchical Graph Causal Attention Networks for Explainable Depression Identification18 Nov 2025
- 2025Causal Graph Neural Networks for Healthcare4 Nov 2025
- 2025BACE: Behavior-Adaptive Connectivity Estimation for Interpretable Graphs of Neural Dynamics11 Oct 2025
- 2025Beyond Pairwise Connections: Extracting High-Order Functional Brain Network Structures under Global Constraints10 Oct 2025
- 2025Causal Spherical Hypergraph Networks for Modelling Social Uncertainty21 Jun 2025
- 2024A Survey of Out-of-distribution Generalization for Graph Machine Learning from a Causal View15 Sep 2024
- 2024MHNet: Multi-view High-order Network for Diagnosing Neurodevelopmental Disorders Using Resting-state fMRI3 Jul 2024
- 2024A Comprehensive Survey of Foundation Models in Medicine15 Jun 2024
- 2024Explaining Graph Neural Networks via Structure-aware Interaction Index23 May 2024
12 newest of 16 All 16 (JSON)