Spatio-Temporal Graph Convolution for Resting-State fMRI Analysis
Not on the map. Why?
Abstract (arXiv)
The Blood-Oxygen-Level-Dependent (BOLD) signal of resting-state fMRI (rs-fMRI) records the temporal dynamics of intrinsic functional networks in the brain. However, existing deep learning methods applied to rs-fMRI either neglect the functional dependency between different brain regions in a network or discard the information in the temporal dynamics of brain activity. To overcome those shortcomings, we propose to formulate functional connectivity networks within the context of spatio-temporal graphs. We train a spatio-temporal graph convolutional network (ST-GCN) on short sub-sequences of the BOLD time series to model the non-stationary nature of functional connectivity. Simultaneously, the model learns the importance of graph edges within ST-GCN to gain insight into the functional connectivities contributing to the prediction. In analyzing the rs-fMRI of the Human Connectome Project (HCP, N=1,091) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA, N=773), ST-GCN is significantly more accurate than common approaches in predicting gender and age based on BOLD signals. Furthermore, the brain regions and functional connections significantly contributing to the predictions of our model are important markers according to the neuroscience literature.
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 13; 2023: 8; 2024: 8; 2025: 11; 2026: 9.
57 papers.
Sort:
By area:
- 2021Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attentioncited by 86
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2023NeuroGraph: Benchmarks for Graph Machine Learning in Brain Connectomicscited by 33
- 2022BolT: Fused Window Transformers for fMRI Time Series Analysiscited by 23
- 2021Self-Supervised Transformers for fMRI representationcited by 17
- 2024Graph Neural Networks for Brain Graph Learning: A Surveycited by 13
- 2021Improving Phenotype Prediction using Long-Range Spatio-Temporal Dynamics of Functional Connectivitycited by 9
- 2022Joint Graph Convolution for Analyzing Brain Structural and Functional Connectomecited by 9
- 2021A deep learning model for data-driven discovery of functional connectivitycited by 8
- 2021Dynamic Adaptive Spatio-temporal Graph Convolution for fMRI Modellingcited by 7
38 more
- 2022Graph Convolutional Networks for Multi-modality Medical Imaging: Methods, Architectures, and Clinical Applicationscited by 7
- 2023Dynamic Brain Transformer with Multi-level Attention for Functional Brain Network Analysiscited by 7
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Datacited by 6
- 2021Heterogeneous Graph-Based Multimodal Brain Network Learningcited by 5
- 2021Learning to Model the Relationship Between Brain Structural and Functional Connectomescited by 5
- 2023Meta Transfer of Self-Supervised Knowledge: Foundation Model in Action for Post-Traumatic Epilepsy Predictioncited by 5
- 2022Graph-in-Graph (GiG): Learning interpretable latent graphs in non-Euclidean domain for biological and healthcare applicationscited by 4
- 2022DynDepNet: Learning Time-Varying Dependency Structures from fMRI Data via Dynamic Graph Structure Learningcited by 4
- 2022Benchmarking Graph Neural Networks for FMRI analysiscited by 4
- 2023Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRIcited by 4
- 2023Preserving Specificity in Federated Graph Learning for fMRI-based Neurological Disorder Identificationcited by 4
- 2022Improving the Diagnosis of Psychiatric Disorders with Self-Supervised Graph State Space Modelscited by 3
- 2024Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Braincited by 3
- 2024Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equationcited by 3
- 2026ODEBrain: Continuous-Time EEG Graph for Modeling Dynamic Brain Networkscited by 3
- 2022Deep Dynamic Effective Connectivity Estimation from Multivariate Time Seriescited by 2
- 2022Spatial Temporal Graph Convolution with Graph Structure Self-learning for Early MCI Detectioncited by 2
- 2024Spatial Craving Patterns in Marijuana Users: Insights from fMRI Brain Connectivity Analysis with High-Order Graph Attention Neural Networkscited by 2
- 2024ACTION: Augmentation and Computation Toolbox for Brain Network Analysis with Functional MRIcited by 2
- 2024STNAGNN: Data-driven Spatio-temporal Brain Connectivity beyond FCcited by 2
- 2025BrainNetMLP: An Efficient and Effective Baseline for Functional Brain Network Classificationcited by 2
- 2025Hierarchical Characterization of Brain Dynamics via State Space-based Vector Quantizationcited by 2
- 2026Moving Beyond Functional Connectivity: Time-Series Modeling for fMRI-Based Brain Disorder Classificationcited by 2
- 2026NeuroMambaLLM: Dynamic Graph Learning of fMRI Functional Connectivity in Autistic Brains Using Mamba and Language Model Reasoningcited by 2
- 2022fMRI-S4: learning short- and long-range dynamic fMRI dependencies using 1D Convolutions and State Space Modelscited by 1
- 2024Generalizable Representation Learning for fMRI-based Neurological Disorder Identificationcited by 1
- 2025BrainATCL: Adaptive Temporal Brain Connectivity Learning for Functional Link Prediction and Age Estimationcited by 1
- 2022Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRIcited by 0
- 2022Toward Improved Generalization: Meta Transfer of Self-supervised Knowledge on Graphscited by 0
- 2023Correlation-Distance Graph Learning for Treatment Response Prediction from rs-fMRIcited by 0
- 2023Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classificationcited by 0
- 2024SpaRG: Sparsely Reconstructed Graphs for Generalizable fMRI Analysiscited by 0
- 2025Towards Zero-Shot Task-Generalizable Learning on fMRIcited by 0
- 2025ASD Classification on Dynamic Brain Connectome using Temporal Random Walk with Transformer-based Dynamic Network Embeddingcited by 0
- 2025Brain Network Classification Based on Graph Contrastive Learning and Graph Transformercited by 0
- 2025Comorbidity-Informed Transfer Learning for Neuro-developmental Disorder Diagnosiscited by 0
- 2025SlepNet: Spectral Subgraph Representation Learning for Neural Dynamicscited by 0
- 2025Defining and Benchmarking a Data-Centric Design Space for Brain Graph Constructioncited by 0
50 most cited of 57 All 57 (JSON)
- 2026BrainNet Studio: A Unified Toolkit for Brain Network Construction, Intelligent Analysis, and Visualization29 Sep 2026
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning27 May 2026
- 2026Foundation models for discovering robust biomarkers of neurological disorders from dynamic functional connectivity23 Apr 2026
- 2026BrainSCL: Subtype-Guided Contrastive Learning for Brain Disorder Diagnosis11 Mar 2026
- 2026BrainSTR: Spatio-Temporal Contrastive Learning for Interpretable Dynamic Brain Network Modeling10 Mar 2026
- 2026ODEBrain: Continuous-Time EEG Graph for Modeling Dynamic Brain Networks26 Feb 2026
- 2026RepSPD: Enhancing SPD Manifold Representation in EEGs via Dynamic Graphs26 Feb 2026
- 2026NeuroMambaLLM: Dynamic Graph Learning of fMRI Functional Connectivity in Autistic Brains Using Mamba and Language Model Reasoning14 Feb 2026
- 2026Moving Beyond Functional Connectivity: Time-Series Modeling for fMRI-Based Brain Disorder Classification9 Feb 2026
- 2025Graph Neural Networks with Transformer Fusion of Brain Connectivity Dynamics and Tabular Data for Forecasting Future Tobacco Use29 Dec 2025
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Data23 Sep 2025
- 2025Defining and Benchmarking a Data-Centric Design Space for Brain Graph Construction17 Aug 2025
38 more
- 2025BrainATCL: Adaptive Temporal Brain Connectivity Learning for Functional Link Prediction and Age Estimation9 Aug 2025
- 2025Hierarchical Characterization of Brain Dynamics via State Space-based Vector Quantization28 Jun 2025
- 2025SlepNet: Spectral Subgraph Representation Learning for Neural Dynamics19 Jun 2025
- 2025BrainNetMLP: An Efficient and Effective Baseline for Functional Brain Network Classification14 May 2025
- 2025Comorbidity-Informed Transfer Learning for Neuro-developmental Disorder Diagnosis13 Apr 2025
- 2025Brain Network Classification Based on Graph Contrastive Learning and Graph Transformer1 Apr 2025
- 2025ASD Classification on Dynamic Brain Connectome using Temporal Random Walk with Transformer-based Dynamic Network Embedding16 Mar 2025
- 2025Towards Zero-Shot Task-Generalizable Learning on fMRI15 Feb 2025
- 2024Generalizable Representation Learning for fMRI-based Neurological Disorder Identification16 Dec 2024
- 2024SpaRG: Sparsely Reconstructed Graphs for Generalizable fMRI Analysis24 Sep 2024
- 2024STNAGNN: Data-driven Spatio-temporal Brain Connectivity beyond FC17 Jun 2024
- 2024Graph Neural Networks for Brain Graph Learning: A Survey1 Jun 2024
- 2024Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation21 May 2024
- 2024ACTION: Augmentation and Computation Toolbox for Brain Network Analysis with Functional MRI10 May 2024
- 2024Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Brain11 Mar 2024
- 2024Spatial Craving Patterns in Marijuana Users: Insights from fMRI Brain Connectivity Analysis with High-Order Graph Attention Neural Networks29 Feb 2024
- 2023Meta Transfer of Self-Supervised Knowledge: Foundation Model in Action for Post-Traumatic Epilepsy Prediction21 Dec 2023
- 2023Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification16 Dec 2023
- 2023Correlation-Distance Graph Learning for Treatment Response Prediction from rs-fMRI17 Nov 2023
- 2023Dynamic Brain Transformer with Multi-level Attention for Functional Brain Network Analysis5 Sep 2023
- 2023Preserving Specificity in Federated Graph Learning for fMRI-based Neurological Disorder Identification20 Aug 2023
- 2023SwiFT: Swin 4D fMRI Transformer12 Jul 2023
- 2023Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRI24 Jun 2023
- 2023NeuroGraph: Benchmarks for Graph Machine Learning in Brain Connectomics9 Jun 2023
- 2022Toward Improved Generalization: Meta Transfer of Self-supervised Knowledge on Graphs16 Dec 2022
- 2022Benchmarking Graph Neural Networks for FMRI analysis16 Nov 2022
- 2022Spatial Temporal Graph Convolution with Graph Structure Self-learning for Early MCI Detection11 Nov 2022
- 2022Joint Graph Convolution for Analyzing Brain Structural and Functional Connectome27 Oct 2022
- 2022DynDepNet: Learning Time-Varying Dependency Structures from fMRI Data via Dynamic Graph Structure Learning27 Sep 2022
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspective27 Sep 2022
- 2022fMRI-S4: learning short- and long-range dynamic fMRI dependencies using 1D Convolutions and State Space Models8 Aug 2022
- 2022Improving the Diagnosis of Psychiatric Disorders with Self-Supervised Graph State Space Models7 Jun 2022
- 2022BolT: Fused Window Transformers for fMRI Time Series Analysis23 May 2022
- 2022Graph-in-Graph (GiG): Learning interpretable latent graphs in non-Euclidean domain for biological and healthcare applications1 Apr 2022
- 2022Graph Convolutional Networks for Multi-modality Medical Imaging: Methods, Architectures, and Clinical Applications17 Feb 2022
- 2022Deep Dynamic Effective Connectivity Estimation from Multivariate Time Series4 Feb 2022
- 2022Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI21 Jan 2022
- 2021Learning to Model the Relationship Between Brain Structural and Functional Connectomes18 Dec 2021
50 newest of 57 All 57 (JSON)
- 2021Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attentioncited by 86
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2023NeuroGraph: Benchmarks for Graph Machine Learning in Brain Connectomicscited by 33
- 2022BolT: Fused Window Transformers for fMRI Time Series Analysiscited by 23
- 2021Self-Supervised Transformers for fMRI representationcited by 17
- 2024Graph Neural Networks for Brain Graph Learning: A Surveycited by 13
- 2021Improving Phenotype Prediction using Long-Range Spatio-Temporal Dynamics of Functional Connectivitycited by 9
- 2022Joint Graph Convolution for Analyzing Brain Structural and Functional Connectomecited by 9
- 2021A deep learning model for data-driven discovery of functional connectivitycited by 8
- 2021Dynamic Adaptive Spatio-temporal Graph Convolution for fMRI Modellingcited by 7
12 most cited of 56 All 56 (JSON)
- 2026BrainNet Studio: A Unified Toolkit for Brain Network Construction, Intelligent Analysis, and Visualization29 Sep 2026
- 2026Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning27 May 2026
- 2026Foundation models for discovering robust biomarkers of neurological disorders from dynamic functional connectivity23 Apr 2026
- 2026BrainSCL: Subtype-Guided Contrastive Learning for Brain Disorder Diagnosis11 Mar 2026
- 2026BrainSTR: Spatio-Temporal Contrastive Learning for Interpretable Dynamic Brain Network Modeling10 Mar 2026
- 2026ODEBrain: Continuous-Time EEG Graph for Modeling Dynamic Brain Networks26 Feb 2026
- 2026RepSPD: Enhancing SPD Manifold Representation in EEGs via Dynamic Graphs26 Feb 2026
- 2026Moving Beyond Functional Connectivity: Time-Series Modeling for fMRI-Based Brain Disorder Classification9 Feb 2026
- 2025Graph Neural Networks with Transformer Fusion of Brain Connectivity Dynamics and Tabular Data for Forecasting Future Tobacco Use29 Dec 2025
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Data23 Sep 2025
- 2025Defining and Benchmarking a Data-Centric Design Space for Brain Graph Construction17 Aug 2025
- 2025BrainATCL: Adaptive Temporal Brain Connectivity Learning for Functional Link Prediction and Age Estimation9 Aug 2025
12 newest of 56 All 56 (JSON)