mlsanityData to 14 Oct 2026

Biologically Plausible Brain Graph Transformer

arXiv 2502.08958 ↗First posted 13 Feb 2025cs.LG cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

State-of-the-art brain graph analysis methods fail to fully encode the small-world architecture of brain graphs (accompanied by the presence of hubs and functional modules), and therefore lack biological plausibility to some extent. This limitation hinders their ability to accurately represent the brain's structural and functional properties, thereby restricting the effectiveness of machine learning models in tasks such as brain disorder detection. In this work, we propose a novel Biologically Plausible Brain Graph Transformer (BioBGT) that encodes the small-world architecture inherent in brain graphs. Specifically, we present a network entanglement-based node importance encoding technique that captures the structural importance of nodes in global information propagation during brain graph communication, highlighting the biological properties of the brain structure. Furthermore, we introduce a functional module-aware self-attention to preserve the functional segregation and integration characteristics of brain graphs in the learned representations. Experimental results on three benchmark datasets demonstrate that BioBGT outperforms state-of-the-art models, enhancing biologically plausible brain graph representations for various brain graph analytical tasks

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 32 of its 76 references that are in the map. First posted on arXiv 13 Feb 2025.

Builds on

32 of 76 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
  5. 2020A Generalization of Transformer Networks to Graphscited by 661
  6. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  7. 2019Diffusion Improves Graph Learningcited by 414
  8. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
  9. 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
  10. 2023Exphormer: Sparse Transformers for Graphscited by 170
  11. 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
  12. 2021GraphiT: Encoding Graph Structure in Transformerscited by 147
20 more
  1. 2017On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learningcited by 142
  2. 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
  3. 2022Brain Network Transformercited by 94
  4. 2021Graph Neural Networks in Network Neurosciencecited by 92
  5. 2022BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networkscited by 75
  6. 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 65
  7. 2023Transformers Meet Directed Graphscited by 40
  8. 2021LGGNet: Learning from Local-Global-Graph Representations for Brain-Computer Interfacecited by 36
  9. 2023NeuroGraph: Benchmarks for Graph Machine Learning in Brain Connectomicscited by 33
  10. 2024Graph Transformers: A Surveycited by 32
  11. 2024FairGT: A Fairness-aware Graph Transformercited by 29
  12. 2023Community-Aware Transformer for Autism Prediction in fMRI Connectomecited by 28
  13. 2022Transformers over Directed Acyclic Graphscited by 23
  14. 2018The physics of brain network structure, function, and controlcited by 20
  15. 2023A Generalized Neural Diffusion Framework on Graphscited by 13
  16. 2024Gradformer: Graph Transformer with Exponential Decaycited by 11
  17. 2023CSGCL: Community-Strength-Enhanced Graph Contrastive Learningcited by 7
  18. 2023NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation Learningcited by 7
  19. 2023Quantum Graph Learning: Frontiers and Outlookcited by 6
  20. 2023Exploring Sparsity in Graph Transformerscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 6.

10 papers.