A Unified Geometric Space for Topological Alignment Between Transformer-Based Models and Human Brain Networks
Not on the map. Why?
Abstract (arXiv)
Whether artificial neural networks organize information comparably to the human brain remains unclear. Prior brain--AI alignment studies are constrained by specific inputs and tasks, limiting cross-modal comparison. Here we introduce a brain--model topological alignment space, mapping Transformer attention topology onto human intrinsic connectivity networks (ICNs) to enable task-free, modality-agnostic comparison. Analyzing 151 Transformer-based models with 62,480 attention head graphs, we observe a continuous arc-shaped distribution reflecting varying alignment. Models optimized for global semantics aligned with higher-order ICNs, while local-detail models aligned with sensory ICNs. Non-intuitive findings include reduced alignment in DINOv2 compared to its predecessors and a counterintuitive scaling inversion in distilled DeiT models, while fine-tuning and instruction tuning had limited effect. Alignment scores showed no significant correlation with ImageNet accuracy (r = 0.266, p = 0.156). This work offers a quantitative framework for comparing the organizational principles of artificial and biological systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
30 of 68 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
- 2022DeiT III: Revenge of the ViTcited by 417
- 2024The Platonic Representation Hypothesiscited by 362
18 more
- 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 298
- 2023Getting aligned on representational alignmentcited by 142
- 2019Language Modeling with Deep Transformerscited by 96
- 2023Instruction-tuning Aligns LLMs to the Human Braincited by 39
- 2024Contextual Feature Extraction Hierarchies Converge in Large Language Models and the Braincited by 32
- 2024Human-like object concept representations emerge naturally in multimodal large language modelscited by 24
- 2023Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddingscited by 23
- 2025From Colors to Classes: Emergence of Concepts in Vision Transformerscited by 23
- 2016Small-World Brain Networks Revisitedcited by 16
- 2024Dissecting Query-Key Interaction in Vision Transformerscited by 12
- 2025Disentangling the Factors of Convergence between Brains and Computer Vision Modelscited by 12
- 2025Better artificial intelligence does not mean better models of biologycited by 10
- 2023Coupling Artificial Neurons in BERT and Biological Neurons in the Human Braincited by 9
- 2022A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformerscited by 7
- 2024Positional Attention: Expressivity and Learnability of Algorithmic Computationcited by 7
- 2022Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activationscited by 4
- 2025Bridging Brains and Machines: A Unified Frontier in Neuroscience, Artificial Intelligence, and Neuromorphic Systemscited by 2
- 2025Hierarchical Frequency Tagging Probe (HFTP): A Unified Approach to Investigate Syntactic Structure Representations in Large Language Models and the Human Braincited by 2
Built on by
Not cited yet.