mlsanityData to 7 Oct 2026

A Unified Geometric Space for Topological Alignment Between Transformer-Based Models and Human Brain Networks

arXiv 2510.24342 ↗First posted 28 Oct 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Whether artificial neural networks organize information comparably to the human brain remains unclear. Prior brain--AI alignment studies are constrained by specific inputs and tasks, limiting cross-modal comparison. Here we introduce a brain--model topological alignment space, mapping Transformer attention topology onto human intrinsic connectivity networks (ICNs) to enable task-free, modality-agnostic comparison. Analyzing 151 Transformer-based models with 62,480 attention head graphs, we observe a continuous arc-shaped distribution reflecting varying alignment. Models optimized for global semantics aligned with higher-order ICNs, while local-detail models aligned with sensory ICNs. Non-intuitive findings include reduced alignment in DINOv2 compared to its predecessors and a counterintuitive scaling inversion in distilled DeiT models, while fine-tuning and instruction tuning had limited effect. Alignment scores showed no significant correlation with ImageNet accuracy (r = 0.266, p = 0.156). This work offers a quantitative framework for comparing the organizational principles of artificial and biological systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

30 of 68 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  8. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  9. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  10. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
  11. 2022DeiT III: Revenge of the ViTcited by 417
  12. 2024The Platonic Representation Hypothesiscited by 362
18 more
  1. 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 298
  2. 2023Getting aligned on representational alignmentcited by 142
  3. 2019Language Modeling with Deep Transformerscited by 96
  4. 2023Instruction-tuning Aligns LLMs to the Human Braincited by 39
  5. 2024Contextual Feature Extraction Hierarchies Converge in Large Language Models and the Braincited by 32
  6. 2024Human-like object concept representations emerge naturally in multimodal large language modelscited by 24
  7. 2023Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddingscited by 23
  8. 2025From Colors to Classes: Emergence of Concepts in Vision Transformerscited by 23
  9. 2016Small-World Brain Networks Revisitedcited by 16
  10. 2024Dissecting Query-Key Interaction in Vision Transformerscited by 12
  11. 2025Disentangling the Factors of Convergence between Brains and Computer Vision Modelscited by 12
  12. 2025Better artificial intelligence does not mean better models of biologycited by 10
  13. 2023Coupling Artificial Neurons in BERT and Biological Neurons in the Human Braincited by 9
  14. 2022A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformerscited by 7
  15. 2024Positional Attention: Expressivity and Learnability of Algorithmic Computationcited by 7
  16. 2022Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activationscited by 4
  17. 2025Bridging Brains and Machines: A Unified Frontier in Neuroscience, Artificial Intelligence, and Neuromorphic Systemscited by 2
  18. 2025Hierarchical Frequency Tagging Probe (HFTP): A Unified Approach to Investigate Syntactic Structure Representations in Large Language Models and the Human Braincited by 2

Built on by

Not cited yet.