Local Intrinsic Dimension of Representations Predicts Alignment and Generalization in AI Models and Human Brain
Not on the map. Why?
Abstract (arXiv)
Recent work has found that neural networks with stronger generalization tend to exhibit higher representational alignment with one another across architectures and training paradigms. In this work, we show that models with stronger generalization also align more strongly with human neural activity. Moreover, generalization performance, model--model alignment, and model--brain alignment are all significantly correlated with each other. We further show that these relationships can be explained by a single geometric property of learned representations: the local intrinsic dimension of embeddings. Lower local dimension is consistently associated with stronger model--model alignment, stronger model--brain alignment, and better generalization, whereas global dimension measures fail to capture these effects. Finally, we find that increasing model capacity and training data scale systematically reduces local intrinsic dimension, providing a geometric account of the benefits of scaling. Together, our results identify local intrinsic dimension as a unifying descriptor of representational convergence in artificial and biological systems.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 7 of its 28 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
7 of 28 references.
References · 7
- 2022A ConvNet for the 2020scited by 3,545
- 2019Intrinsic dimension of data representations in deep neural networkscited by 276
- 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 156
- 2014Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain's Ventral Visual Pathwaycited by 93
- 2025Symmetry in Neural Network Parameter Spacescited by 31
- 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
- 2025Disentangling the Factors of Convergence between Brains and Computer Vision Modelscited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Transition Information Density: Morphological Trajectories, Synesthetic Perception, and Structured Interpolation in Neural Training (or: The Synesthetic AI)cited by 0
- 2026The Platonic brain bridge hypothesis: human brain networks as an architectural prior for multimodal large language modelscited by 0
- 2026The Platonic brain bridge hypothesis: human brain networks as an architectural prior for multimodal large language models10 Sep 2026
- 2026Transition Information Density: Morphological Trajectories, Synesthetic Perception, and Structured Interpolation in Neural Training (or: The Synesthetic AI)3 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Training-Driven Representational Geometry Modularization Predicts Brain Alignment in Language Models
- 2025Brain-Language Model Alignment: Insights into the Platonic Hypothesis and Intermediate-Layer Advantage
- 2026Representation Gap: Explaining the Unreasonable Effectiveness of Neural Networks from a Geometric Perspective
- 2026Barycentric alignment for instance-level comparison of neural representations
- 2026The Umwelt Representation Hypothesis: Rethinking Universality
- 2025Scaling and context steer LLMs along the same computational path as the human brain
- 2026Abstraction Induces the Brain Alignment of Language and Speech Models
- 2026Linguistic properties and model scale in brain encoding: from small to compressed language models