mlsanityData to 14 Oct 2026

Shared representations in brains and models reveal a two-route cortical organization during scene perception

arXiv 2507.13941 ↗First posted 18 Jul 2025q-bio.NC cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The brain transforms visual inputs into high-dimensional cortical representations that support diverse cognitive and behavioral goals. Characterizing how this information is organized and routed across the human brain is essential for understanding how we process complex visual scenes. Here, we applied representational similarity analysis to 7T fMRI data collected during natural scene viewing. We quantified representational geometry shared across individuals and compared it to hierarchical features from vision and language neural networks. This analysis revealed two distinct processing routes: a ventromedial pathway specialized for scene layout and environmental context, and a lateral occipitotemporal pathway selective for animate content. Vision models aligned with shared structure in both routes, whereas language models corresponded primarily with the lateral pathway. These findings refine classical visual-stream models by characterizing scene perception as a distributed cortical network with separable representational routes for context and animate content.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 106 references that are in the map. First posted on arXiv 18 Jul 2025.

Builds on

26 of 106 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2024The Llama 3 Herd of Modelscited by 14,715
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  10. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  11. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  12. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
14 more
  1. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  2. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  3. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 569
  4. 2024The Platonic Representation Hypothesiscited by 382
  5. 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 160
  6. 2023Natural scene reconstruction from fMRI signals using generative latent diffusioncited by 97
  7. 2014Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain's Ventral Visual Pathwaycited by 94
  8. 2018BOLD5000: A public fMRI dataset of 5000 imagescited by 63
  9. 2025Harnessing the Universal Geometry of Embeddingscited by 55
  10. 2022The neuroconnectionist research programmecited by 48
  11. 2024Learned feature representations are biased by complexity, learning order, position, and morecited by 23
  12. 2021Statistical inference on representational geometriescited by 13
  13. 2024Universal dimensions of visual representationcited by 12
  14. 2020mvlearn: Multiview Machine Learning in Pythoncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.