Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain's Ventral Visual Pathway
Not on the map. Why?
Abstract (arXiv)
Converging evidence suggests that the mammalian ventral visual pathway encodes increasingly complex stimulus features in downstream areas. Using deep convolutional neural networks, we can now quantitatively demonstrate that there is indeed an explicit gradient for feature complexity in the ventral pathway of the human brain. Our approach also allows stimulus features of increasing complexity to be mapped across the human brain, providing an automated approach to probing how representations are mapped across the cortical sheet. Finally, it is shown that deep convolutional neural networks allow decoding of representations in the human brain at a previously unattainable degree of accuracy, providing a more sensitive window into the human brain.
Key facts. Cited by 94 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 15; 2023: 16; 2024: 13; 2025: 19; 2026: 23.
94 papers.
Sort:
By area:
- 2023Getting aligned on representational alignmentcited by 143
- 2022Human alignment of neural network representationscited by 74
- 2023In search of dispersed memories: Generative diffusion models are associative memory networkscited by 44
- 2023Brain encoding models based on multimodal transformers can transfer across language and visioncited by 32
- 2023BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstructioncited by 30
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
- 2023Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputscited by 23
- 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
- 2021Capturing the objects of vision with neural networkscited by 21
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mindcited by 21
- 2022Visio-Linguistic Brain Encodingcited by 13
- 2024Cognitive Overload Attack:Prompt Injection for Long Contextcited by 13
38 more
- 2022Personalized visual encoding model construction with small datacited by 12
- 2022Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signalscited by 12
- 2022Visual representations in the human brain are aligned with large language modelscited by 12
- 2023A Dual-Stream Neural Network Explains the Functional Segregation of Dorsal and Ventral Visual Pathways in Human Brainscited by 12
- 2024Evaluating Representational Similarity Measures from the Lens of Functional Correspondencecited by 12
- 2021Modeling Category-Selective Cortical Regions with Topographic Variational Autoencoderscited by 10
- 2021Long-range and hierarchical language predictions in brains and algorithmscited by 10
- 2022Multimodal foundation models are better simulators of the human braincited by 10
- 2023Brain2Music: Reconstructing Music from Human Brain Activitycited by 10
- 2025Transformer brain encoders explain human high-level visual responsescited by 10
- 2023Joint fMRI Decoding and Encoding with Latent Embedding Alignmentcited by 8
- 2023End-to-end topographic networks as models of cortical map formation and human visual behaviour: moving beyond convolutionscited by 8
- 2021Deep Recurrent Encoder: A scalable end-to-end network to model brain signalscited by 6
- 2024BRACTIVE: A Brain Activation Approach to Human Visual Brain Learningcited by 6
- 2021More Than Meets the Eye: Self-Supervised Depth Reconstruction From Brain Activitycited by 5
- 2024Reanimating Images using Neural Representations of Dynamic Stimulicited by 5
- 2025Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformercited by 5
- 2023Applicability of scaling laws to vision encoding modelscited by 4
- 2023The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Modelscited by 4
- 2024How does the primate brain combine generative and discriminative computations in vision?cited by 4
- 2024Achieving More Human Brain-Like Vision via Human EEG Representational Alignmentcited by 4
- 2024Modeling the Human Visual System: Comparative Insights from Response-Optimized and Task-Optimized Vision Models, Language Models, and different Readout Mechanismscited by 4
- 2025LaVCa: LLM-assisted Visual Cortex Captioningcited by 4
- 2025Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspectivecited by 4
- 2025Meta-Learning an In-Context Transformer Model of Human Higher Visual Cortexcited by 4
- 2026Subject-Aware Multi-Granularity Alignment for Zero-Shot EEG-to-Image Retrievalcited by 4
- 2021Relating CNNs with brain: Challenges and findingscited by 3
- 2021Multimodal neural networks better explain multivoxel patterns in the hippocampuscited by 3
- 2022Prune and distill: similar reformatting of image information along rat visual cortex and deep neural networkscited by 3
- 2022Guiding Visual Attention in Deep Convolutional Neural Networks Based on Human Eye Movementscited by 3
- 2023Deep Learning Models to Study Sentence Comprehension in the Human Braincited by 3
- 2023Probing neural representations of scene perception in a hippocampally dependent task using artificial neural networkscited by 3
- 2023Generate your neural signals from mine: individual-to-individual EEG converterscited by 3
- 2023Insightful analysis of historical sources at scales beyond human capabilities using unsupervised Machine Learning and XAIcited by 3
- 2025Signatures of human-like processing in Transformer forward passescited by 3
- 2025LITcoder: A General-Purpose Library for Building and Comparing Encoding Modelscited by 3
- 2025Representational Alignment Across Model Layers and Brain Regions with Multi-Level Optimal Transportcited by 3
- 2022Functional Network: A Novel Framework for Interpretability of Deep Neural Networkscited by 2
50 most cited of 94 All 94 (JSON)
- 2026StimFlow: Synthesizing Brain Activity from Images via Stimulus-conditioned Flow Matching11 Oct 2026
- 2026Two Routes to the Middle: Placement Search and Brain Readouts Converge on Where Continual Learners Should Specialize1 Oct 2026
- 2026Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video30 Sep 2026
- 2026Programs-of-Layers in LLMs through the Lens of Cortical Areas25 Sep 2026
- 2026Do Vision Model See Like the Brain? A Comparison Across EEG Encoding Model22 Sep 2026
- 2026STSBench: A Large-Scale Dataset for Modeling Neuronal Activity in the Dorsal Stream of Primate Visual Cortex17 Jul 2026
- 2026Texture Representations in Deep Vision Models: Comparing CNNs, Vision Transformers, and Human Perception9 Jul 2026
- 2026Dual-Stream EEG Decoding for 3D Visual Perception20 Jun 2026
- 2026Brain-IT-VQA: From Brain Signals to Answers28 May 2026
- 2026Misalignment Between Backpropagation and the Hierarchy of Brain Responses to Images27 May 2026
- 2026What Makes Linguistic Representations Good Models of High-Level Visual Perception in the Human Brain?22 May 2026
- 2026Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignment19 May 2026
38 more
- 2026Perceived face similarity reflects inverse-generative and naturalistic discriminative objectives12 May 2026
- 2026ViBE: Visual-to-M/EEG Brain Encoding via Spatio-Temporal VAE and Distribution-Aligned Projection29 Apr 2026
- 2026The Umwelt Representation Hypothesis: Rethinking Universality20 Apr 2026
- 2026Subject-Aware Multi-Granularity Alignment for Zero-Shot EEG-to-Image Retrieval20 Apr 2026
- 2026Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matching13 Apr 2026
- 2026Zero-shot World Models Are Developmentally Efficient Learners11 Apr 2026
- 2026NeuroFlow: Toward Unified Visual Encoding and Decoding from Neural Activity10 Apr 2026
- 2026Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding9 Apr 2026
- 2026Perceptual misalignment of texture representations in convolutional neural networks1 Apr 2026
- 2026Human-AI Divergence in Ego-centric Action Recognition under Spatial and Spatiotemporal Manipulations9 Mar 2026
- 2026Local Intrinsic Dimension of Representations Predicts Alignment and Generalization in AI Models and Human Brain30 Jan 2026
- 2025Better audio representations are more brain-like: linking model-brain alignment with performance in downstream auditory tasks20 Nov 2025
- 2025Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformer29 Oct 2025
- 2025A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation21 Oct 2025
- 2025Beyond Grid-Locked Voxels: Neural Response Functions for Continuous Brain Encoding7 Oct 2025
- 2025Stacked Regression using Off-the-shelf, Stimulus-tuned and Fine-tuned Neural Networks for Predicting fMRI Brain Responses to Movies (Algonauts 2025 Report)2 Oct 2025
- 2025Representational Alignment Across Model Layers and Brain Regions with Multi-Level Optimal Transport2 Oct 2025
- 2025Rest2Visual: Predicting Visually Evoked fMRI from Resting-State Scans17 Sep 2025
- 2025LITcoder: A General-Purpose Library for Building and Comparing Encoding Models11 Sep 2025
- 2025Image-to-Brain Signal Generation for Visual Prosthesis with CLIP Guided Multimodal Diffusion Models31 Aug 2025
- 2025Sensory robustness through top-down feedback and neural stochasticity in recurrent vision models9 Aug 2025
- 2025Shared representations in brains and models reveal a two-route cortical organization during scene perception18 Jul 2025
- 2025Visualizing and Controlling Cortical Responses Using Voxel-Weighted Activation Maximization4 Jun 2025
- 2025Transformer brain encoders explain human high-level visual responses22 May 2025
- 2025Meta-Learning an In-Context Transformer Model of Human Higher Visual Cortex21 May 2025
- 2025Improving Unsupervised Task-driven Models of Ventral Visual Stream via Relative Position Predictivity13 May 2025
- 2025Signatures of human-like processing in Transformer forward passes18 Apr 2025
- 2025Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective28 Feb 2025
- 2025Language learning shapes visual category-selectivity in deep neural networks23 Feb 2025
- 2025LaVCa: LLM-assisted Visual Cortex Captioning19 Feb 2025
- 2024Evaluating Representational Similarity Measures from the Lens of Functional Correspondence21 Nov 2024
- 2024LinBridge: A Learnable Framework for Interpreting Nonlinear Neural Encoding Models26 Oct 2024
- 2024Modeling the Human Visual System: Comparative Insights from Response-Optimized and Task-Optimized Vision Models, Language Models, and different Readout Mechanisms17 Oct 2024
- 2024Cognitive Overload Attack:Prompt Injection for Long Context15 Oct 2024
- 2024Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex8 Oct 2024
- 2024Generalizability analysis of deep learning predictions of human brain responses to augmented and semantically novel visual stimuli6 Oct 2024
- 2024Configural processing as an optimized strategy for robust object recognition in neural networks18 Jul 2024
- 2024Teaching CORnet Human fMRI Representations for Enhanced Model-Brain Alignment15 Jul 2024
50 newest of 94 All 94 (JSON)
- 2023In search of dispersed memories: Generative diffusion models are associative memory networkscited by 44
- 2023Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputscited by 23
- 2024Reanimating Images using Neural Representations of Dynamic Stimulicited by 5
- 2025Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformercited by 5
- 2025Image-to-Brain Signal Generation for Visual Prosthesis with CLIP Guided Multimodal Diffusion Modelscited by 1
- 2026Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matchingcited by 0
- 2026Future Video Generation Better Aligns with the Human Visual Cortex than Observed Videocited by 0
- 2026StimFlow: Synthesizing Brain Activity from Images via Stimulus-conditioned Flow Matchingcited by 0
- 2026StimFlow: Synthesizing Brain Activity from Images via Stimulus-conditioned Flow Matching11 Oct 2026
- 2026Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video30 Sep 2026
- 2026Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matching13 Apr 2026
- 2025Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformer29 Oct 2025
- 2025Image-to-Brain Signal Generation for Visual Prosthesis with CLIP Guided Multimodal Diffusion Models31 Aug 2025
- 2024Reanimating Images using Neural Representations of Dynamic Stimuli4 Jun 2024
- 2023In search of dispersed memories: Generative diffusion models are associative memory networks29 Sep 2023
- 2023Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs20 Jun 2023
- 2024Cognitive Overload Attack:Prompt Injection for Long Contextcited by 13
- 2024Cognitive Overload Attack:Prompt Injection for Long Context15 Oct 2024
- 2023Getting aligned on representational alignmentcited by 143
- 2022Human alignment of neural network representationscited by 74
- 2023Brain encoding models based on multimodal transformers can transfer across language and visioncited by 32
- 2023BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstructioncited by 30
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
- 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
- 2021Capturing the objects of vision with neural networkscited by 21
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mindcited by 21
- 2022Visio-Linguistic Brain Encodingcited by 13
- 2022Personalized visual encoding model construction with small datacited by 12
- 2022Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signalscited by 12
- 2022Visual representations in the human brain are aligned with large language modelscited by 12
12 most cited of 84 All 84 (JSON)
- 2026Two Routes to the Middle: Placement Search and Brain Readouts Converge on Where Continual Learners Should Specialize1 Oct 2026
- 2026Programs-of-Layers in LLMs through the Lens of Cortical Areas25 Sep 2026
- 2026Do Vision Model See Like the Brain? A Comparison Across EEG Encoding Model22 Sep 2026
- 2026STSBench: A Large-Scale Dataset for Modeling Neuronal Activity in the Dorsal Stream of Primate Visual Cortex17 Jul 2026
- 2026Texture Representations in Deep Vision Models: Comparing CNNs, Vision Transformers, and Human Perception9 Jul 2026
- 2026Dual-Stream EEG Decoding for 3D Visual Perception20 Jun 2026
- 2026Brain-IT-VQA: From Brain Signals to Answers28 May 2026
- 2026Misalignment Between Backpropagation and the Hierarchy of Brain Responses to Images27 May 2026
- 2026What Makes Linguistic Representations Good Models of High-Level Visual Perception in the Human Brain?22 May 2026
- 2026Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignment19 May 2026
- 2026Perceived face similarity reflects inverse-generative and naturalistic discriminative objectives12 May 2026
- 2026ViBE: Visual-to-M/EEG Brain Encoding via Spatio-Temporal VAE and Distribution-Aligned Projection29 Apr 2026
12 newest of 84 All 84 (JSON)