Brain-Model Evaluations Need the NeuroAI Turing Test
Not on the map. Why?
Abstract (arXiv)
What makes an artificial system a good model of intelligence? The classical test proposed by Alan Turing focuses on behavior, requiring that an artificial agent's behavior be indistinguishable from that of a human. While behavioral similarity provides a strong starting point, two systems with very different internal representations can produce the same outputs. Thus, in modeling biological intelligence, the field of NeuroAI often aims to go beyond behavioral similarity and achieve representational convergence between a model's activations and the measured activity of a biological system. This position paper argues that the standard definition of the Turing Test is incomplete for NeuroAI, and proposes a stronger framework called the ``NeuroAI Turing Test'', a benchmark that extends beyond behavior alone and additionally requires models to produce internal neural representations that are empirically indistinguishable from those of a brain up to measured individual variability, i.e. the differences between a computational model and the brain is no more than the difference between one brain and another brain. While the brain is not necessarily the ceiling of intelligence, it remains the only universally agreed-upon example, making it a natural reference point for evaluating computational models. By proposing this framework, we aim to shift the discourse from loosely defined notions of brain inspiration to a systematic and testable standard centered on both behavior and internal representations, providing a clear benchmark for neuroscientific modeling and AI development.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 25 of its 120 references that are in the map. First posted on arXiv 22 Feb 2025.
Builds on
25 of 120 references.
References · 25
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2015Convergent Learning: Do different neural networks learn the same representations?cited by 220
- 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 218
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2021Generalized Shape Metrics on Neural Representationscited by 112
- 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
- 2023Neither hype nor gloom do DNNs justicecited by 40
- 2017Deep Learning Models of the Retinal Response to Natural Scenescited by 36
13 more
- 2018Task-Driven Convolutional Recurrent Models of the Visual Systemcited by 27
- 2023Unifying (Machine) Vision via Counterfactual World Modelingcited by 19
- 2023Performance-optimized deep neural networks are evolving into worse models of inferotemporal visual cortexcited by 18
- 2023Soft Matching Distance: A metric on neural representations that captures single-neuron tuningcited by 18
- 2023A Spectral Theory of Neural Prediction and Alignmentcited by 14
- 2023Neural Foundations of Mental Simulation: Future Prediction of Latent Representations on Dynamic Scenescited by 13
- 2024Scaling Laws for Task-Optimized Models of the Primate Visual Ventral Streamcited by 13
- 2021Neural Population Geometry Reveals the Role of Stochasticity in Robust Perceptioncited by 12
- 2019From deep learning to mechanistic understanding in neuroscience: the structure of retinal predictioncited by 11
- 2025TopoNets: High Performing Vision and Language Models with Brain-Like Topographycited by 10
- 2017Balanced Excitation and Inhibition are Required for High-Capacity, Noise-Robust Neuronal Selectivitycited by 7
- 2023A newborn embodied Turing test for view-invariant object recognitioncited by 2
- 2023A Goal-Driven Approach to Systems Neurosciencecited by 1
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
By area:
- 2025From Language to Cognition: How LLMs Outgrow the Human Language Networkcited by 30
- 2025Representation Potentials of Foundation Models for Multimodal Alignment: A Surveycited by 11
- 2025Better artificial intelligence does not mean better models of biologycited by 10
- 2025Representation biases: will we achieve complete understanding by analyzing representations?cited by 6
- 2025Intrinsic Goals for Autonomous Agents: Model-Based Exploration in Virtual Zebrafish Predicts Ethological Behavior and Whole-Brain Dynamicscited by 3
- 2026What Capable Agents Must Know: Selection Theorems for Robust Decision-Making under Uncertaintycited by 2
- 2025Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Braincited by 1
- 2026Do Language Models Align with Brains? Prediction Scores Are Not Enoughcited by 1
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Perucited by 0
- 2026The Umwelt Representation Hypothesis: Rethinking Universalitycited by 0
- 2026Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignmentcited by 0
- 2026Bidirectional representational alignment between biological and artificial neural networkscited by 0
- 2026Parameter symmetries determine representational geometry in overparameterized nonlinear networks30 Sep 2026
- 2026Bidirectional representational alignment between biological and artificial neural networks18 Aug 2026
- 2026Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignment19 May 2026
- 2026Do Language Models Align with Brains? Prediction Scores Are Not Enough13 May 2026
- 2026The Umwelt Representation Hypothesis: Rethinking Universality20 Apr 2026
- 2026What Capable Agents Must Know: Selection Theorems for Robust Decision-Making under Uncertainty3 Mar 2026
- 2025Representation Potentials of Foundation Models for Multimodal Alignment: A Survey5 Oct 2025
- 2025Representation biases: will we achieve complete understanding by analyzing representations?29 Jul 2025
- 2025Intrinsic Goals for Autonomous Agents: Model-Based Exploration in Virtual Zebrafish Predicts Ethological Behavior and Whole-Brain Dynamics30 May 2025
- 2025Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain23 May 2025
- 2025Better artificial intelligence does not mean better models of biology8 Apr 2025
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Peru10 Mar 2025
1 more
- 2025From Language to Cognition: How LLMs Outgrow the Human Language Networkcited by 30
- 2025Representation Potentials of Foundation Models for Multimodal Alignment: A Surveycited by 11
- 2025Better artificial intelligence does not mean better models of biologycited by 10
- 2025Representation biases: will we achieve complete understanding by analyzing representations?cited by 6
- 2025Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Braincited by 1
- 2026Do Language Models Align with Brains? Prediction Scores Are Not Enoughcited by 1
- 2026The Umwelt Representation Hypothesis: Rethinking Universalitycited by 0
- 2026Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignmentcited by 0
- 2026Bidirectional representational alignment between biological and artificial neural networkscited by 0
- 2026Parameter symmetries determine representational geometry in overparameterized nonlinear networkscited by 0
- 2026Parameter symmetries determine representational geometry in overparameterized nonlinear networks30 Sep 2026
- 2026Bidirectional representational alignment between biological and artificial neural networks18 Aug 2026
- 2026Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignment19 May 2026
- 2026Do Language Models Align with Brains? Prediction Scores Are Not Enough13 May 2026
- 2026The Umwelt Representation Hypothesis: Rethinking Universality20 Apr 2026
- 2025Representation Potentials of Foundation Models for Multimodal Alignment: A Survey5 Oct 2025
- 2025Representation biases: will we achieve complete understanding by analyzing representations?29 Jul 2025
- 2025Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain23 May 2025
- 2025Better artificial intelligence does not mean better models of biology8 Apr 2025
- 2025From Language to Cognition: How LLMs Outgrow the Human Language Network3 Mar 2025