The brain-AI convergence: Predictive and generative world models for general-purpose computation
On the map: World models → World models for navigation
Abstract (arXiv)
Recent advances in general-purpose AI systems with attention-based transformers offer a potential window into how the neocortex and cerebellum, despite their relatively uniform circuit architectures, give rise to diverse functions and, ultimately, to human intelligence. This Perspective provides a cross-domain comparison between the brain and AI that goes beyond the traditional focus on visual processing, adopting the emerging perspecive of world-model-based computation. Here, we identify shared computational mechanisms in the attention-based neocortex and the non-attentional cerebellum: both predict future world events from past inputs and construct internal world models through prediction-error learning. These predictive world models are repurposed for seemingly distinct functions -- understanding in sensory processing and generation in motor processing -- enabling the brain to achieve multi-domain capabilities and human-like adaptive intelligence. Notably, attention-based AI has independently converged on a similar learning paradigm and world-model-based computation. We conclude that these shared mechanisms in both biological and artificial systems constitute a core computational foundation for realizing diverse functions including high-level intelligence, despite their relatively uniform circuit structures. Our theoretical insights bridge neuroscience and AI, advancing our understanding of the computational essence of intelligence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 31 of its 203 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
31 of 203 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
18 more
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2022A Generalist Agentcited by 802
- 2022Transformers learn in-context by gradient descentcited by 714
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
- 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 671
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 627
- 2015Understanding Neural Networks Through Deep Visualizationcited by 332
- 2023Trained Transformers Learn Linear Models In-Contextcited by 331
- 2023Transformers learn to implement preconditioned gradient descent for in-context learningcited by 274
- 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
- 2023One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-Attentioncited by 168
- 2025Which Attention Heads Matter for In-Context Learning?cited by 61
- 2025Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergencecited by 10
- 2023PIM-GPT: A Hybrid Process-in-Memory Accelerator for Autoregressive Transformerscited by 8
- 2017Cortical microcircuits as gated-recurrent neural networkscited by 6
- 2021From internal models toward metacognitive AIcited by 4
- 202050 years since the Marr, Ito, and Albus models of the cerebellumcited by 3
- 2024The Topos of Transformer Networkscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024The brain versus AI: World-model-based versatile circuit computation underlying diverse functions in the neocortex and cerebellum
- 2021A brain basis of dynamical intelligence for AI and computational neuroscience
- 2025Uncovering Brain-Like Hierarchical Patterns in Vision-Language Models through fMRI-Based Neural Encoding
- 2026Neural Fields as World Models
- 2026SaiVLA-0: Cerebrum--Pons--Cerebellum Tripartite Architecture for Compute-Aware Vision-Language-Action
- 2025The Dragon Hatchling: The Missing Link between the Transformer and Models of the Brain
- 2025Beyond Attention: Toward Machines with Intrinsic Higher Mental States
- 2025The Physical Basis of Prediction: World Model Formation in Neural Organoids via an LLM-Generated Curriculum