Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impact
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Can machines truly think, reason and act in domains like humans? This enduring question continues to shape the pursuit of Artificial General Intelligence (AGI). Despite the growing capabilities of models such as GPT-4.5, DeepSeek, Claude 3.5 Sonnet, Phi-4, and Grok 3, which exhibit multimodal fluency and partial reasoning, these systems remain fundamentally limited by their reliance on token-level prediction and lack of grounded agency. This paper offers a cross-disciplinary synthesis of AGI development, spanning artificial intelligence, cognitive neuroscience, psychology, generative models, and agent-based systems. We analyze the architectural and cognitive foundations of general intelligence, highlighting the role of modular reasoning, persistent memory, and multi-agent coordination. In particular, we emphasize the rise of Agentic RAG frameworks that combine retrieval, planning, and dynamic tool use to enable more adaptive behavior. We discuss generalization strategies, including information compression, test-time adaptation, and training-free methods, as critical pathways toward flexible, domain-agnostic intelligence. Vision-Language Models (VLMs) are reexamined not just as perception modules but as evolving interfaces for embodied understanding and collaborative task completion. We also argue that true intelligence arises not from scale alone but from the integration of memory and reasoning: an orchestration of modular, interactive, and self-improving components where compression enables adaptive behavior. Drawing on advances in neurosymbolic systems, reinforcement learning, and cognitive scaffolding, we explore how recent architectures begin to bridge the gap between statistical learning and goal-directed cognition. Finally, we identify key scientific, technical, and ethical challenges on the path to AGI.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 99 of its 363 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
99 of 363 references.
Closest ancestors · 6
Same direction, newest first
- 2025From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning21 May
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models28 Feb
- 2024DeepSeek-V3 Technical Report27 Dec
- 2024On Memorization of Large Language Models in Logical Reasoning30 Oct
- 2024Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoning29 Mar
- 2023LLaMA: Open and Efficient Foundation Language Models27 Feb
Other references · 93
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
38 more
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2024Phi-4 Technical Reportcited by 675
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
- 2014In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learningcited by 339
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2023A Survey of Reinforcement Learning from Human Feedbackcited by 259
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
- 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 238
- 2018Deep learning generalizes because the parameter-function map is biased towards simple functionscited by 180
- 2024An Introduction to Vision-Language Modelingcited by 175
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
- 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
- 2017Generalization in Deep Learningcited by 146
- 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
- 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
- 2019On the Measure of Intelligencecited by 129
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
- 2022Holistic Evaluation of Language Modelscited by 115
- 2025Reinforcement Learning with Verifiable Rewards: GRPO's Effective Loss, Dynamics, and Success Amplificationcited by 108
- 2018Trainability and Accuracy of Neural Networks: An Interacting Particle System Approachcited by 105
- 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
- 2023SONAR: Sentence-Level Multimodal and Language-Agnostic Representationscited by 105
- 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 103
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 86
- 2022Synthetic Data -- what, why and how?cited by 66
50 most cited of 93 All 93 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspectivecited by 7
- 2025STROKEVISION-BENCH: A Multimodal Video And 2D Pose Benchmark For Tracking Stroke Recoverycited by 2
- 2025Foundation Models in Biomedical Imaging: Turning Hype into Realitycited by 2
- 2026Learning to Share: Selective Memory for Efficient Parallel Agentic Systemscited by 2
- 2026MedRoute: RL-Based Dynamic Specialist Routing in Multi-Agent Medical Diagnosiscited by 0
- 2026Towards Responsible Multimodal Medical Reasoning via Context-Aligned Vision-Language Modelscited by 0
- 2026Towards Responsible Multimodal Medical Reasoning via Context-Aligned Vision-Language Models9 Apr 2026
- 2026MedRoute: RL-Based Dynamic Specialist Routing in Multi-Agent Medical Diagnosis5 Feb 2026
- 2026Learning to Share: Selective Memory for Efficient Parallel Agentic Systems5 Feb 2026
- 2025Foundation Models in Biomedical Imaging: Turning Hype into Reality17 Dec 2025
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective11 Sep 2025
- 2025STROKEVISION-BENCH: A Multimodal Video And 2D Pose Benchmark For Tracking Stroke Recovery2 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2023Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Models
- 2025Applying Cognitive Design Patterns to General LLM Agents
- 2024Unlocking the Wisdom of Large Language Models: An Introduction to The Path to Artificial General Intelligence
- 2025General Intelligence Requires Reward-based Pretraining
- 2025Recognizing Artificial Minds: A Philosophical Defense of AI Cognition
- 2026Computer Environments Elicit General Agentic Intelligence in LLMs
- 2025Unified Mind Model: Reimagining Autonomous Agents in the LLM Era
- 2025Emergent Cognitive Convergence via Implementation: Structured Cognitive Loop Reflecting Four Theories of Mind