mlsanityData to 7 Oct 2026

Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impact

arXiv 2507.00951 ↗First posted 1 Jul 2025cs.AIcited by 6

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Can machines truly think, reason and act in domains like humans? This enduring question continues to shape the pursuit of Artificial General Intelligence (AGI). Despite the growing capabilities of models such as GPT-4.5, DeepSeek, Claude 3.5 Sonnet, Phi-4, and Grok 3, which exhibit multimodal fluency and partial reasoning, these systems remain fundamentally limited by their reliance on token-level prediction and lack of grounded agency. This paper offers a cross-disciplinary synthesis of AGI development, spanning artificial intelligence, cognitive neuroscience, psychology, generative models, and agent-based systems. We analyze the architectural and cognitive foundations of general intelligence, highlighting the role of modular reasoning, persistent memory, and multi-agent coordination. In particular, we emphasize the rise of Agentic RAG frameworks that combine retrieval, planning, and dynamic tool use to enable more adaptive behavior. We discuss generalization strategies, including information compression, test-time adaptation, and training-free methods, as critical pathways toward flexible, domain-agnostic intelligence. Vision-Language Models (VLMs) are reexamined not just as perception modules but as evolving interfaces for embodied understanding and collaborative task completion. We also argue that true intelligence arises not from scale alone but from the integration of memory and reasoning: an orchestration of modular, interactive, and self-improving components where compression enables adaptive behavior. Drawing on advances in neurosymbolic systems, reinforcement learning, and cognitive scaffolding, we explore how recent architectures begin to bridge the gap between statistical learning and goal-directed cognition. Finally, we identify key scientific, technical, and ethical challenges on the path to AGI.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 99 of its 363 references that are in the map. First posted on arXiv 1 Jul 2025.

Builds on

99 of 363 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning21 May
  2. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models28 Feb
  3. 2024DeepSeek-V3 Technical Report27 Dec
  4. 2024On Memorization of Large Language Models in Logical Reasoning30 Oct
  5. 2024Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoning29 Mar
  6. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb

Other references · 93

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  8. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  10. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  11. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  12. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
38 more
  1. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  2. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  3. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  4. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  5. 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
  6. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  7. 2024Phi-4 Technical Reportcited by 675
  8. 2024KAN: Kolmogorov-Arnold Networkscited by 634
  9. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  10. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  11. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  12. 2014In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learningcited by 339
  13. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  14. 2023A Survey of Reinforcement Learning from Human Feedbackcited by 259
  15. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
  16. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  17. 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
  18. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 238
  19. 2018Deep learning generalizes because the parameter-function map is biased towards simple functionscited by 180
  20. 2024An Introduction to Vision-Language Modelingcited by 175
  21. 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
  22. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
  23. 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
  24. 2017Generalization in Deep Learningcited by 146
  25. 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
  26. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
  27. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
  28. 2019On the Measure of Intelligencecited by 129
  29. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  30. 2022Holistic Evaluation of Language Modelscited by 115
  31. 2025Reinforcement Learning with Verifiable Rewards: GRPO's Effective Loss, Dynamics, and Success Amplificationcited by 108
  32. 2018Trainability and Accuracy of Neural Networks: An Interacting Particle System Approachcited by 105
  33. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
  34. 2023SONAR: Sentence-Level Multimodal and Language-Agnostic Representationscited by 105
  35. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 103
  36. 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
  37. 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 86
  38. 2022Synthetic Data -- what, why and how?cited by 66

50 most cited of 93 All 93 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Models
  2. 2025Applying Cognitive Design Patterns to General LLM Agents
  3. 2024Unlocking the Wisdom of Large Language Models: An Introduction to The Path to Artificial General Intelligence
  4. 2025General Intelligence Requires Reward-based Pretraining
  5. 2025Recognizing Artificial Minds: A Philosophical Defense of AI Cognition
  6. 2026Computer Environments Elicit General Agentic Intelligence in LLMs
  7. 2025Unified Mind Model: Reimagining Autonomous Agents in the LLM Era
  8. 2025Emergent Cognitive Convergence via Implementation: Structured Cognitive Loop Reflecting Four Theories of Mind