The Philosophical Foundations of Growing AI Like A Child
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Despite excelling in high-level reasoning, current language models lack robustness in real-world scenarios and perform poorly on fundamental problem-solving tasks that are intuitive to humans. This paper argues that both challenges stem from a core discrepancy between human and machine cognitive development. While both systems rely on increasing representational power, the absence of core knowledge, foundational cognitive structures in humans, prevents language models from developing robust, generalizable abilities, where complex skills are grounded in simpler ones within their respective domains. It explores empirical evidence of core knowledge in humans, analyzes why language models fail to acquire it, and argues that this limitation is not an inherent architectural constraint. Finally, it outlines a workable proposal for systematically integrating core knowledge into future multi-modal language models through the large-scale generation of synthetic training data using a cognitive prototyping strategy.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 27 of its 86 references that are in the map. First posted on arXiv 15 Feb 2025.
Builds on
27 of 86 references.
Closest ancestors · 2
Same direction, newest first
- 2024Easy Problems That LLMs Get Wrong30 May
- 2023LLaMA: Open and Efficient Foundation Language Models27 Feb
Other references · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Visual Instruction Tuningcited by 7,869
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Qwen Technical Reportcited by 3,344
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
- 2018Deep Learning: A Critical Appraisalcited by 217
- 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
13 more
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 97
- 2024Project Sid: Many-agent simulations toward AI civilizationcited by 49
- 2023Testing AI on language comprehension tasks reveals insensitivity to underlying meaningcited by 45
- 2024Core Knowledge Deficits in Multi-Modal Language Modelscited by 38
- 2024RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Modelscited by 20
- 2024The 3D-PC: a benchmark for visual perspective taking in humans and machinescited by 16
- 2024Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrationscited by 12
- 2024Vision Language Models See What You Want but not What You Seecited by 10
- 2024Probing Mechanical Reasoning in Large Vision Language Modelscited by 9
- 2025Probing Perceptual Constancy in Large Vision-Language Modelscited by 7
- 2023Towards Concept-Aware Large Language Modelscited by 6
- 2024Vision Language Models Know Law of Conservation without Understanding More-or-Lesscited by 4
- 2024Multiple Realizability and the Rise of Deep Learningcited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2026A Very Big Video Reasoning Suitecited by 34
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matricescited by 4
- 2026Vision Language Models Cannot Reason About Physical Transformationcited by 4
- 2026Egocentric Bias in Vision-Language Modelscited by 3
- 2025Towards Embodied Cognition in Robots via Spatially Grounded Synthetic Worldscited by 0
- 2026Training Object Permanence in World Modelscited by 0
- 2026Training Object Permanence in World Models23 Sep 2026
- 2026Vision Language Models Cannot Reason About Physical Transformation7 Mar 2026
- 2026A Very Big Video Reasoning Suite23 Feb 2026
- 2026Egocentric Bias in Vision-Language Models10 Feb 2026
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matrices2 Nov 2025
- 2025Towards Embodied Cognition in Robots via Spatially Grounded Synthetic Worlds20 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025A Review of Developmental Interpretability in Large Language Models
- 2024A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates
- 2023Machine Psychology
- 2022Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks
- 2025Three tiers of computation in transformers and in brain architectures
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks
- 2023Studying and improving reasoning in humans and machines
- 2026Uneven Evolution of Cognition Across Generations of Generative AI Models