mlsanityData to 14 Oct 2026

The Philosophical Foundations of Growing AI Like A Child

arXiv 2502.10742 ↗First posted 15 Feb 2025cs.AIcited by 6

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Despite excelling in high-level reasoning, current language models lack robustness in real-world scenarios and perform poorly on fundamental problem-solving tasks that are intuitive to humans. This paper argues that both challenges stem from a core discrepancy between human and machine cognitive development. While both systems rely on increasing representational power, the absence of core knowledge, foundational cognitive structures in humans, prevents language models from developing robust, generalizable abilities, where complex skills are grounded in simpler ones within their respective domains. It explores empirical evidence of core knowledge in humans, analyzes why language models fail to acquire it, and argues that this limitation is not an inherent architectural constraint. Finally, it outlines a workable proposal for systematically integrating core knowledge into future multi-modal language models through the large-scale generation of synthetic training data using a cognitive prototyping strategy.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 27 of its 86 references that are in the map. First posted on arXiv 15 Feb 2025.

Builds on

27 of 86 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Easy Problems That LLMs Get Wrong30 May
  2. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb

Other references · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  7. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  8. 2022Using cognitive psychology to understand GPT-3cited by 398
  9. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
  10. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
  11. 2018Deep Learning: A Critical Appraisalcited by 217
  12. 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
13 more
  1. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 97
  2. 2024Project Sid: Many-agent simulations toward AI civilizationcited by 49
  3. 2023Testing AI on language comprehension tasks reveals insensitivity to underlying meaningcited by 45
  4. 2024Core Knowledge Deficits in Multi-Modal Language Modelscited by 38
  5. 2024RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Modelscited by 20
  6. 2024The 3D-PC: a benchmark for visual perspective taking in humans and machinescited by 16
  7. 2024Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrationscited by 12
  8. 2024Vision Language Models See What You Want but not What You Seecited by 10
  9. 2024Probing Mechanical Reasoning in Large Vision Language Modelscited by 9
  10. 2025Probing Perceptual Constancy in Large Vision-Language Modelscited by 7
  11. 2023Towards Concept-Aware Large Language Modelscited by 6
  12. 2024Vision Language Models Know Law of Conservation without Understanding More-or-Lesscited by 4
  13. 2024Multiple Realizability and the Rise of Deep Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Review of Developmental Interpretability in Large Language Models
  2. 2024A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates
  3. 2023Machine Psychology
  4. 2022Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks
  5. 2025Three tiers of computation in transformers and in brain architectures
  6. 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks
  7. 2023Studying and improving reasoning in humans and machines
  8. 2026Uneven Evolution of Cognition Across Generations of Generative AI Models