mlsanityData to 14 Oct 2026

On the use of foundation models in cognitive science

arXiv 2608.07812 ↗First posted 7 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

A host of recent studies have evaluated the cognitive and developmental alignment of Foundation Models (FMs). These investigations include evaluations of their correspondence to adult performance across a range of cognitive domains, as well as whether aspects of model training track children's cognitive development. However, using FMs as candidate cognitive models poses significant methodological and conceptual challenges. A key question underlies this effort: under what conditions does behavioral alignment justify treating FMs as explanatory models of cognition? In this paper, we articulate a four-stage inferential framework for evaluating FMs as cognitive and developmental models: adapting human experimental tasks to model-compatible formats, specifying linking hypotheses that map model outputs to human measures, evaluating behavioral correspondence, and comparing across candidate models or manipulations. We clarify the role of linking hypotheses in mapping model outputs to human behavioral measures, identify challenges that constrain alignment claims, and propose principles for theory-driven and comparative evaluation. Throughout, we argue that behavioral fit alone is insufficient. Alignment becomes scientifically meaningful only when embedded within explicit theoretical commitments, theory-diagnostic tasks, and systematic contrastive evaluation across candidate models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 109 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

55 of 109 references.

References · 55

  1. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  3. 2024OLMo: Accelerating the Science of Language Modelscited by 613
  4. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
  5. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
  6. 2022Using cognitive psychology to understand GPT-3cited by 398
  7. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
  8. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
  9. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
  10. 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
  11. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  12. 2025Open Problems in Mechanistic Interpretabilitycited by 179
38 more
  1. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 155
  2. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 113
  3. 2023LLM360: Towards Fully Transparent Open-Source LLMscited by 104
  4. 2022What Artificial Neural Networks Can Tell Us About Human Language Acquisitioncited by 99
  5. 2024A Primer on the Inner Workings of Transformer-based Language Modelscited by 85
  6. 2024Does Spatial Cognition Emerge in Frontier Models?cited by 66
  7. 2024CogBench: a large language model walks into a psychology labcited by 63
  8. 2024Auxiliary task demands mask the capabilities of smaller language modelscited by 54
  9. 2024Language models align with human judgments on key grammatical constructionscited by 49
  10. 2021Word Acquisition in Neural Language Modelscited by 41
  11. 2023Transformer-Based Language Model Surprisal Predicts Human Reading Times Best with About Two Billion Training Tokenscited by 41
  12. 2023Language acquisition: do children and language models follow similar learning stages?cited by 41
  13. 2021Do language models learn typicality judgments from text?cited by 32
  14. 2025Large Language Models Are Human-Like Internallycited by 29
  15. 2024LLMs can Find Mathematical Reasoning Mistakes by Pedagogical Chain-of-Thoughtcited by 28
  16. 2023In-Context Analogical Reasoning with Pre-Trained Language Modelscited by 22
  17. 2026Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking Tokenscited by 22
  18. 2025Rethinking Thinking Tokens: LLMs as Improvement Operatorscited by 21
  19. 2025How Many Instructions Can LLMs Follow at Once?cited by 20
  20. 2025In-Context Learning Strategies Emerge Rationallycited by 16
  21. 2020Relational reasoning and generalization using non-symbolic neural networkscited by 15
  22. 2024Evidence from counterfactual tasks supports emergent analogical reasoning in large language modelscited by 14
  23. 2024DevBench: A multimodal developmental benchmark for language learningcited by 13
  24. 2024Incremental Comprehension of Garden-Path Sentences by Large Language Models: Semantic Interpretation, Syntactic Re-Analysis, and Attentioncited by 11
  25. 2025To model human linguistic prediction, make LLMs less superhumancited by 11
  26. 2023Human Behavioral Benchmarking: Numeric Magnitude Comparison Effects in Large Language Modelscited by 10
  27. 2024HLB: Benchmarking LLMs' Humanlikeness in Language Usecited by 8
  28. 2022Interpretability of artificial neural network models in artificial Intelligence vs. neurosciencecited by 7
  29. 2024How Well Do Deep Learning Models Capture Human Concepts? The Case of the Typicality Effectcited by 7
  30. 2024Antagonistic AIcited by 6
  31. 2025Representation biases: will we achieve complete understanding by analyzing representations?cited by 6
  32. 2024GPT-ology, Computational Models, Silicon Sampling: How should we think about LLMs in Cognitive Science?cited by 5
  33. 2026The Representational Geometry of Numbercited by 5
  34. 2023Psychometric Predictive Power of Large Language Modelscited by 4
  35. 2024A Controlled Reevaluation of Coreference Resolution Modelscited by 4
  36. 2024CogLM: Tracking Cognitive Development of Large Language Modelscited by 4
  37. 2025A Distributional Perspective on Word Learning in Neural Language Modelscited by 4
  38. 2025CogMath: Assessing LLMs' Authentic Mathematical Ability from a Human Cognitive Perspectivecited by 4

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.