mlsanityData to 7 Oct 2026

Assessing mentalization in humans and large language models

arXiv 2608.26291 ↗First posted 26 Aug 2026cs.AI q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Mentalization - the ability to infer others' beliefs and intentions to guide one's own choices - is a key cognitive function underlying human social interactions. Large language models (LLMs) demonstrate behaviour consistent with humans on theory-of-mind tasks, yet whether these models can guide adaptive behaviour through mentalization is unknown. Here we use two economic games with cognitive computational modeling to uncover the latent strategies underlying mentalization in LLMs. We tested individual LLM agents across four model families, DeepSeek, GPT-4.1, GPT-5 and Gemini 2.0 Flash (N = 2,099), against opponents of varying sophistication and examined whether a prompting strategy designed to elicit strategic reasoning improved performance. We benchmarked results against human participants (N = 251) as a comparative measure. Across both games, LLMs showed clear behavioural and computational signatures of mentalizing that differed markedly by model provider and size. Strategic prompting generally improved performance by inducing more sophisticated reasoning, yet the extent of the benefit differed across the two tasks. Last, GPT-5 agents flexibly adapted their recursive depth of reasoning to increasingly sophisticated opponents, demonstrating superior performance to human participants. Collectively, we demonstrate different capacities for mentalization across LLMs, and highlight cognitive computational modeling as a formal method for assessing comparative intelligence across humans and machines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 76 of its 200 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

76 of 200 references.

References · 76

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  4. 2022Using cognitive psychology to understand GPT-3cited by 389
  5. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
  6. 2023Evaluating Large Language Models in Theory of Mind Taskscited by 217
  7. 2023Playing repeated games with Large Language Modelscited by 213
  8. 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 161
  9. 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 128
  10. 2015Practical Bayesian model evaluation using leave-one-out cross-validation and WAICcited by 110
  11. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
  12. 2023Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilitiescited by 86
38 more
  1. 2023Moral Foundations of Large Language Modelscited by 84
  2. 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Surveycited by 82
  3. 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
  4. 2023How FaR Are Large Language Models From Agents with Theory-of-Mind?cited by 75
  5. 2024Building Machines that Learn and Think with Peoplecited by 73
  6. 2023Unleashing the potential of prompt engineering for large language modelscited by 72
  7. 2023Boosting Theory-of-Mind Performance in Large Language Models via Promptingcited by 64
  8. 2024Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?cited by 62
  9. 2024CogBench: a large language model walks into a psychology labcited by 60
  10. 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspectivecited by 57
  11. 2024Determinants of LLM-assisted Decision-Makingcited by 55
  12. 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
  13. 2025Advancing Reasoning in Large Language Models: Promising Methods and Approachescited by 43
  14. 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 36
  15. 2025Emergent Abilities in Large Language Models: A Surveycited by 34
  16. 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameterscited by 32
  17. 2024Position: Theory of Mind Benchmarks are Broken for Large Language Modelscited by 30
  18. 2024STEER: Assessing the Economic Rationality of Large Language Modelscited by 26
  19. 2025Theory of Mind in Large Language Models: Assessment and Enhancementcited by 24
  20. 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
  21. 2025Re-evaluating Theory of Mind evaluation in large language modelscited by 23
  22. 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
  23. 2024Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Modelscited by 22
  24. 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Gamescited by 20
  25. 2023Generative Models as a Complex Systems Science: How can we make sense of large language model behavior?cited by 19
  26. 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitationcited by 19
  27. 2023Unveiling Theory of Mind in Large Language Models: A Parallel to Single Neurons in the Human Braincited by 18
  28. 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
  29. 2025Decompose-ToM: Enhancing Theory of Mind Reasoning in Large Language Models through Simulation and Task Decompositioncited by 17
  30. 2023Studying and improving reasoning in humans and machinescited by 14
  31. 2025LLM Strategic Reasoning: Agentic Study through Behavioral Game Theorycited by 14
  32. 2025The threat of analytic flexibility in using large language models to simulate human datacited by 13
  33. 2025A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Taskscited by 12
  34. 2025Triangulating LLM Progress through Benchmarks, Games, and Cognitive Testscited by 11
  35. 2024Can AI with High Reasoning Ability Replicate Human-like Decision Making in Economic Experiments?cited by 9
  36. 2024Can Machines Think Like Humans? A Behavioral Evaluation of LLM Agents in Dictator Gamescited by 9
  37. 2024Large Language Models show both individual and collective creativity comparable to humanscited by 9
  38. 2024Mind Your Theory: Theory of Mind Goes Deeper Than Reasoningcited by 9

50 most cited of 76 All 76 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models
  2. 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
  3. 2024Reproducing and Extending Experiments in Behavioral Strategy with Large Language Models
  4. 2025Reasoning Capabilities of Large Language Models on Dynamic Tasks
  5. 2025Doing Things with Words: Rethinking Theory of Mind Simulation in Large Language Models
  6. 2026Readable Minds: Emergent Theory-of-Mind-Like Behavior in LLM Poker Agents
  7. 2023MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic
  8. 2026The Internal Anatomy of Strategic Choice in Large Language Models