Assessing mentalization in humans and large language models
Not on the map. Why?
Abstract (arXiv)
Mentalization - the ability to infer others' beliefs and intentions to guide one's own choices - is a key cognitive function underlying human social interactions. Large language models (LLMs) demonstrate behaviour consistent with humans on theory-of-mind tasks, yet whether these models can guide adaptive behaviour through mentalization is unknown. Here we use two economic games with cognitive computational modeling to uncover the latent strategies underlying mentalization in LLMs. We tested individual LLM agents across four model families, DeepSeek, GPT-4.1, GPT-5 and Gemini 2.0 Flash (N = 2,099), against opponents of varying sophistication and examined whether a prompting strategy designed to elicit strategic reasoning improved performance. We benchmarked results against human participants (N = 251) as a comparative measure. Across both games, LLMs showed clear behavioural and computational signatures of mentalizing that differed markedly by model provider and size. Strategic prompting generally improved performance by inducing more sophisticated reasoning, yet the extent of the benefit differed across the two tasks. Last, GPT-5 agents flexibly adapted their recursive depth of reasoning to increasingly sophisticated opponents, demonstrating superior performance to human participants. Collectively, we demonstrate different capacities for mentalization across LLMs, and highlight cognitive computational modeling as a formal method for assessing comparative intelligence across humans and machines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 76 of its 200 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
76 of 200 references.
References · 76
- 2017Attention Is All You Needcited by 59,932
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Using cognitive psychology to understand GPT-3cited by 389
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
- 2023Evaluating Large Language Models in Theory of Mind Taskscited by 217
- 2023Playing repeated games with Large Language Modelscited by 213
- 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 161
- 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 128
- 2015Practical Bayesian model evaluation using leave-one-out cross-validation and WAICcited by 110
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
- 2023Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilitiescited by 86
38 more
- 2023Moral Foundations of Large Language Modelscited by 84
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Surveycited by 82
- 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
- 2023How FaR Are Large Language Models From Agents with Theory-of-Mind?cited by 75
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2023Boosting Theory-of-Mind Performance in Large Language Models via Promptingcited by 64
- 2024Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?cited by 62
- 2024CogBench: a large language model walks into a psychology labcited by 60
- 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspectivecited by 57
- 2024Determinants of LLM-assisted Decision-Makingcited by 55
- 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
- 2025Advancing Reasoning in Large Language Models: Promising Methods and Approachescited by 43
- 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 36
- 2025Emergent Abilities in Large Language Models: A Surveycited by 34
- 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameterscited by 32
- 2024Position: Theory of Mind Benchmarks are Broken for Large Language Modelscited by 30
- 2024STEER: Assessing the Economic Rationality of Large Language Modelscited by 26
- 2025Theory of Mind in Large Language Models: Assessment and Enhancementcited by 24
- 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
- 2025Re-evaluating Theory of Mind evaluation in large language modelscited by 23
- 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
- 2024Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Modelscited by 22
- 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Gamescited by 20
- 2023Generative Models as a Complex Systems Science: How can we make sense of large language model behavior?cited by 19
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitationcited by 19
- 2023Unveiling Theory of Mind in Large Language Models: A Parallel to Single Neurons in the Human Braincited by 18
- 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
- 2025Decompose-ToM: Enhancing Theory of Mind Reasoning in Large Language Models through Simulation and Task Decompositioncited by 17
- 2023Studying and improving reasoning in humans and machinescited by 14
- 2025LLM Strategic Reasoning: Agentic Study through Behavioral Game Theorycited by 14
- 2025The threat of analytic flexibility in using large language models to simulate human datacited by 13
- 2025A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Taskscited by 12
- 2025Triangulating LLM Progress through Benchmarks, Games, and Cognitive Testscited by 11
- 2024Can AI with High Reasoning Ability Replicate Human-like Decision Making in Economic Experiments?cited by 9
- 2024Can Machines Think Like Humans? A Behavioral Evaluation of LLM Agents in Dictator Gamescited by 9
- 2024Large Language Models show both individual and collective creativity comparable to humanscited by 9
- 2024Mind Your Theory: Theory of Mind Goes Deeper Than Reasoningcited by 9
50 most cited of 76 All 76 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
- 2024Reproducing and Extending Experiments in Behavioral Strategy with Large Language Models
- 2025Reasoning Capabilities of Large Language Models on Dynamic Tasks
- 2025Doing Things with Words: Rethinking Theory of Mind Simulation in Large Language Models
- 2026Readable Minds: Emergent Theory-of-Mind-Like Behavior in LLM Poker Agents
- 2023MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic
- 2026The Internal Anatomy of Strategic Choice in Large Language Models