Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to us, emulating it presents a challenge to even the most advanced Large Language Models (LLMs). Recent improvements to LLMs' reasoning capabilities from simple yet effective prompting techniques such as Chain-of-Thought have seen limited applicability to ToM. In this paper, we turn to the prominent cognitive science theory "Simulation Theory" to bridge this gap. We introduce SimToM, a novel two-stage prompting framework inspired by Simulation Theory's notion of perspective-taking. To implement this idea on current ToM benchmarks, SimToM first filters context based on what the character in question knows before answering a question about their mental state. Our approach, which requires no additional training and minimal prompt-tuning, shows substantial improvement over existing methods, and our analysis reveals the importance of perspective-taking to Theory-of-Mind capabilities. Our findings suggest perspective-taking as a promising direction for future research into improving LLMs' ToM capabilities.
Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 15 of its 43 references that are in the map. First posted on arXiv 16 Nov 2023.
Builds on
15 of 43 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 334
- 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 324
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
- 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 285
- 2020Transformers as Soft Reasoners over Languagecited by 270
- 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
- 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 163
Built on by
Citing papers per year: 2024: 18; 2025: 43; 2026: 28.
89 papers.
Sort:
By area:
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 99
- 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 85
- 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 72
- 2024SimpleToM: Exposing the Gap between Explicit ToM Inference and Implicit ToM Application in LLMscited by 57
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
- 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
- 2025Language Models use Lookbacks to Track Beliefscited by 39
- 2024Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoningcited by 33
- 2024Language Models Represent Beliefs of Self and Otherscited by 31
- 2024Meta Reasoning for Large Language Modelscited by 29
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Modelscited by 29
38 more
- 2025Theory of Mind in Large Language Models: Assessment and Enhancementcited by 25
- 2025AutoToM: Scaling Model-based Mental Inference via Automated Agent Modelingcited by 23
- 2025Re-evaluating Theory of Mind evaluation in large language modelscited by 23
- 2024Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Modelscited by 22
- 2024TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mindcited by 21
- 2025Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human Statescited by 19
- 2025Decompose-ToM: Enhancing Theory of Mind Reasoning in Large Language Models through Simulation and Task Decompositioncited by 17
- 2025Social World Modelscited by 16
- 2025EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric Videoscited by 12
- 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mindcited by 12
- 2024Brittle Minds, Fixable Activations: Understanding Belief Representations in Language Modelscited by 8
- 2025Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mindcited by 8
- 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Languagecited by 8
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agentscited by 8
- 2025Modeling Others' Minds as Codecited by 7
- 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity Statescited by 6
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
- 2025A Review of Incorporating Psychological Theories in LLMscited by 6
- 2026RebuttalAgent: Strategic Persuasion in Academic Rebuttal via Theory of Mindcited by 6
- 2026PerspectiveGap: A Benchmark for Multi-Agent Orchestration Promptingcited by 6
- 2024Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Modelscited by 5
- 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learningcited by 5
- 2024Multi-ToM: Evaluating Multilingual Theory of Mind Capabilities in Large Language Modelscited by 5
- 2025Exploring Consciousness in LLMs: A Systematic Survey of Theories, Implementations, and Frontier Riskscited by 5
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Plannercited by 5
- 2025ToM-SSI: Evaluating Theory of Mind in Situated Social Interactionscited by 5
- 2025TactfulToM: Do LLMs Have the Theory of Mind Ability to Understand White Lies?cited by 5
- 2025HeaRT: A Hierarchical Circuit Reasoning Tree-Based Agentic Framework for AMS Design Optimizationcited by 5
- 2025MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agentscited by 5
- 2026ThinkTwice: Jointly Optimizing Large Language Models for Reasoning and Self-Refinementcited by 5
- 2025Towards Machine Theory of Mind with Large Language Model-Augmented Inverse Planningcited by 4
- 2025Perspective Transition of Large Language Models for Solving Subjective Taskscited by 3
- 2025Representations of Fact, Fiction and Forecast in Large Language Models: Epistemics and Attitudescited by 3
- 2025UniToMBench: Integrating Perspective-Taking to Improve Theory of Mind in LLMscited by 3
- 2025Mixture of Reasonings: Teach Large Language Models to Reason with Adaptive Strategiescited by 3
- 2026SOTOPIA-TOM: Evaluating Privacy and Information Management in Multi-Agent Interaction with Theory of Mindcited by 3
- 2025Let's Put Ourselves in Sally's Shoes: Shoes-of-Others Prefilling Improves Theory of Mind in Large Language Modelscited by 2
- 2025PRISON: Unmasking the Criminal Potential of Large Language Modelscited by 2
50 most cited of 89 All 89 (JSON)
- 2026Jev-ToM: Evaluating Theory of Mind in Typed Decision Models13 Oct 2026
- 2026Beyond Belief Nesting: Rethinking Higher-Order Theory of Mind in Large Language Models13 Oct 2026
- 2026The Curse of Knowledge in Role-Playing Language Models12 Oct 2026
- 2026Assessing mentalization in humans and large language models26 Aug 2026
- 2026Illusion of Alignment: Detecting Hidden Disagreement in Collaborative Dialogue8 Aug 2026
- 2026Evaluating Theory of Mind in Reasoning Models: Robustness over Reasoning5 Aug 2026
- 2026PICTURE: Enhancing Theory-of-Mind in Large Language Models by Revealing, Not Hiding, Characters' Lack of Knowledge3 Aug 2026
- 2026TARS: A Theory-of-Mind Agent for Personalized In-IDE Code Comprehension17 Jul 2026
- 2026Flout at Your Own Risk: LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry13 Jul 2026
- 2026Enhancing Decision-Making with Large Language Models through Multi-Agent Fictitious Play17 Jun 2026
- 2026From Shortcuts to Reasoning: Robust Post-Training of Theory of Mind with Reinforcement Learning8 Jun 2026
- 2026PerspectiveGap: A Benchmark for Multi-Agent Orchestration Prompting7 Jun 2026
38 more
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotations29 May 2026
- 2026UserHarness: Harnessing User Minds for Stronger Agent Theory-of-Mind26 May 2026
- 2026Agent-ToM: Learning to Monitor Autonomous LLM Agents via Theory-of-Mind Reasoning22 May 2026
- 2026SODE: Analyzing Social Dynamics in LLM Agents6 May 2026
- 2026SOTOPIA-TOM: Evaluating Privacy and Information Management in Multi-Agent Interaction with Theory of Mind4 May 2026
- 2026Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations28 Apr 2026
- 2026DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories22 Apr 2026
- 2026CoSToM:Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models11 Apr 2026
- 2026ThinkTwice: Jointly Optimizing Large Language Models for Reasoning and Self-Refinement2 Apr 2026
- 2026Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models25 Mar 2026
- 2026Dynamic Theory of Mind as a Temporal Memory Problem: Evidence from Large Language Models15 Mar 2026
- 2026Understanding Artificial Theory of Mind: Perturbed Tasks and Reasoning in Large Language Models25 Feb 2026
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks11 Feb 2026
- 2026Reasoning Promotes Robustness in Theory of Mind Tasks23 Jan 2026
- 2026RebuttalAgent: Strategic Persuasion in Academic Rebuttal via Theory of Mind22 Jan 2026
- 2026Understanding Mental States to Guide Social Influence in Multi-Person Group Dialogue20 Jan 2026
- 2025Are Vision Language Models Cross-Cultural Theory of Mind Reasoners?19 Dec 2025
- 2025MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents28 Nov 2025
- 2025HeaRT: A Hierarchical Circuit Reasoning Tree-Based Agentic Framework for AMS Design Optimization24 Nov 2025
- 2025Mind the Motions: Benchmarking Theory-of-Mind in Everyday Body Language19 Nov 2025
- 2025PerspAct: Enhancing LLM Situated Collaboration Skills through Perspective Taking and Active Vision11 Nov 2025
- 2025Active Confusion Expression in Large Language Models: Leveraging World Models toward Better Social Reasoning9 Oct 2025
- 2025When Researchers Say Mental Model/Theory of Mind of AI, What Are They Really Talking About?3 Oct 2025
- 2025Modeling Others' Minds as Code29 Sep 2025
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agents26 Sep 2025
- 2025TactfulToM: Do LLMs Have the Theory of Mind Ability to Understand White Lies?21 Sep 2025
- 2025Growing Perspectives: Modelling Embodied Perspective Taking and Inner Narrative Development Using Large Language Models15 Sep 2025
- 2025ToM-SSI: Evaluating Theory of Mind in Situated Social Interactions5 Sep 2025
- 2025Social World Models30 Aug 2025
- 2025Who Sees What? Structured Thought-Action Sequences for Epistemic Reasoning in LLMs20 Aug 2025
- 2025Making Language Model a Hierarchical Classifier17 Jul 2025
- 2025Towards Machine Theory of Mind with Large Language Model-Augmented Inverse Planning4 Jul 2025
- 2025Mixture of Reasonings: Teach Large Language Models to Reason with Adaptive Strategies1 Jul 2025
- 2025PRISON: Unmasking the Criminal Potential of Large Language Models19 Jun 2025
- 2025EvolvTrip: Enhancing Literary Character Understanding with Temporal Theory-of-Mind Graphs16 Jun 2025
- 2025UniToMBench: Integrating Perspective-Taking to Improve Theory of Mind in LLMs11 Jun 2025
- 2025Let's Put Ourselves in Sally's Shoes: Shoes-of-Others Prefilling Improves Theory of Mind in Large Language Models6 Jun 2025
- 2025Representations of Fact, Fiction and Forecast in Large Language Models: Epistemics and Attitudes2 Jun 2025
50 newest of 89 All 89 (JSON)
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 99
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
- 2024Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoningcited by 33
- 2024Meta Reasoning for Large Language Modelscited by 29
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Modelscited by 29
- 2025Decompose-ToM: Enhancing Theory of Mind Reasoning in Large Language Models through Simulation and Task Decompositioncited by 17
- 2025EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric Videoscited by 12
- 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Languagecited by 8
- 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity Statescited by 6
- 2024Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Modelscited by 5
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Plannercited by 5
- 2026ThinkTwice: Jointly Optimizing Large Language Models for Reasoning and Self-Refinementcited by 5
12 most cited of 24 All 24 (JSON)
- 2026Beyond Belief Nesting: Rethinking Higher-Order Theory of Mind in Large Language Models13 Oct 2026
- 2026Evaluating Theory of Mind in Reasoning Models: Robustness over Reasoning5 Aug 2026
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotations29 May 2026
- 2026Agent-ToM: Learning to Monitor Autonomous LLM Agents via Theory-of-Mind Reasoning22 May 2026
- 2026ThinkTwice: Jointly Optimizing Large Language Models for Reasoning and Self-Refinement2 Apr 2026
- 2026Understanding Artificial Theory of Mind: Perturbed Tasks and Reasoning in Large Language Models25 Feb 2026
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks11 Feb 2026
- 2026Reasoning Promotes Robustness in Theory of Mind Tasks23 Jan 2026
- 2025Are Vision Language Models Cross-Cultural Theory of Mind Reasoners?19 Dec 2025
- 2025Who Sees What? Structured Thought-Action Sequences for Epistemic Reasoning in LLMs20 Aug 2025
- 2025Mixture of Reasonings: Teach Large Language Models to Reason with Adaptive Strategies1 Jul 2025
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner2 Jun 2025
12 newest of 24 All 24 (JSON)
- 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
- 2025AutoToM: Scaling Model-based Mental Inference via Automated Agent Modelingcited by 23
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agentscited by 8
- 2026PerspectiveGap: A Benchmark for Multi-Agent Orchestration Promptingcited by 6
- 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learningcited by 5
- 2025HeaRT: A Hierarchical Circuit Reasoning Tree-Based Agentic Framework for AMS Design Optimizationcited by 5
- 2025MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agentscited by 5
- 2026SOTOPIA-TOM: Evaluating Privacy and Information Management in Multi-Agent Interaction with Theory of Mindcited by 3
- 2025BeliefNest: A Joint Action Simulator for Embodied Agents with Theory of Mindcited by 1
- 2025Towards Conversational Development Environments: Using Theory-of-Mind and Multi-Agent Architectures for Requirements Refinementcited by 1
- 2026SODE: Analyzing Social Dynamics in LLM Agentscited by 0
- 2026Enhancing Decision-Making with Large Language Models through Multi-Agent Fictitious Playcited by 0
12 most cited of 13 All 13 (JSON)
- 2026TARS: A Theory-of-Mind Agent for Personalized In-IDE Code Comprehension17 Jul 2026
- 2026Enhancing Decision-Making with Large Language Models through Multi-Agent Fictitious Play17 Jun 2026
- 2026PerspectiveGap: A Benchmark for Multi-Agent Orchestration Prompting7 Jun 2026
- 2026SODE: Analyzing Social Dynamics in LLM Agents6 May 2026
- 2026SOTOPIA-TOM: Evaluating Privacy and Information Management in Multi-Agent Interaction with Theory of Mind4 May 2026
- 2025MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents28 Nov 2025
- 2025HeaRT: A Hierarchical Circuit Reasoning Tree-Based Agentic Framework for AMS Design Optimization24 Nov 2025
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agents26 Sep 2025
- 2025Towards Conversational Development Environments: Using Theory-of-Mind and Multi-Agent Architectures for Requirements Refinement27 May 2025
- 2025BeliefNest: A Joint Action Simulator for Embodied Agents with Theory of Mind18 May 2025
- 2025AutoToM: Scaling Model-based Mental Inference via Automated Agent Modeling21 Feb 2025
- 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learning20 Nov 2024
12 newest of 13 All 13 (JSON)
- 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 85
- 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 72
- 2024SimpleToM: Exposing the Gap between Explicit ToM Inference and Implicit ToM Application in LLMscited by 57
- 2025Language Models use Lookbacks to Track Beliefscited by 39
- 2024Language Models Represent Beliefs of Self and Otherscited by 31
- 2025Theory of Mind in Large Language Models: Assessment and Enhancementcited by 25
- 2025Re-evaluating Theory of Mind evaluation in large language modelscited by 23
- 2024Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Modelscited by 22
- 2024TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mindcited by 21
- 2025Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human Statescited by 19
- 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mindcited by 12
- 2024Brittle Minds, Fixable Activations: Understanding Belief Representations in Language Modelscited by 8
12 most cited of 48 All 48 (JSON)
- 2026Jev-ToM: Evaluating Theory of Mind in Typed Decision Models13 Oct 2026
- 2026The Curse of Knowledge in Role-Playing Language Models12 Oct 2026
- 2026Assessing mentalization in humans and large language models26 Aug 2026
- 2026Illusion of Alignment: Detecting Hidden Disagreement in Collaborative Dialogue8 Aug 2026
- 2026PICTURE: Enhancing Theory-of-Mind in Large Language Models by Revealing, Not Hiding, Characters' Lack of Knowledge3 Aug 2026
- 2026Flout at Your Own Risk: LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry13 Jul 2026
- 2026From Shortcuts to Reasoning: Robust Post-Training of Theory of Mind with Reinforcement Learning8 Jun 2026
- 2026UserHarness: Harnessing User Minds for Stronger Agent Theory-of-Mind26 May 2026
- 2026Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations28 Apr 2026
- 2026DialToM: A Theory of Mind Benchmark for Forecasting State-Driven Dialogue Trajectories22 Apr 2026
- 2026CoSToM:Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models11 Apr 2026
- 2026Dynamic Theory of Mind as a Temporal Memory Problem: Evidence from Large Language Models15 Mar 2026
12 newest of 48 All 48 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models
- 2025On the Thinking-Language Modeling Gap in Large Language Models
- 2025Language Models Might Not Understand You: Evaluating Theory of Mind via Story Prompting
- 2025Do Large Language Models Have a Planning Theory of Mind? Evidence from MindGames: a Multi-Step Persuasion Task
- 2025XToM: Exploring the Multilingual Theory of Mind for Large Language Models
- 2025Doing Things with Words: Rethinking Theory of Mind Simulation in Large Language Models
- 2023MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic
- 2024Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning