Machine Theory of Mind
Not on the map. Why?
Cited by 25 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Theory of mind (ToM; Premack & Woodruff, 1978) broadly refers to humans' ability to represent the mental states of others, including their desires, beliefs, and intentions. We propose to train a machine to build such models too. We design a Theory of Mind neural network -- a ToMnet -- which uses meta-learning to build models of the agents it encounters, from observations of their behaviour alone. Through this process, it acquires a strong prior model for agents' behaviour, as well as the ability to bootstrap to richer predictions about agents' characteristics and mental states using only a small number of behavioural observations. We apply the ToMnet to agents behaving in simple gridworld environments, showing that it learns to model random, algorithmic, and deep reinforcement learning agents from varied populations, and that it passes classic ToM tasks such as the "Sally-Anne" test (Wimmer & Perner, 1983; Baron-Cohen et al., 1985) of recognising that others can hold false beliefs about the world. We argue that this system -- which autonomously learns how to model other agents in its world -- is an important step forward for developing multi-agent AI systems, for building intermediating technology for machine-human interaction, and for advancing the progress on interpretable AI.
Key facts. Cited by 226 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 23; 2022: 28; 2023: 45; 2024: 33; 2025: 47; 2026: 48.
226 papers.
Sort:
By area:
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
- 2023Playing repeated games with Large Language Modelscited by 217
- 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
- 2023Generative AIcited by 120
- 2023Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Trackercited by 95
- 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 85
- 2023MADiff: Offline Multi-agent Learning with Diffusion Modelscited by 75
- 2021MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Taskscited by 62
- 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 62
- 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
38 more
- 2023Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Testscited by 48
- 2022A Survey of Ad Hoc Teamwork Researchcited by 43
- 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
- 2021Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of otherscited by 39
- 2023Visual cognition in multimodal large language modelscited by 38
- 2021Continuous Coordination As a Realistic Scenario for Lifelong Learningcited by 32
- 2021Few-shot Language Coordination by Modeling Theory of Mindcited by 32
- 2023Towards A Holistic Landscape of Situated Theory of Mind in Large Language Modelscited by 32
- 2024Language Models Represent Beliefs of Self and Otherscited by 31
- 2024Position: Theory of Mind Benchmarks are Broken for Large Language Modelscited by 31
- 2021Deep Interactive Bayesian Reinforcement Learning via Meta-Learningcited by 29
- 2021On the Critical Role of Conventions in Adaptive Human-AI Collaborationcited by 27
- 2023COKE: A Cognitive Knowledge Graph for Machine Theory of Mindcited by 27
- 2025Theory of Mind in Large Language Models: Assessment and Enhancementcited by 25
- 2023The SocialAI School: Insights from Developmental Psychology Towards Artificial Socio-Cultural Agentscited by 24
- 2021PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learningcited by 23
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordinationcited by 23
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yetcited by 23
- 2021PHASE: PHysically-grounded Abstract Social Events for Machine Social Perceptioncited by 22
- 2021Model-Based Opponent Modelingcited by 22
- 2021Cognitive science as a source of forward and inverse models of human decisions for robotics and controlcited by 22
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mindcited by 21
- 2024TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mindcited by 21
- 2021CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Modelscited by 20
- 2022Using Natural Language and Program Abstractions to Instill Human Inductive Biases in Machinescited by 20
- 2023Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understandingcited by 20
- 2023Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learningcited by 19
- 2021Neural Recursive Belief States in Multi-Agent Reinforcement Learningcited by 18
- 2022Unpacking Large Language Models with Conceptual Consistencycited by 18
- 2023The feasibility of artificial consciousness through the lens of neurosciencecited by 18
- 2024Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Taskcited by 17
- 2025General agents contain world modelscited by 17
- 2022On the link between conscious function and general intelligence in humans and machinescited by 16
- 2022ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Timecited by 16
- 2023Neural Relational Inference with Fast Modular Meta-learningcited by 16
- 2024A Notion of Complexity for Theory of Mind via Discrete World Modelscited by 16
50 most cited of 226 All 226 (JSON)
- 2026Smart Alone, Blind Together: Why Accuracy Fails to CertifyTheory of Mind in Multi-Agent Teams13 Oct 2026
- 2026When Does Opponent Modeling Pay Off? Spatial Inference Stabilises Reinforcement Learning under Partial Observability13 Oct 2026
- 2026Beyond Successful Play: Diagnosing Opponent Modeling in Large Language Models12 Oct 2026
- 2026Collaborative Theory of Mind: Learning to Self-Revise by Anticipating User Responses9 Oct 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States14 Sep 2026
- 2026DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting8 Sep 2026
- 2026Agents That Model Agents: Five Principles Toward a Theory of Mind for 6G Networks1 Sep 2026
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competition31 Aug 2026
- 2026A Primer on Computational Semantics for Artificial Intelligence Systems25 Aug 2026
- 2026Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfaces11 Aug 2026
- 2026Mental World Modeling29 Jul 2026
38 more
- 2026Align AI to Dynamic Human-AI Workflows15 Jul 2026
- 2026Auditing Belief-Conditioned LLM Agents in Hidden-Information Social Deduction Games12 Jul 2026
- 2026Personalizing MLLMs via Reinforced Multimodal Reference Game27 Jun 2026
- 2026RevengeBench: Reverse Engineering Code-Space Policies from Behavioral Experiments24 Jun 2026
- 2026Learning User Simulators with Turing Rewards17 Jun 2026
- 2026A formal definition and meta-model for a machine theory of mind2 Jun 2026
- 2026See Better, Foresee Better, Act Wiser: Physically Grounded Proactive Modeling and Decision Making2 Jun 2026
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotations29 May 2026
- 2026Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning29 May 2026
- 2026Generalized Intention Modeling in Multi-Agent Reinforcement Learning29 May 2026
- 2026Differentiable Belief-based Opponent Shaping27 May 2026
- 2026Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottlenecks18 May 2026
- 2026Predicting Decisions of AI Agents from Limited Interaction through Text-Tabular Modeling12 May 2026
- 2026Empathy as Predictive Misalignment Tolerance: A Co-Regulation Framework and the Regime Structure of Dialogue Repair5 May 2026
- 2026CoAX: Cognitive-Oriented Attribution eXplanation User Model of Human Understanding of AI Explanations30 Apr 2026
- 2026StratFormer: Adaptive Opponent Modeling and Exploitation in Imperfect-Information Games28 Apr 2026
- 2026From Fallback to Frontline: When Can LLMs be Superior Annotators of Human Perspectives?20 Apr 2026
- 2026Readable Minds: Emergent Theory-of-Mind-Like Behavior in LLM Poker Agents5 Apr 2026
- 2026Belief Dynamics for Detecting Behavioral Shifts in Safe Collaborative Manipulation4 Apr 2026
- 2026Grounding Social Perception in Intuitive Physics28 Mar 2026
- 2026Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models25 Mar 2026
- 2026Learning When to Cooperate Under Heterogeneous Goals7 Mar 2026
- 2026Traces of Social Competence in Large Language Models4 Mar 2026
- 2026MetaMind: General and Cognitive World Models in Multi-Agent Systems by Meta-Theory of Mind28 Feb 2026
- 2026Rules or Weights? Comparing User Understanding of Explainable AI Techniques with the Cognitive XAI-Adaptive Model23 Feb 2026
- 2026Reasoning-Native Agentic Communication for 6G19 Feb 2026
- 2026HiVAE: Hierarchical Latent Variables for Scalable Theory of Mind18 Feb 2026
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind14 Feb 2026
- 2026How does longer temporal context enhance multimodal narrative video processing in the brain?7 Feb 2026
- 2026Learning the Value Systems of Agents with Preference-based and Inverse Reinforcement Learning4 Feb 2026
- 2026SIDiffAgent: Self-Improving Diffusion Agent2 Feb 2026
- 2026Tacit Coordination of Large Language Models28 Jan 2026
- 2026Meta-Cognitive Reinforcement Learning with Self-Doubt and Recovery28 Jan 2026
- 2026RebuttalAgent: Strategic Persuasion in Academic Rebuttal via Theory of Mind22 Jan 2026
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yet19 Jan 2026
- 2026M3-BENCH: Process-Aware Evaluation of LLM Agents' Social Behaviors in Mixed-Motive Games13 Jan 2026
- 2025BEDA: Belief Estimation as Probabilistic Constraints for Performing Strategic Dialogue Acts31 Dec 2025
- 2025Inter-Agent Relative Representations for Multi-Agent Option Discovery31 Dec 2025
50 newest of 226 All 226 (JSON)
- 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
- 2023The SocialAI School: Insights from Developmental Psychology Towards Artificial Socio-Cultural Agentscited by 24
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yetcited by 23
- 2024Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Taskcited by 17
- 2025Large Language Models as Theory of Mind Aware Generative Agents with Counterfactual Reflectioncited by 13
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperationcited by 13
- 2025Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaborationcited by 10
- 2026M3-BENCH: Process-Aware Evaluation of LLM Agents' Social Behaviors in Mixed-Motive Gamescited by 8
- 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learningcited by 5
- 2025Communication-Efficient Desire Alignment for Embodied Agent-Human Adaptationcited by 4
- 2023MultiPrompter: Cooperative Prompt Optimization with Multi-Agent Reinforcement Learningcited by 3
- 2025GroundAct: Can LLM Agents Ground Actions in Environmental States?cited by 2
12 most cited of 24 All 24 (JSON)
- 2026Smart Alone, Blind Together: Why Accuracy Fails to CertifyTheory of Mind in Multi-Agent Teams13 Oct 2026
- 2026Beyond Successful Play: Diagnosing Opponent Modeling in Large Language Models12 Oct 2026
- 2026Agents That Model Agents: Five Principles Toward a Theory of Mind for 6G Networks1 Sep 2026
- 2026Auditing Belief-Conditioned LLM Agents in Hidden-Information Social Deduction Games12 Jul 2026
- 2026Predicting Decisions of AI Agents from Limited Interaction through Text-Tabular Modeling12 May 2026
- 2026Readable Minds: Emergent Theory-of-Mind-Like Behavior in LLM Poker Agents5 Apr 2026
- 2026Reasoning-Native Agentic Communication for 6G19 Feb 2026
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind14 Feb 2026
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yet19 Jan 2026
- 2026M3-BENCH: Process-Aware Evaluation of LLM Agents' Social Behaviors in Mixed-Motive Games13 Jan 2026
- 2025Policy-Conditioned Policies for Multi-Agent Task Solving24 Dec 2025
- 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperation4 Nov 2025
12 newest of 24 All 24 (JSON)
- 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
- 2025EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric Videoscited by 12
- 2022Solving the Baby Intuitions Benchmark with a Hierarchically Bayesian Theory of Mindcited by 9
- 2023Neural Reasoning About Agents' Goals, Preferences, and Actionscited by 8
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Plannercited by 5
- 2025HugAgent: A Human Simulation Benchmark for Individual-Level Reasoningcited by 2
- 2025MIRROR: Converging Cognitive Principles as Computational Mechanisms for AI Reasoningcited by 1
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotationscited by 0
- 2026Collaborative Theory of Mind: Learning to Self-Revise by Anticipating User Responsescited by 0
- 2026Collaborative Theory of Mind: Learning to Self-Revise by Anticipating User Responses9 Oct 2026
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotations29 May 2026
- 2025HugAgent: A Human Simulation Benchmark for Individual-Level Reasoning16 Oct 2025
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner2 Jun 2025
- 2025MIRROR: Converging Cognitive Principles as Computational Mechanisms for AI Reasoning31 May 2025
- 2025EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric Videos28 Mar 2025
- 2023Neural Reasoning About Agents' Goals, Preferences, and Actions12 Dec 2023
- 2023Understanding Social Reasoning in Language Models with Language Models21 Jun 2023
- 2022Solving the Baby Intuitions Benchmark with a Hierarchically Bayesian Theory of Mind4 Aug 2022
- 2023COKE: A Cognitive Knowledge Graph for Machine Theory of Mindcited by 27
- 2025General agents contain world modelscited by 17
- 2024A Notion of Complexity for Theory of Mind via Discrete World Modelscited by 16
- 2026MetaMind: General and Cognitive World Models in Multi-Agent Systems by Meta-Theory of Mindcited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026Mental World Modelingcited by 1
- 2026Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learningcited by 0
- 2026See Better, Foresee Better, Act Wiser: Physically Grounded Proactive Modeling and Decision Makingcited by 0
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Mental World Modeling29 Jul 2026
- 2026See Better, Foresee Better, Act Wiser: Physically Grounded Proactive Modeling and Decision Making2 Jun 2026
- 2026Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning29 May 2026
- 2026MetaMind: General and Cognitive World Models in Multi-Agent Systems by Meta-Theory of Mind28 Feb 2026
- 2025General agents contain world models2 Jun 2025
- 2024A Notion of Complexity for Theory of Mind via Discrete World Models16 Jun 2024
- 2023COKE: A Cognitive Knowledge Graph for Machine Theory of Mind9 May 2023
- 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
- 2024Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planningcited by 7
- 2024Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inferencecited by 7
- 2026Learning the Value Systems of Agents with Preference-based and Inverse Reinforcement Learningcited by 1
- 2026Meta-Cognitive Reinforcement Learning with Self-Doubt and Recoverycited by 0
- 2026When Does Opponent Modeling Pay Off? Spatial Inference Stabilises Reinforcement Learning under Partial Observabilitycited by 0
- 2026When Does Opponent Modeling Pay Off? Spatial Inference Stabilises Reinforcement Learning under Partial Observability13 Oct 2026
- 2026Learning the Value Systems of Agents with Preference-based and Inverse Reinforcement Learning4 Feb 2026
- 2026Meta-Cognitive Reinforcement Learning with Self-Doubt and Recovery28 Jan 2026
- 2024Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference18 Dec 2024
- 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design25 Jun 2024
- 2024Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planning12 Jun 2024
- 2023Multiagent Inverse Reinforcement Learning via Theory of Mind Reasoningcited by 11
- 2020Inverse Reinforcement Learning from a Gradient-based Learnercited by 7
- 2019Motion Reasoning for Goal-Based Imitation Learningcited by 6
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowdscited by 6
- 2022Basis for Intentions: Efficient Inverse Reinforcement Learning using Past Experiencecited by 4
- 2024Inverse Reinforcement Learning from Non-Stationary Learning Agentscited by 1
- 2024Inverse Reinforcement Learning from Non-Stationary Learning Agents18 Oct 2024
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowds26 May 2024
- 2023Multiagent Inverse Reinforcement Learning via Theory of Mind Reasoning20 Feb 2023
- 2022Basis for Intentions: Efficient Inverse Reinforcement Learning using Past Experience9 Aug 2022
- 2020Inverse Reinforcement Learning from a Gradient-based Learner15 Jul 2020
- 2019Motion Reasoning for Goal-Based Imitation Learning13 Nov 2019
- 2023Visual cognition in multimodal large language modelscited by 38
- 2026Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Modelscited by 0
- 2026Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottleneckscited by 0
- 2026Personalizing MLLMs via Reinforced Multimodal Reference Gamecited by 0
- 2026Personalizing MLLMs via Reinforced Multimodal Reference Game27 Jun 2026
- 2026Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottlenecks18 May 2026
- 2026Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models25 Mar 2026
- 2023Visual cognition in multimodal large language models27 Nov 2023
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
- 2023Playing repeated games with Large Language Modelscited by 217
- 2023Generative AIcited by 120
- 2023Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Trackercited by 95
- 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 85
- 2021MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Taskscited by 62
- 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2023Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Testscited by 48
- 2022A Survey of Ad Hoc Teamwork Researchcited by 43
- 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
- 2021Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of otherscited by 39
12 most cited of 162 All 162 (JSON)
- 2026Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States14 Sep 2026
- 2026DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting8 Sep 2026
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competition31 Aug 2026
- 2026A Primer on Computational Semantics for Artificial Intelligence Systems25 Aug 2026
- 2026Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfaces11 Aug 2026
- 2026RevengeBench: Reverse Engineering Code-Space Policies from Behavioral Experiments24 Jun 2026
- 2026Learning User Simulators with Turing Rewards17 Jun 2026
- 2026A formal definition and meta-model for a machine theory of mind2 Jun 2026
- 2026Generalized Intention Modeling in Multi-Agent Reinforcement Learning29 May 2026
- 2026Differentiable Belief-based Opponent Shaping27 May 2026
- 2026Empathy as Predictive Misalignment Tolerance: A Co-Regulation Framework and the Regime Structure of Dialogue Repair5 May 2026
- 2026CoAX: Cognitive-Oriented Attribution eXplanation User Model of Human Understanding of AI Explanations30 Apr 2026
12 newest of 162 All 162 (JSON)