Does ChatGPT have Theory of Mind?
Not on the map. Why?
Abstract (arXiv)
Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent recent Large Language Models in the ChatGPT tradition possess ToM. We posed six well-known problems that address biases in human reasoning and decision making to two versions of ChatGPT and we compared the results under a range of prompting strategies. While the results concerning ChatGPT-3 were somewhat inconclusive, ChatGPT-4 was shown to arrive at the correct answers more often than would be expected based on chance, although correct answers were often arrived at on the basis of false assumptions or invalid reasoning.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 13 of its 44 references that are in the map. First posted on arXiv 23 May 2023.
Builds on
13 of 44 references.
References · 13
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 214
- 2023A Categorical Archive of ChatGPT Failurescited by 168
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2023ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learningcited by 100
- 2021Probing Across Time: What Does RoBERTa Know and When?cited by 73
- 2023Boosting Theory-of-Mind Performance in Large Language Models via Promptingcited by 64
1 more
Built on by
Citing papers per year: 2023: 7; 2024: 6; 2025: 3.
16 papers.
Sort:
By area:
- 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
- 2023Deception Abilities Emerged in Large Language Modelscited by 101
- 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-4cited by 73
- 2023Towards A Holistic Landscape of Situated Theory of Mind in Large Language Modelscited by 32
- 2024(Ir)rationality and Cognitive Biases in Large Language Modelscited by 23
- 2025Re-evaluating Theory of Mind evaluation in large language modelscited by 23
- 2024Recent Advancement of Emotion Cognition in Large Language Modelscited by 9
- 2023LLM Cognitive Judgements Differ From Humancited by 8
- 2023The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?cited by 8
- 2024Improving Language Models for Emotion Analysis: Insights from Cognitive Sciencecited by 4
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicitycited by 4
- 2025THiNK: Can Large Language Models Think-aloud?cited by 3
4 more
- 2023Human-Like Intuitive Behavior and Reasoning Biases Emerged in Language Models -- and Disappeared in GPT-4cited by 2
- 2023A criterion for Artificial General Intelligence: hypothetic-deductive reasoning, tested on ChatGPTcited by 1
- 2024Can AI and humans genuinely communicate?cited by 1
- 2025Causes in neuron diagrams, and testing causal reasoning in Large Language Models. A glimpse of the future of philosophy?cited by 0
- 2025Causes in neuron diagrams, and testing causal reasoning in Large Language Models. A glimpse of the future of philosophy?17 Jun 2025
- 2025THiNK: Can Large Language Models Think-aloud?26 May 2025
- 2025Re-evaluating Theory of Mind evaluation in large language models28 Feb 2025
- 2024Recent Advancement of Emotion Cognition in Large Language Models20 Sep 2024
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity8 Jul 2024
- 2024Improving Language Models for Emotion Analysis: Insights from Cognitive Science11 Jun 2024
- 2024Can AI and humans genuinely communicate?14 Feb 2024
- 2024(Ir)rationality and Cognitive Biases in Large Language Models14 Feb 2024
- 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs6 Feb 2024
- 2023Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models30 Oct 2023
- 2023The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?28 Aug 2023
- 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-424 Aug 2023
4 more
- 2023A criterion for Artificial General Intelligence: hypothetic-deductive reasoning, tested on ChatGPT5 Aug 2023
- 2023Deception Abilities Emerged in Large Language Models31 Jul 2023
- 2023LLM Cognitive Judgements Differ From Human20 Jul 2023
- 2023Human-Like Intuitive Behavior and Reasoning Biases Emerged in Language Models -- and Disappeared in GPT-413 Jun 2023
- 2024(Ir)rationality and Cognitive Biases in Large Language Modelscited by 23
- 2023The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?cited by 8
- 2025THiNK: Can Large Language Models Think-aloud?cited by 3
- 2023Human-Like Intuitive Behavior and Reasoning Biases Emerged in Language Models -- and Disappeared in GPT-4cited by 2
- 2023A criterion for Artificial General Intelligence: hypothetic-deductive reasoning, tested on ChatGPTcited by 1
- 2025Causes in neuron diagrams, and testing causal reasoning in Large Language Models. A glimpse of the future of philosophy?cited by 0
- 2025Causes in neuron diagrams, and testing causal reasoning in Large Language Models. A glimpse of the future of philosophy?17 Jun 2025
- 2025THiNK: Can Large Language Models Think-aloud?26 May 2025
- 2024(Ir)rationality and Cognitive Biases in Large Language Models14 Feb 2024
- 2023The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?28 Aug 2023
- 2023A criterion for Artificial General Intelligence: hypothetic-deductive reasoning, tested on ChatGPT5 Aug 2023
- 2023Human-Like Intuitive Behavior and Reasoning Biases Emerged in Language Models -- and Disappeared in GPT-413 Jun 2023
- 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
- 2023Deception Abilities Emerged in Large Language Modelscited by 101
- 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-4cited by 73
- 2023Towards A Holistic Landscape of Situated Theory of Mind in Large Language Modelscited by 32
- 2025Re-evaluating Theory of Mind evaluation in large language modelscited by 23
- 2024Recent Advancement of Emotion Cognition in Large Language Modelscited by 9
- 2023LLM Cognitive Judgements Differ From Humancited by 8
- 2024Improving Language Models for Emotion Analysis: Insights from Cognitive Sciencecited by 4
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicitycited by 4
- 2024Can AI and humans genuinely communicate?cited by 1
- 2025Re-evaluating Theory of Mind evaluation in large language models28 Feb 2025
- 2024Recent Advancement of Emotion Cognition in Large Language Models20 Sep 2024
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity8 Jul 2024
- 2024Improving Language Models for Emotion Analysis: Insights from Cognitive Science11 Jun 2024
- 2024Can AI and humans genuinely communicate?14 Feb 2024
- 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs6 Feb 2024
- 2023Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models30 Oct 2023
- 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-424 Aug 2023
- 2023Deception Abilities Emerged in Large Language Models31 Jul 2023
- 2023LLM Cognitive Judgements Differ From Human20 Jul 2023