Does ChatGPT Have a Mind?
Not on the map. Why?
Abstract (arXiv)
This paper examines the question of whether Large Language Models (LLMs) like ChatGPT possess minds, focusing specifically on whether they have a genuine folk psychology encompassing beliefs, desires, and intentions. We approach this question by investigating two key aspects: internal representations and dispositions to act. First, we survey various philosophical theories of representation, including informational, causal, structural, and teleosemantic accounts, arguing that LLMs satisfy key conditions proposed by each. We draw on recent interpretability research in machine learning to support these claims. Second, we explore whether LLMs exhibit robust dispositions to perform actions, a necessary component of folk psychology. We consider two prominent philosophical traditions, interpretationism and representationalism, to assess LLM action dispositions. While we find evidence suggesting LLMs may satisfy some criteria for having a mind, particularly in game-theoretic environments, we conclude that the data remains inconclusive. Additionally, we reply to several skeptical challenges to LLM folk psychology, including issues of sensory grounding, the "stochastic parrots" argument, and concerns about memorization. Our paper has three main upshots. First, LLMs do have robust internal representations. Second, there is an open question to answer about whether LLMs have robust action dispositions. Third, existing skeptical challenges to LLM representation do not survive philosophical scrutiny.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 27 Jun 2024.
Builds on
24 of 55 references.
References · 24
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
- 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
- 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240
12 more
- 2023The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networkscited by 153
- 2021Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Colorcited by 118
- 2024Evaluating the World Model Implicit in a Generative Modelcited by 107
- 2018Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Informationcited by 97
- 2023Still No Lie Detector for Language Models: Probing Empirical and Conceptual Roadblockscited by 77
- 2019Do Neural Language Representations Learn Physical Commonsense?cited by 62
- 2023From task structures to world models: What do LLMs know?cited by 46
- 2015Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learningcited by 29
- 2019Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representationscited by 24
- 2023Operationalising Representation in Natural Language Processingcited by 14
- 2024Are Language Models More Like Libraries or Like Librarians? Bibliotechnism, the Novel Reference Problem, and the Attitudes of LLMscited by 11
- 2023Testing Causal Models of Word Meaning in GPT-3 and -4cited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 9; 2026: 2.
13 papers.
Sort:
By area:
- 2025Agentic Large Language Models, a surveycited by 105
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 57
- 2024Taking AI Welfare Seriouslycited by 28
- 2024Can LLMs make trade-offs involving stipulated pain and pleasure states?cited by 16
- 2025Mechanistic Interpretability Needs Philosophycited by 6
- 2025Mechanistic Indicators of Understanding in Large Language Modelscited by 6
- 2025Towards properly implementing Theory of Mind in AI systems: An account of four misconceptionscited by 3
- 2025The Limits of Predicting Agents from Behaviourcited by 3
- 2025Not Minds, but Signs: Reframing LLMs through Semioticscited by 2
- 2026Beliefs and Behavior in Language Modelscited by 1
- 2025Representation in large language modelscited by 0
- 2025Explainability Through Systematicity: The Hard Systematicity Challenge for Artificial Intelligencecited by 0
1 more
- 2026How LLMs Might Thinkcited by 0
- 2026Beliefs and Behavior in Language Models7 Sep 2026
- 2026How LLMs Might Think2 Apr 2026
- 2025Explainability Through Systematicity: The Hard Systematicity Challenge for Artificial Intelligence29 Jul 2025
- 2025Mechanistic Indicators of Understanding in Large Language Models7 Jul 2025
- 2025Mechanistic Interpretability Needs Philosophy23 Jun 2025
- 2025The Limits of Predicting Agents from Behaviour3 Jun 2025
- 2025Not Minds, but Signs: Reframing LLMs through Semiotics20 May 2025
- 2025Agentic Large Language Models, a survey29 Mar 2025
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems5 Mar 2025
- 2025Towards properly implementing Theory of Mind in AI systems: An account of four misconceptions28 Feb 2025
- 2025Representation in large language models1 Jan 2025
- 2024Taking AI Welfare Seriously4 Nov 2024
1 more
- 2025Agentic Large Language Models, a surveycited by 105
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 57
- 2024Taking AI Welfare Seriouslycited by 28
- 2025Agentic Large Language Models, a survey29 Mar 2025
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems5 Mar 2025
- 2024Taking AI Welfare Seriously4 Nov 2024
- 2024Can LLMs make trade-offs involving stipulated pain and pleasure states?cited by 16
- 2025Mechanistic Interpretability Needs Philosophycited by 6
- 2025Mechanistic Indicators of Understanding in Large Language Modelscited by 6
- 2025Towards properly implementing Theory of Mind in AI systems: An account of four misconceptionscited by 3
- 2025The Limits of Predicting Agents from Behaviourcited by 3
- 2025Not Minds, but Signs: Reframing LLMs through Semioticscited by 2
- 2026Beliefs and Behavior in Language Modelscited by 1
- 2025Representation in large language modelscited by 0
- 2025Explainability Through Systematicity: The Hard Systematicity Challenge for Artificial Intelligencecited by 0
- 2026How LLMs Might Thinkcited by 0
- 2026Beliefs and Behavior in Language Models7 Sep 2026
- 2026How LLMs Might Think2 Apr 2026
- 2025Explainability Through Systematicity: The Hard Systematicity Challenge for Artificial Intelligence29 Jul 2025
- 2025Mechanistic Indicators of Understanding in Large Language Models7 Jul 2025
- 2025Mechanistic Interpretability Needs Philosophy23 Jun 2025
- 2025The Limits of Predicting Agents from Behaviour3 Jun 2025
- 2025Not Minds, but Signs: Reframing LLMs through Semiotics20 May 2025
- 2025Towards properly implementing Theory of Mind in AI systems: An account of four misconceptions28 Feb 2025
- 2025Representation in large language models1 Jan 2025
- 2024Can LLMs make trade-offs involving stipulated pain and pleasure states?1 Nov 2024