mlsanityData to 7 Oct 2026

Does ChatGPT Have a Mind?

arXiv 2407.11015 ↗First posted 27 Jun 2024cs.CL cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper examines the question of whether Large Language Models (LLMs) like ChatGPT possess minds, focusing specifically on whether they have a genuine folk psychology encompassing beliefs, desires, and intentions. We approach this question by investigating two key aspects: internal representations and dispositions to act. First, we survey various philosophical theories of representation, including informational, causal, structural, and teleosemantic accounts, arguing that LLMs satisfy key conditions proposed by each. We draw on recent interpretability research in machine learning to support these claims. Second, we explore whether LLMs exhibit robust dispositions to perform actions, a necessary component of folk psychology. We consider two prominent philosophical traditions, interpretationism and representationalism, to assess LLM action dispositions. While we find evidence suggesting LLMs may satisfy some criteria for having a mind, particularly in game-theoretic environments, we conclude that the data remains inconclusive. Additionally, we reply to several skeptical challenges to LLM folk psychology, including issues of sensory grounding, the "stochastic parrots" argument, and concerns about memorization. Our paper has three main upshots. First, LLMs do have robust internal representations. Second, there is an open question to answer about whether LLMs have robust action dispositions. Third, existing skeptical challenges to LLM representation do not survive philosophical scrutiny.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

24 of 55 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  5. 2019Language Models as Knowledge Bases?cited by 1,922
  6. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  7. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
  8. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  9. 2023The Internal State of an LLM Knows When It's Lyingcited by 644
  10. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
  11. 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
  12. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240
12 more
  1. 2023The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networkscited by 153
  2. 2021Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Colorcited by 118
  3. 2024Evaluating the World Model Implicit in a Generative Modelcited by 107
  4. 2018Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Informationcited by 97
  5. 2023Still No Lie Detector for Language Models: Probing Empirical and Conceptual Roadblockscited by 77
  6. 2019Do Neural Language Representations Learn Physical Commonsense?cited by 62
  7. 2023From task structures to world models: What do LLMs know?cited by 46
  8. 2015Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learningcited by 29
  9. 2019Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representationscited by 24
  10. 2023Operationalising Representation in Natural Language Processingcited by 14
  11. 2024Are Language Models More Like Libraries or Like Librarians? Bibliotechnism, the Novel Reference Problem, and the Attitudes of LLMscited by 11
  12. 2023Testing Causal Models of Word Meaning in GPT-3 and -4cited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 2.

13 papers.

Sort:

By area: