Large language models and linguistic intentionality
Not on the map. Why?
Abstract (arXiv)
Do large language models like Chat-GPT or LLaMa meaningfully use the words they produce? Or are they merely clever prediction machines, simulating language use by producing statistically plausible text? There have already been some initial attempts to answer this question by showing that these models meet the criteria for entering meaningful states according to metasemantic theories of mental content. In this paper, I will argue for a different approach - that we should instead consider whether language models meet the criteria given by our best metasemantic theories of linguistic content. In that vein, I will illustrate how this can be done by applying two such theories to the case of language models: Gareth Evans' (1982) account of naming practices and Ruth Millikan's (1984, 2004, 2005) teleosemantics. In doing so, I will argue that it is a mistake to think that the failure of LLMs to meet plausible conditions for mental intentionality thereby renders their outputs meaningless, and that a distinguishing feature of linguistic intentionality - dependency on a pre-existing linguistic system - allows for the plausible result LLM outputs are meaningful.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 64 references that are in the map. First posted on arXiv 15 Apr 2024.
Builds on
19 of 64 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 452
- 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
7 more
- 2019Distributional Semantics and Linguistic Theorycited by 53
- 2023The Vector Grounding Problemcited by 39
- 2023Do Language Models' Words Refer?cited by 17
- 2024Language Writ Large: LLMs, ChatGPT, Grounding, Meaning and Understandingcited by 12
- 2024Are Language Models More Like Libraries or Like Librarians? Bibliotechnism, the Novel Reference Problem, and the Attitudes of LLMscited by 11
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
- 2022TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Modelscited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 0; 2026: 3.
6 papers.
- 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 14
- 2024Do Large Language Models Advocate for Inferentialism?cited by 1
- 2026Asymmetric Communication: Large Language Models and Language Gamescited by 0
- 2026Grounding Without Corrective Control: Truth-Tracking Profiles for Large Language Modelscited by 0
- 2026Anthropomorphism in the age of Large Language Models: An overview of potential risks and mitigationscited by 0
- 2026Anthropomorphism in the age of Large Language Models: An overview of potential risks and mitigations29 Sep 2026
- 2026Grounding Without Corrective Control: Truth-Tracking Profiles for Large Language Models14 Aug 2026
- 2026Asymmetric Communication: Large Language Models and Language Games30 Jul 2026
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models22 Dec 2024
- 2024Do Large Language Models Advocate for Inferentialism?19 Dec 2024
- 2024People cannot distinguish GPT-4 from a human in a Turing test9 May 2024