mlsanityData to 7 Oct 2026

Large language models and linguistic intentionality

arXiv 2404.09576 ↗First posted 15 Apr 2024cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Do large language models like Chat-GPT or LLaMa meaningfully use the words they produce? Or are they merely clever prediction machines, simulating language use by producing statistically plausible text? There have already been some initial attempts to answer this question by showing that these models meet the criteria for entering meaningful states according to metasemantic theories of mental content. In this paper, I will argue for a different approach - that we should instead consider whether language models meet the criteria given by our best metasemantic theories of linguistic content. In that vein, I will illustrate how this can be done by applying two such theories to the case of language models: Gareth Evans' (1982) account of naming practices and Ruth Millikan's (1984, 2004, 2005) teleosemantics. In doing so, I will argue that it is a mistake to think that the failure of LLMs to meet plausible conditions for mental intentionality thereby renders their outputs meaningless, and that a distinguishing feature of linguistic intentionality - dependency on a pre-existing linguistic system - allows for the plausible result LLM outputs are meaningful.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 64 references that are in the map. First posted on arXiv 15 Apr 2024.

Builds on

19 of 64 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  6. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  7. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  8. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  9. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
  10. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  11. 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 452
  12. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
7 more
  1. 2019Distributional Semantics and Linguistic Theorycited by 53
  2. 2023The Vector Grounding Problemcited by 39
  3. 2023Do Language Models' Words Refer?cited by 17
  4. 2024Language Writ Large: LLMs, ChatGPT, Grounding, Meaning and Understandingcited by 12
  5. 2024Are Language Models More Like Libraries or Like Librarians? Bibliotechnism, the Novel Reference Problem, and the Attitudes of LLMscited by 11
  6. 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
  7. 2022TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 0; 2026: 3.

6 papers.