mlsanityData to 7 Oct 2026

Transforming Agency. On the mode of existence of Large Language Models

arXiv 2407.10735 ↗First posted 15 Jul 2024cs.AI cs.CL cs.CYcited by 7

Not on the map. Why?

Abstract (arXiv)

This paper investigates the ontological characterization of Large Language Models (LLMs) like ChatGPT. Between inflationary and deflationary accounts, we pay special attention to their status as agents. This requires explaining in detail the architecture, processing, and training procedures that enable LLMs to display their capacities, and the extensions used to turn LLMs into agent-like systems. After a systematic analysis we conclude that a LLM fails to meet necessary and sufficient conditions for autonomous agency in the light of embodied theories of mind: the individuality condition (it is not the product of its own activity, it is not even directly affected by it), the normativity condition (it does not generate its own norms or goals), and, partially the interactional asymmetry condition (it is not the origin and sustained source of its interaction with the environment). If not agents, then ... what are LLMs? We argue that ChatGPT should be characterized as an interlocutor or linguistic automaton, a library-that-talks, devoid of (autonomous) agency, but capable to engage performatively on non-purposeful yet purpose-structured and purpose-bounded tasks. When interacting with humans, a "ghostly" component of the human-machine interaction makes it possible to enact genuine conversational experiences with LLMs. Despite their lack of sensorimotor and biological embodiment, LLMs textual embodiment (the training corpus) and resource-hungry computational embodiment, significantly transform existing forms of human agency. Beyond assisted and extended agency, the LLM-human coupling can produce midtended forms of agency, closer to the production of intentional agency than to the extended instrumentality of any previous technologies.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 55 of its 199 references that are in the map. First posted on arXiv 15 Jul 2024.

Builds on

55 of 199 references.

References · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2020Scaling Laws for Neural Language Modelscited by 6,411
  10. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  11. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  12. 2023Let's Verify Step by Stepcited by 3,598
38 more
  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  6. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  8. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  9. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  10. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  11. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  12. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  13. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  14. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  15. 2022A Generalist Agentcited by 802
  16. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  17. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
  18. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  19. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
  20. 2024Understanding the planning of LLM agents: A surveycited by 414
  21. 2023Augmented Language Models: a Surveycited by 398
  22. 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
  23. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  24. 2023Large Language Models as General Pattern Machinescited by 196
  25. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 195
  26. 2024More Agents Is All You Needcited by 174
  27. 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
  28. 2022Language Models as Agent Modelscited by 131
  29. 2023Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functionscited by 129
  30. 2023Theory of Mind for Multi-Agent Collaboration via Large Language Modelscited by 129
  31. 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
  32. 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
  33. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  34. 2022Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contestcited by 98
  35. 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)cited by 85
  36. 2024Do language models plan ahead for future tokens?cited by 47
  37. 2023From task structures to world models: What do LLMs know?cited by 46
  38. 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 1.

7 papers.