mlsanityData to 7 Oct 2026

Six misconceptions about large language models: A minimal model and diagnostic taxonomy

arXiv 2608.20421 ↗First posted 19 Aug 2026cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are now embedded in scientific, educational, and governance workflows, with debates centering on their capabilities, mechanisms, and impacts. Yet these debates remain structured by persistent folk theories--intuitive, informal explanatory models that guide attitudes and actions. Deflationary slogans ("just autocomplete," "stochastic parrots," and "average of the internet") and anthropomorphic framings ("emergent agents" and "proto-minds") each capture genuine features of current systems but mistake those features for the whole. This Perspective proposes a minimal working model of LLM-based systems centered on four distinctions: between pretraining and deployed systems; between the learned distribution and particular samples; among parametric, contextual, and external memory; and between task competence and agency. The model is used to diagnose six misconceptions about LLMs: next-token prediction, regression to the mean, training-data regurgitation, model memory, alignment, and understanding. For each, the analysis identifies what the misconception gets right, which distinctions it conflates, and what follows for capability evaluation, system design, and governance. Applied to publisher AI policies as governance case studies, the framework shows both how policy language can conflate these distinctions and how such errors can be corrected. The model thereby avoids the parrot-mind binary by treating LLMs as simulators of discourse and task performance, offering a diagnostic toolkit for locating and correcting the errors these folk theories perpetuate.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 75 references that are in the map. First posted on arXiv 19 Aug 2026.

Builds on

36 of 75 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  7. 2017Deep reinforcement learning from human preferencescited by 3,846
  8. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  9. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  10. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  11. 2020Extracting Training Data from Large Language Modelscited by 2,144
  12. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
24 more
  1. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  2. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  3. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  4. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  5. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 165
  6. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
  7. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
  8. 2023GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Informationcited by 115
  9. 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 66
  10. 2025Mathematical exploration and discovery at scalecited by 66
  11. 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 36
  12. 2024Superhuman performance of a large language model on the reasoning tasks of a physiciancited by 28
  13. 2024AnthroScore: A Computational Linguistic Measure of Anthropomorphismcited by 27
  14. 2024Six Fallacies in Substituting Large Language Models for Human Participantscited by 24
  15. 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
  16. 2025Academic journals' AI policies fail to curb the surge in AI-assisted academic writingcited by 12
  17. 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphorscited by 9
  18. 2025From Prompts to Constructs: A Dual-Validity Framework for Large Language Model Research in Psychologycited by 9
  19. 2025A validity-guided workflow for robust large language model research in psychologycited by 8
  20. 2025Memory in Large Language Models: Mechanisms, Evaluation and Evolutioncited by 8
  21. 2025R1dacted: Investigating Local Censorship in DeepSeek's R1 Language Modelcited by 7
  22. 2025Large Language Models as Psychological Simulators: A Methodological Guidecited by 6
  23. 2024How ChatGPT Changed the Media's Narratives on AI: A Semi-Automated Narrative Analysis Through Frame Semanticscited by 4
  24. 2025Data-Driven Analysis of Text-Conditioned AI-Generated Music: A Case Study with Suno and Udiocited by 3

Built on by

Not cited yet.