mlsanityData to 7 Oct 2026

Thinking beyond the anthropomorphic paradigm benefits LLM research

arXiv 2502.09192 ↗First posted 13 Feb 2025cs.CLcited by 13

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Anthropomorphism, or the attribution of human traits to technology, is an automatic and unconscious response that occurs even in those with advanced technical expertise. In this position paper, we analyze hundreds of thousands of research articles to present empirical evidence of the prevalence and growth of anthropomorphic terminology in research on large language models (LLMs). We argue for challenging the deeper assumptions reflected in this terminology -- which, though often useful, may inadvertently constrain LLM development -- and broadening beyond them to open new pathways for understanding and improving LLMs. Specifically, we identify and examine five anthropomorphic assumptions that shape research across the LLM development lifecycle. For each assumption (e.g., that LLMs must use natural language for reasoning, or that they should be evaluated on benchmarks originally meant for humans), we demonstrate empirical, non-anthropomorphic alternatives that remain under-explored yet offer promising directions for LLM research and development.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 53 of its 105 references that are in the map. First posted on arXiv 13 Feb 2025.

Builds on

53 of 105 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024When a language model is optimized for reasoning, does it still show embers of autoregression? An analysis of OpenAI o12 Oct

Other references · 52

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  5. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  6. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  7. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  8. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  9. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
  10. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  11. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  12. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
38 more
  1. 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
  2. 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
  3. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
  4. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  5. 2024Alignment faking in large language modelscited by 316
  6. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
  7. 2023Role-Play with Large Language Modelscited by 290
  8. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
  9. 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
  10. 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 175
  11. 2022Talking About Large Language Modelscited by 174
  12. 2022Language Models as Agent Modelscited by 131
  13. 2023Eliciting Human Preferences with Language Modelscited by 90
  14. 2022Mapping global dynamics of benchmark creation and saturation in artificial intelligencecited by 71
  15. 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 71
  16. 2024Feedback Loops With Language Models Drive In-Context Reward Hackingcited by 70
  17. 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 61
  18. 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
  19. 2024Beyond Preferences in AI Alignmentcited by 46
  20. 2022The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligencecited by 42
  21. 2024Confabulation: The Surprising Value of Large Language Model Hallucinationscited by 42
  22. 2024Bias in Language Models: Beyond Trick Tests and Toward RUTEd Evaluationcited by 41
  23. 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 38
  24. 2023Does GPT-4 pass the Turing test?cited by 37
  25. 2022What do tokens know about their characters and how do they know it?cited by 36
  26. 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 36
  27. 2024AnthroScore: A Computational Linguistic Measure of Anthropomorphismcited by 27
  28. 2024MrT5: Dynamic Token Merging for Efficient Byte-level Language Modelscited by 27
  29. 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
  30. 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
  31. 2021The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identitycited by 16
  32. 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliancecited by 15
  33. 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 14
  34. 2024The Cognitive Revolution in Interpretability: From Explaining Behavior to Interpreting Representations and Algorithmscited by 13
  35. 2022Robustness of Demonstration-based Learning Under Limited Data Scenariocited by 11
  36. 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
  37. 2024Instruction Following without Instruction Tuningcited by 11
  38. 2025From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphorscited by 9

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 6.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Humanizing Machines: Rethinking LLM Anthropomorphism Through a Multi-Level Framework of Design
  2. 2026A Scoping Review of the Ethical Perspectives on Anthropomorphising Large Language Model-Based Conversational Agents
  3. 2025Mind the Gap: The Divergence Between Human and LLM-Generated Tasks
  4. 2024Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina
  5. 2025Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications
  6. 2025Exploring Anthropomorphism in Conversational Agents for Environmental Sustainability
  7. 2026Understanding Large Language Models
  8. 2024LLM Theory of Mind and Alignment: Opportunities and Risks