mlsanityData to 14 Oct 2026

HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns

arXiv 2601.10198 ↗First posted 15 Jan 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment with human cognitive and behavioral patterns remains a critical challenge for these agents. We present HumanLLM, a framework treating psychological patterns as interacting causal forces. We construct 244 patterns from ~12,000 academic papers and synthesize 11,359 scenarios where 2-5 patterns reinforce, conflict, or modulate each other, with multi-turn conversations expressing inner thoughts, actions, and dialogue. Our dual-level checklists evaluate both individual pattern fidelity and emergent multi-pattern dynamics, achieving strong human alignment (r=0.90) while revealing that holistic metrics conflate simulation accuracy with social desirability. HumanLLM-8B outperforms Qwen3-32B on multi-pattern dynamics despite 4× fewer parameters, demonstrating that authentic anthropomorphism requires cognitive modeling -- simulating not just what humans do, but the psychological processes generating those behaviors. Our dataset, code, and model are available at:https://github.com/YJGoodbye2024/HumanLLM

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

19 of 43 references.

References · 19

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2020Aligning AI With Shared Human Valuescited by 723
  3. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  4. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
  5. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
  6. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  7. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
  8. 2024LongAlign: A Recipe for Long Context Alignment of Large Language Modelscited by 106
  9. 2024MoralBench: Moral Evaluation of LLMscited by 50
  10. 2024Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Workscited by 38
  11. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
  12. 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
7 more
  1. 2024Can LLM "Self-report"?: Evaluating the Validity of Self-report Scales in Measuring Personality Design in LLM-based Chatbotscited by 20
  2. 2024How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHOcited by 19
  3. 2025Large Language Models Do Not Simulate Human Psychologycited by 19
  4. 2025The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societiescited by 14
  5. 2024MINDECHO: Role-Playing Language Agents for Key Opinion Leaderscited by 10
  6. 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulationcited by 10
  7. 2025Curse of Knowledge: When Complex Evaluation Context Benefits yet Biases LLM Judgescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.