HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment with human cognitive and behavioral patterns remains a critical challenge for these agents. We present HumanLLM, a framework treating psychological patterns as interacting causal forces. We construct 244 patterns from ~12,000 academic papers and synthesize 11,359 scenarios where 2-5 patterns reinforce, conflict, or modulate each other, with multi-turn conversations expressing inner thoughts, actions, and dialogue. Our dual-level checklists evaluate both individual pattern fidelity and emergent multi-pattern dynamics, achieving strong human alignment (r=0.90) while revealing that holistic metrics conflate simulation accuracy with social desirability. HumanLLM-8B outperforms Qwen3-32B on multi-pattern dynamics despite 4× fewer parameters, demonstrating that authentic anthropomorphism requires cognitive modeling -- simulating not just what humans do, but the psychological processes generating those behaviors. Our dataset, code, and model are available at:https://github.com/YJGoodbye2024/HumanLLM
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
19 of 43 references.
References · 19
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2020Aligning AI With Shared Human Valuescited by 723
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
- 2024LongAlign: A Recipe for Long Context Alignment of Large Language Modelscited by 106
- 2024MoralBench: Moral Evaluation of LLMscited by 50
- 2024Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Workscited by 38
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
- 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
7 more
- 2024Can LLM "Self-report"?: Evaluating the Validity of Self-report Scales in Measuring Personality Design in LLM-based Chatbotscited by 20
- 2024How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHOcited by 19
- 2025Large Language Models Do Not Simulate Human Psychologycited by 19
- 2025The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societiescited by 14
- 2024MINDECHO: Role-Playing Language Agents for Key Opinion Leaderscited by 10
- 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulationcited by 10
- 2025Curse of Knowledge: When Complex Evaluation Context Benefits yet Biases LLM Judgescited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.