mlsanityData to 14 Oct 2026

AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction

arXiv 2609.37853 ↗First posted 29 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed as social agents, yet credible human-like interaction requires more than fluent responses or persona consistency. Agents must autonomously decide whether, when, and how to communicate while adapting to evolving contexts, goals, and relationships. Existing research, however, lacks a unified approach to enabling, evaluating, and improving such capabilities in continuous, open-ended interaction. We introduce AnthroDial, a unified framework for developing anthropomorphic social agents from three complementary aspects: MindFlow, a lightweight interaction harness that enables autonomous, asynchronous, and adaptive communication through a dynamic Mind Buffer; CAPS-Eval, a theory-grounded framework for evaluating cognitive, affective, and behavioral dimensions of anthropomorphic interaction; and a scalable training paradigm that combines SEEDS for environment expansion with DiAPO for adaptive capability optimization. We further construct evaluation datasets covering everyday communication, game interaction, and long-horizon character interaction. Extensive experiments across diverse models and scenarios demonstrate improved interaction autonomy and naturalness, validate the reliability, discriminativeness, and agreement with human rankings of CAPS-Eval, and confirm the effectiveness of our training paradigm. Together, these components provide a unified framework for developing credible human-like social agents in open-ended interaction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

23 of 35 references.

References · 23

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  4. 2023Role-Play with Large Language Modelscited by 294
  5. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 97
  6. 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 52
  7. 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agentscited by 50
  8. 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 41
  9. 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
  10. 2026HumanLM: Simulating Users with State Alignment Beats Response Imitationcited by 37
  11. 2024Proactive Conversational Agents with Inner Thoughtscited by 36
  12. 2024AI Companions Reduce Lonelinesscited by 28
11 more
  1. 2025Can LLM Agents Simulate Multi-Turn Human Behavior? Evidence from Real Online Customer Behavior Datacited by 28
  2. 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
  3. 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 22
  4. 2024Human Simulacra: Benchmarking the Personification of Large Language Modelscited by 17
  5. 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 15
  6. 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 13
  7. 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generationcited by 11
  8. 2026Reinforcing Human Behavior Simulation via Verbal Feedbackcited by 4
  9. 2026HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patternscited by 2
  10. 2026Beyond Static Personas: Situational Personality Steering for Large Language Modelscited by 2
  11. 2026Your LLM, Your Style: Behavioral Mode Axes for LLM Behavioral Controlcited by 1

Built on by

Not cited yet.