mlsanityData to 7 Oct 2026

How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulation

arXiv 2502.14642 ↗First posted 20 Feb 2025cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

Recently, LLMs have garnered increasing attention across academic disciplines for their potential as human digital twins, virtual proxies designed to replicate individuals and autonomously perform tasks such as decision-making, problem-solving, and reasoning on their behalf. However, current evaluations of LLMs primarily emphasize dialogue simulation while overlooking human behavior simulation, which is crucial for digital twins. To address this gap, we introduce BehaviorChain, the first benchmark for evaluating LLMs' ability to simulate continuous human behavior. BehaviorChain comprises diverse, high-quality, persona-based behavior chains, totaling 15,846 distinct behaviors across 1,001 unique personas, each with detailed history and profile metadata. For evaluation, we integrate persona metadata into LLMs and employ them to iteratively infer contextually appropriate behaviors within dynamic scenarios provided by BehaviorChain. Comprehensive evaluation results demonstrated that even state-of-the-art models struggle with accurately simulating continuous human behavior.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

24 of 41 references.

References · 24

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
  3. 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
  4. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  5. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
  6. 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
  7. 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
  8. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  9. 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
  10. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
  11. 2024Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarioscited by 85
  12. 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 71
12 more
  1. 2023CharacterChat: Learning towards Conversational AI with Personalized Social Supportcited by 58
  2. 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agentcited by 52
  3. 2024Y Social: an LLM-powered Social Media Digital Twincited by 43
  4. 2024Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Workscited by 38
  5. 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
  6. 2024ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agentscited by 35
  7. 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
  8. 2024Personalized LLM Response Generation with Parameterized Memory Injectioncited by 33
  9. 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streamingcited by 27
  10. 2022Integrating Digital Twin and Advanced Intelligent Technologies to Realize the Metaversecited by 5
  11. 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmarkcited by 3
  12. 2022Applying Digital Twins in Metaverse: User Interface, Security and Privacy Challengescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 16.

21 papers.

Sort:

By area:

  1. 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
  2. 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
  3. 2025Persona-Based Synthetic Data Generation Using Multi-Stage Conditioning with Large Language Models for Emotion Recognitioncited by 5
  4. 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agentscited by 5
  5. 2026The Behavioral Fabric of LLM-Powered GUI Agents: Human Values and Interaction Outcomescited by 3
  6. 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategiescited by 2
  7. 2026When Can Digital Personas Reliably Approximate Human Survey Findings?cited by 2
  8. 2026ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?cited by 2
  9. 2026Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studiescited by 1
  10. 2025PersonaDrift: A Benchmark for Temporal Anomaly Detection in Language-Based Dementia Monitoringcited by 0
  11. 2026Personalized Prediction of Perceived Message Effectiveness Using Large Language Model Based Digital Twinscited by 0
  12. 2026Can LLMs Emulate Human Belief Dynamics?cited by 0
9 more
  1. 2026BehaviorBench: Modeling Real-World User Decisions from Behavioral Tracescited by 0
  2. 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
  3. 2026Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agentcited by 0
  4. 2026The Severance Problem: LLMs are Unaware of the Person Beyond the Promptcited by 0
  5. 2026A Persona-based Rate Action Indexcited by 0
  6. 2026Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfacescited by 0
  7. 2026mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transferscited by 0
  8. 2026Measuring the Behavioral Fidelity of Long-Horizon Human Activity Simulationscited by 0
  9. 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interactioncited by 0