How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulation
Not on the map. Why?
Abstract (arXiv)
Recently, LLMs have garnered increasing attention across academic disciplines for their potential as human digital twins, virtual proxies designed to replicate individuals and autonomously perform tasks such as decision-making, problem-solving, and reasoning on their behalf. However, current evaluations of LLMs primarily emphasize dialogue simulation while overlooking human behavior simulation, which is crucial for digital twins. To address this gap, we introduce BehaviorChain, the first benchmark for evaluating LLMs' ability to simulate continuous human behavior. BehaviorChain comprises diverse, high-quality, persona-based behavior chains, totaling 15,846 distinct behaviors across 1,001 unique personas, each with detailed history and profile metadata. For evaluation, we integrate persona metadata into LLMs and employ them to iteratively infer contextually appropriate behaviors within dynamic scenarios provided by BehaviorChain. Comprehensive evaluation results demonstrated that even state-of-the-art models struggle with accurately simulating continuous human behavior.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 20 Feb 2025.
Builds on
24 of 41 references.
References · 24
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
- 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
- 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
- 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
- 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
- 2024Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarioscited by 85
- 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 71
12 more
- 2023CharacterChat: Learning towards Conversational AI with Personalized Social Supportcited by 58
- 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agentcited by 52
- 2024Y Social: an LLM-powered Social Media Digital Twincited by 43
- 2024Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Workscited by 38
- 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
- 2024ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agentscited by 35
- 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
- 2024Personalized LLM Response Generation with Parameterized Memory Injectioncited by 33
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streamingcited by 27
- 2022Integrating Digital Twin and Advanced Intelligent Technologies to Realize the Metaversecited by 5
- 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmarkcited by 3
- 2022Applying Digital Twins in Metaverse: User Interface, Security and Privacy Challengescited by 2
Built on by
Citing papers per year: 2025: 5; 2026: 16.
21 papers.
Sort:
By area:
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2025Persona-Based Synthetic Data Generation Using Multi-Stage Conditioning with Large Language Models for Emotion Recognitioncited by 5
- 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agentscited by 5
- 2026The Behavioral Fabric of LLM-Powered GUI Agents: Human Values and Interaction Outcomescited by 3
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategiescited by 2
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?cited by 2
- 2026ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?cited by 2
- 2026Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studiescited by 1
- 2025PersonaDrift: A Benchmark for Temporal Anomaly Detection in Language-Based Dementia Monitoringcited by 0
- 2026Personalized Prediction of Perceived Message Effectiveness Using Large Language Model Based Digital Twinscited by 0
- 2026Can LLMs Emulate Human Belief Dynamics?cited by 0
9 more
- 2026BehaviorBench: Modeling Real-World User Decisions from Behavioral Tracescited by 0
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
- 2026Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agentcited by 0
- 2026The Severance Problem: LLMs are Unaware of the Person Beyond the Promptcited by 0
- 2026A Persona-based Rate Action Indexcited by 0
- 2026Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfacescited by 0
- 2026mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transferscited by 0
- 2026Measuring the Behavioral Fidelity of Long-Horizon Human Activity Simulationscited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interactioncited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction29 Sep 2026
- 2026Measuring the Behavioral Fidelity of Long-Horizon Human Activity Simulations1 Sep 2026
- 2026mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers31 Aug 2026
- 2026Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfaces11 Aug 2026
- 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agents4 Aug 2026
- 2026A Persona-based Rate Action Index29 Jul 2026
- 2026The Severance Problem: LLMs are Unaware of the Person Beyond the Prompt15 Jul 2026
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure16 Jun 2026
- 2026ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?4 Jun 2026
- 2026BehaviorBench: Modeling Real-World User Decisions from Behavioral Traces1 Jun 2026
- 2026Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agent13 May 2026
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?11 May 2026
9 more
- 2026Can LLMs Emulate Human Belief Dynamics?5 May 2026
- 2026Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studies17 Apr 2026
- 2026Personalized Prediction of Perceived Message Effectiveness Using Large Language Model Based Digital Twins23 Feb 2026
- 2026The Behavioral Fabric of LLM-Powered GUI Agents: Human Values and Interaction Outcomes22 Jan 2026
- 2025PersonaDrift: A Benchmark for Temporal Anomaly Detection in Language-Based Dementia Monitoring20 Nov 2025
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation29 Oct 2025
- 2025Persona-Based Synthetic Data Generation Using Multi-Stage Conditioning with Large Language Models for Emotion Recognition15 Jul 2025
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategies10 Mar 2025
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
- 2025Benchmarking Chinese Medical LLMs: A Medbench-based Analysis of Performance Gaps and Hierarchical Optimization Strategiescited by 2
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?cited by 2
- 2026ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?cited by 2
- 2026Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studiescited by 1
- 2025PersonaDrift: A Benchmark for Temporal Anomaly Detection in Language-Based Dementia Monitoringcited by 0
- 2026Personalized Prediction of Perceived Message Effectiveness Using Large Language Model Based Digital Twinscited by 0
- 2026Can LLMs Emulate Human Belief Dynamics?cited by 0
- 2026BehaviorBench: Modeling Real-World User Decisions from Behavioral Tracescited by 0
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
- 2026Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agentcited by 0
- 2026The Severance Problem: LLMs are Unaware of the Person Beyond the Promptcited by 0
12 most cited of 17 All 17 (JSON)
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction29 Sep 2026
- 2026Measuring the Behavioral Fidelity of Long-Horizon Human Activity Simulations1 Sep 2026
- 2026mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers31 Aug 2026
- 2026Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfaces11 Aug 2026
- 2026A Persona-based Rate Action Index29 Jul 2026
- 2026The Severance Problem: LLMs are Unaware of the Person Beyond the Prompt15 Jul 2026
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure16 Jun 2026
- 2026ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?4 Jun 2026
- 2026BehaviorBench: Modeling Real-World User Decisions from Behavioral Traces1 Jun 2026
- 2026Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agent13 May 2026
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?11 May 2026
- 2026Can LLMs Emulate Human Belief Dynamics?5 May 2026
12 newest of 17 All 17 (JSON)