TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are exhibiting emergent human-like abilities and are increasingly envisioned as the foundation for simulating an individual's communication style, behavioral tendencies, and personality traits. However, current evaluations of LLM-based persona simulation remain limited: most rely on synthetic dialogues, lack systematic frameworks, and lack analysis of the capability requirement. To address these limitations, we introduce TwinVoice, a comprehensive benchmark for assessing persona simulation across diverse real-world contexts. TwinVoice encompasses three dimensions: Social Persona (public social interactions), Interpersonal Persona (private dialogues), and Narrative Persona (role-based expression). It further decomposes the evaluation of LLM performance into six fundamental capabilities, including opinion consistency, memory recall, logical reasoning, lexical fidelity, persona tone, and syntactic style. Experimental results reveal that while advanced models achieve moderate accuracy in persona simulation, they still fall short of capabilities such as syntactic style and memory recall. Consequently, the average performance achieved by LLMs remains considerably below the human baseline.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 32 of its 74 references that are in the map. First posted on arXiv 29 Oct 2025.
Builds on
32 of 74 references.
References · 32
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023Role-Play with Large Language Modelscited by 290
- 2016A Persona-Based Neural Conversation Modelcited by 221
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
- 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
- 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 101
20 more
- 2025Large Language Models Pass the Turing Testcited by 48
- 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46
- 2023Does GPT-4 pass the Turing test?cited by 37
- 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
- 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
- 2020Pchatbot: A Large-Scale Dataset for Personalized Chatbotcited by 26
- 2023RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Modelscited by 21
- 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 21
- 2024BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysiscited by 20
- 2023Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responsescited by 18
- 2024Human Simulacra: Benchmarking the Personification of Large Language Modelscited by 17
- 2025Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questionscited by 17
- 2020The Pushshift Telegram Datasetcited by 12
- 2024AI-native Memory: A Pathway from LLMs Towards AGIcited by 12
- 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Modelscited by 12
- 2025BookWorld: From Novels to Interactive Agent Societies for Creative Story Generationcited by 12
- 2025REST: Stress Testing Large Reasoning Models by Asking Multiple Problems at Oncecited by 12
- 2025IMPersona: Evaluating Individual Level LM Impersonationcited by 11
- 2025PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?cited by 9
- 2016Augur: Mining Human Behaviors from Fiction to Power Interactive Systemscited by 5
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memorycited by 10
- 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 8
- 2026Reinforcing Human Behavior Simulation via Verbal Feedbackcited by 4
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?cited by 2
- 2026When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skillscited by 2
- 2026Individual Turing Test: A Case Study of LLM-based Simulation Using Longitudinal Personal Datacited by 1
- 2026SensorPersona: An LLM-Empowered System for Continual Persona Extraction from Longitudinal Mobile Sensor Streamscited by 1
- 2026Argument Collapse: LLMs Flatten Long-Form Public Debatecited by 1
- 2026ZIPP:Zero-shot Image Personalization from Personascited by 0
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
- 2026Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectoriescited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interactioncited by 0
- 2026Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulation7 Oct 2026
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction29 Sep 2026
- 2026Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectories20 Aug 2026
- 2026When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skills4 Aug 2026
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure16 Jun 2026
- 2026OdysSim: Building Foundation Models for Human Behavior Simulation12 Jun 2026
- 2026ZIPP:Zero-shot Image Personalization from Personas7 Jun 2026
- 2026Argument Collapse: LLMs Flatten Long-Form Public Debate1 Jun 2026
- 2026Reinforcing Human Behavior Simulation via Verbal Feedback19 May 2026
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory14 May 2026
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?11 May 2026
- 2026SensorPersona: An LLM-Empowered System for Continual Persona Extraction from Longitudinal Mobile Sensor Streams15 Mar 2026
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memorycited by 10
- 2026Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectoriescited by 0
- 2026Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulationcited by 0
- 2026Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulation7 Oct 2026
- 2026Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectories20 Aug 2026
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory14 May 2026
- 2026ZIPP:Zero-shot Image Personalization from Personascited by 0
- 2026ZIPP:Zero-shot Image Personalization from Personas7 Jun 2026
- 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 8
- 2026Reinforcing Human Behavior Simulation via Verbal Feedbackcited by 4
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?cited by 2
- 2026When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skillscited by 2
- 2026SensorPersona: An LLM-Empowered System for Continual Persona Extraction from Longitudinal Mobile Sensor Streamscited by 1
- 2026Argument Collapse: LLMs Flatten Long-Form Public Debatecited by 1
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interactioncited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction29 Sep 2026
- 2026When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skills4 Aug 2026
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure16 Jun 2026
- 2026OdysSim: Building Foundation Models for Human Behavior Simulation12 Jun 2026
- 2026Argument Collapse: LLMs Flatten Long-Form Public Debate1 Jun 2026
- 2026Reinforcing Human Behavior Simulation via Verbal Feedback19 May 2026
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?11 May 2026
- 2026SensorPersona: An LLM-Empowered System for Continual Persona Extraction from Longitudinal Mobile Sensor Streams15 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Population-Aligned Persona Generation for LLM-based Social Simulation
- 2025A Thousand Words or An Image: Studying the Influence of Persona Modality in Multimodal LLMs
- 2026Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits
- 2026A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation
- 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
- 2025DPRF: A Generalizable Dynamic Persona Refinement Framework for Optimizing Behavior Alignment Between Personalized LLM Role-Playing Agents and Humans
- 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generation