mlsanityData to 7 Oct 2026

TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation

arXiv 2510.25536 ↗First posted 29 Oct 2025cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are exhibiting emergent human-like abilities and are increasingly envisioned as the foundation for simulating an individual's communication style, behavioral tendencies, and personality traits. However, current evaluations of LLM-based persona simulation remain limited: most rely on synthetic dialogues, lack systematic frameworks, and lack analysis of the capability requirement. To address these limitations, we introduce TwinVoice, a comprehensive benchmark for assessing persona simulation across diverse real-world contexts. TwinVoice encompasses three dimensions: Social Persona (public social interactions), Interpersonal Persona (private dialogues), and Narrative Persona (role-based expression). It further decomposes the evaluation of LLM performance into six fundamental capabilities, including opinion consistency, memory recall, logical reasoning, lexical fidelity, persona tone, and syntactic style. Experimental results reveal that while advanced models achieve moderate accuracy in persona simulation, they still fall short of capabilities such as syntactic style and memory recall. Consequently, the average performance achieved by LLMs remains considerably below the human baseline.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 32 of its 74 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

32 of 74 references.

References · 32

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  3. 2022Emergent Abilities of Large Language Modelscited by 2,483
  4. 2024A Survey on LLM-as-a-Judgecited by 1,384
  5. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  6. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  7. 2023Role-Play with Large Language Modelscited by 290
  8. 2016A Persona-Based Neural Conversation Modelcited by 221
  9. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
  10. 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
  11. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  12. 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 101
20 more
  1. 2025Large Language Models Pass the Turing Testcited by 48
  2. 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46
  3. 2023Does GPT-4 pass the Turing test?cited by 37
  4. 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
  5. 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
  6. 2020Pchatbot: A Large-Scale Dataset for Personalized Chatbotcited by 26
  7. 2023RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Modelscited by 21
  8. 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 21
  9. 2024BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysiscited by 20
  10. 2023Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responsescited by 18
  11. 2024Human Simulacra: Benchmarking the Personification of Large Language Modelscited by 17
  12. 2025Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questionscited by 17
  13. 2020The Pushshift Telegram Datasetcited by 12
  14. 2024AI-native Memory: A Pathway from LLMs Towards AGIcited by 12
  15. 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Modelscited by 12
  16. 2025BookWorld: From Novels to Interactive Agent Societies for Creative Story Generationcited by 12
  17. 2025REST: Stress Testing Large Reasoning Models by Asking Multiple Problems at Oncecited by 12
  18. 2025IMPersona: Evaluating Individual Level LM Impersonationcited by 11
  19. 2025PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?cited by 9
  20. 2016Augur: Mining Human Behaviors from Fiction to Power Interactive Systemscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Population-Aligned Persona Generation for LLM-based Social Simulation
  2. 2025A Thousand Words or An Image: Studying the Influence of Persona Modality in Multimodal LLMs
  3. 2026Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
  4. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits
  5. 2026A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation
  6. 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
  7. 2025DPRF: A Generalizable Dynamic Persona Refinement Framework for Optimizing Behavior Alignment Between Personalized LLM Role-Playing Agents and Humans
  8. 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generation