Human Simulacra: Benchmarking the Personification of Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are recognized as systems that closely mimic aspects of human intelligence. This capability has attracted attention from the social science community, who see the potential in leveraging LLMs to replace human participants in experiments, thereby reducing research costs and complexity. In this paper, we introduce a framework for large language models personification, including a strategy for constructing virtual characters' life stories from the ground up, a Multi-Agent Cognitive Mechanism capable of simulating human cognitive processes, and a psychology-guided evaluation method to assess human simulations from both self and observational perspectives. Experimental results demonstrate that our constructed simulacra can produce personified responses that align with their target characters. Our work is a preliminary exploration which offers great potential in practical applications. All the code and datasets will be released, with the hope of inspiring further investigations. Our code and dataset are available at: https://github.com/hasakiXie123/Human-Simulacra.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 11; 2026: 6.
17 papers.
Sort:
By area:
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
- 2025An Empirical Analysis of Uncertainty in Large Language Model Evaluationscited by 20
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generationcited by 7
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Tracescited by 6
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistencycited by 3
- 2025HugAgent: A Human Simulation Benchmark for Individual-Level Reasoningcited by 2
- 2026Context-Value-Action Architecture for Value-Driven Large Language Model Agentscited by 2
- 2025PHORECAST: Enabling AI Understanding of Public Health Outreach Across Populationscited by 1
5 more
- 2026Structured Personality Control and Adaptation for LLM Agentscited by 1
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarioscited by 1
- 2026LLM-SAA: LLM-persona Generated Distributions for Decision-makingcited by 1
- 2025Speaking images. A novel framework for the automated self-description of artworkscited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interactioncited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction29 Sep 2026
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces9 Apr 2026
- 2026Context-Value-Action Architecture for Value-Driven Large Language Model Agents7 Apr 2026
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency26 Mar 2026
- 2026LLM-SAA: LLM-persona Generated Distributions for Decision-making6 Feb 2026
- 2026Structured Personality Control and Adaptation for LLM Agents15 Jan 2026
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios30 Nov 2025
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation29 Oct 2025
- 2025HugAgent: A Human Simulation Benchmark for Individual-Level Reasoning16 Oct 2025
- 2025PHORECAST: Enabling AI Understanding of Public Health Outreach Across Populations2 Oct 2025
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generation8 Sep 2025
- 2025Resource Rational Contractualism Should Guide AI Alignment20 Jun 2025
5 more
- 2025Speaking images. A novel framework for the automated self-description of artworks28 May 2025
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr 2025
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar 2025
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents18 Feb 2025
- 2025An Empirical Analysis of Uncertainty in Large Language Model Evaluations15 Feb 2025
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistencycited by 3
- 2026Context-Value-Action Architecture for Value-Driven Large Language Model Agentscited by 2
- 2026Structured Personality Control and Adaptation for LLM Agentscited by 1
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarioscited by 1
- 2026Context-Value-Action Architecture for Value-Driven Large Language Model Agents7 Apr 2026
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency26 Mar 2026
- 2026Structured Personality Control and Adaptation for LLM Agents15 Jan 2026
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios30 Nov 2025
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar 2025
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents18 Feb 2025
- 2025An Empirical Analysis of Uncertainty in Large Language Model Evaluationscited by 20
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generationcited by 7
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Tracescited by 6
- 2025PHORECAST: Enabling AI Understanding of Public Health Outreach Across Populationscited by 1
- 2026LLM-SAA: LLM-persona Generated Distributions for Decision-makingcited by 1
- 2025Speaking images. A novel framework for the automated self-description of artworkscited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interactioncited by 0
- 2026AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction29 Sep 2026
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces9 Apr 2026
- 2026LLM-SAA: LLM-persona Generated Distributions for Decision-making6 Feb 2026
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation29 Oct 2025
- 2025PHORECAST: Enabling AI Understanding of Public Health Outreach Across Populations2 Oct 2025
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generation8 Sep 2025
- 2025Resource Rational Contractualism Should Guide AI Alignment20 Jun 2025
- 2025Speaking images. A novel framework for the automated self-description of artworks28 May 2025
- 2025An Empirical Analysis of Uncertainty in Large Language Model Evaluations15 Feb 2025