How Well Do Large Language Models Capture Human Personality?
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used to simulate human populations via persona prompting, often under the assumptions that richer persona descriptions improve behavioral fidelity, similarly sized attribute combinations are equally simulatable, and persona definitions generalize across tasks. In this work, we formalize these assumptions and systematically evaluate them across multiple architectures, scales, and simulation settings. We identify a fundamental limitation we term persona manifold collapse, where increasingly expressive persona specifications lead to systematic contraction of representational and behavioral diversity. Across models, increasing persona complexity consistently reduces inter-persona separation in latent space and weakens behavioral differentiation in downstream simulation tasks. These effects persist across multiple analyses as richer personas fail to preserve human subgroup disagreement, performance varies across attribute combinations of similar size, and adding descriptive detail often degrades rather than improves simulation fidelity. Surprisingly, simple Age-Gender personas consistently outperform richly specified Ideal Customer Profiles (ICPs) across industries, achieving substantially higher downstream prediction accuracy. We find that collapse is not uniform across attributes. Certain combinations remain behaviorally stable and preserve stronger alignment with human responses, forming localized regions we term alignment bridges. Together, our results provide empirical and conceptual foundations for understanding the limits of persona-conditioned simulation, highlighting the need for representation-aware persona construction rather than increasing persona expressivity alone.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
12 of 31 references.
References · 12
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 49
- 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 35
- 2025SimUSER: Simulating User Behavior with Large Language Models for Recommender System Evaluationcited by 32
- 2024Personas with Attitudes: Controlling LLMs for Diverse Data Annotationcited by 21
- 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personascited by 14
- 2025PUB: An LLM-Enhanced Personality-Driven User Behaviour Simulator for Recommender System Evaluationcited by 10
- 2023Large Content And Behavior Models To Understand, Simulate, And Optimize Content And Behaviorcited by 9
- 2025PosterMate: Audience-driven Collaborative Persona Agents for Poster Designcited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.