mlsanityData to 14 Oct 2026

When Can Digital Personas Reliably Approximate Human Survey Findings?

arXiv 2605.10659 ↗First posted 11 May 2026cs.CL cs.AI cs.SIcited by 4

Not on the map. Why?

Abstract (arXiv)

Digital personas powered by Large Language Models (LLMs) are increasingly proposed as substitutes for human survey respondents, yet it remains unclear when they can reliably approximate human survey findings. We answer this question using the LISS panel, constructing personas from respondents' background variables and pre-2023 survey histories, then testing them against the same respondents' held-out post-cutoff answers. Across four persona architectures, three LLMs, and two prediction tasks, we assess performance at the question, respondent, distributional, equity, and clustering levels. Digital personas improve alignment with human response distributions, especially in domains tied to stable attributes and values, but remain limited for individual prediction and fail to recover multivariate respondent structure. Retrieval-augmented architectures provide the clearest gains, but performance depends more on human response structure than on model choice: personas perform best for low-variability questions and common respondent patterns, and worst for subjective, heterogeneous, or rare responses. Our results provide practical guidance on when digital personas could be appropriate for survey research and when human validation remains necessary.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 24 of its 49 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

24 of 49 references.

References · 24

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  3. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
  4. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
  5. 2024Quantifying the Persona Effect in LLM Simulationscited by 169
  6. 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 144
  7. 2023Aligning Language Models to User Opinionscited by 99
  8. 2025LLM Generated Persona is a Promise with a Catchcited by 81
  9. 2023Questioning the Survey Responses of Large Language Modelscited by 74
  10. 2025Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinionscited by 66
  11. 2023Group Preference Optimization: Few-Shot Alignment of Large Language Modelscited by 63
  12. 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 53
12 more
  1. 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 52
  2. 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 51
  3. 2023AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion Predictioncited by 48
  4. 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 39
  5. 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 39
  6. 2026This human study did not involve human subjects: Validating LLM simulations as behavioral evidencecited by 29
  7. 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 22
  8. 2025Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questionscited by 22
  9. 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 15
  10. 2026Assessing the Reliability of Persona-Conditioned LLMs as Synthetic Survey Respondentscited by 10
  11. 2025PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twinscited by 5
  12. 2025German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studiescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Persona Attributes Improve Population Alignment in Large Language Models
  2. 2025Polypersona: Persona-Grounded LLM for Synthetic Survey Responses
  3. 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment
  4. 2026Persona-Based Simulation of Human Opinion at Population Scale
  5. 2026Beyond Marginal Distributions: A Framework to Evaluate the Representativeness of Demographic-Aligned LLMs
  6. 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparency
  7. 2026Distribution-First Population Simulation: Collapse, Calibration, and Recall in Non-WEIRD LLM Persona Modeling
  8. 2026Stochastic Parrots or Singing in Harmony? Testing Five Leading LLMs for their Ability to Replicate a Human Survey with Synthetic Data