Distribution-First Population Simulation: Collapse, Calibration, and Recall in Non-WEIRD LLM Persona Modeling
Not on the map. Why?
Abstract (arXiv)
Synthetic-population tools increasingly run every individual as an independent large language model (LLM) agent. Using real survey microdata, we show that this paradigm has a basic failure mode, and we set a distribution-first corrective against it, all measured with a deterministic, construct-validated verifier on non-WEIRD (Turkey-first) data. First, N independent LLM agents grounded on 2,414 real World Values Survey respondents fail to reproduce the population's response distribution: they pile onto a modal default (four scenarios x five seeds: concentration 0.36->0.69, entropy 1.46->0.77, 85% collapse, TVD=0.44), and the collapse is a predictable function of scenario structure (r=0.55 with a single-answer structure). Second, Verbalized Sampling (VS) fixes the field's chronic under-dispersion without training in three model families (fidelity +7 to +10; significant on Qwen, p=0.002, d=6.2), yet the same move universally overshoots into over-dispersion (SD-ratio 0.4-0.56 -> 1.26-1.37), a structural property of VS. Third, survey fidelity transfers only weakly to agentic behavior: in a single-model, single-domain booking task, a persona is dominated by a cheapest-default (~80%) that income modulates but does not override (comfort choice 0%->7%->32% across income bands). Fourth, a placebo-controlled memorization attack and an election backtest show VS keeps aggregate strength while subgroup and individual claims are contaminated by recall and underdetermination. We close with the corrective: model the distribution once (VS) and assign it to grounded characters at O(1) cost, with a budget-aware router whose honest AUC is 0.805, not the tautological 1.0 of a code-derived oracle. The central contribution needs no realism claim: it measures the internal inconsistency of the independent-agent route and the conditions under which the distribution-first route calibrates.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
19 of 29 references.
References · 19
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2018Computational Optimal Transportcited by 765
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
- 2023Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordiacited by 119
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2024Is Temperature the Creativity Parameter of Large Language Models?cited by 92
7 more
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 49
- 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 48
- 2025The Price of Format: Diversity Collapse in LLMscited by 43
- 2026Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluationscited by 36
- 2025Mixture-of-Personas Language Models for Population Simulationcited by 20
- 2026Assessing the Reliability of Persona-Conditioned LLMs as Synthetic Survey Respondentscited by 7
- 2025Two-Faced Social Agents: Context Collapse in Role-Conditioned Large Language Modelscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Population-Aligned Persona Generation for LLM-based Social Simulation
- 2024Agentic Society: Merging skeleton from real world and texture from Large Language Model
- 2025Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulation
- 2025German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
- 2026Persona-Based Simulation of Human Opinion at Population Scale
- 2026Benchmarking Psychological Dynamics in Generative Agents
- 2026From Survey Personas to LLM Agents: A Generative Agent-based Simulation of Mobility Policy Preference Dynamics