mlsanityData to 7 Oct 2026

Distribution-First Population Simulation: Collapse, Calibration, and Recall in Non-WEIRD LLM Persona Modeling

arXiv 2607.18310 ↗First posted 17 Jul 2026physics.soc-ph cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Synthetic-population tools increasingly run every individual as an independent large language model (LLM) agent. Using real survey microdata, we show that this paradigm has a basic failure mode, and we set a distribution-first corrective against it, all measured with a deterministic, construct-validated verifier on non-WEIRD (Turkey-first) data. First, N independent LLM agents grounded on 2,414 real World Values Survey respondents fail to reproduce the population's response distribution: they pile onto a modal default (four scenarios x five seeds: concentration 0.36->0.69, entropy 1.46->0.77, 85% collapse, TVD=0.44), and the collapse is a predictable function of scenario structure (r=0.55 with a single-answer structure). Second, Verbalized Sampling (VS) fixes the field's chronic under-dispersion without training in three model families (fidelity +7 to +10; significant on Qwen, p=0.002, d=6.2), yet the same move universally overshoots into over-dispersion (SD-ratio 0.4-0.56 -> 1.26-1.37), a structural property of VS. Third, survey fidelity transfers only weakly to agentic behavior: in a single-model, single-domain booking task, a persona is dominated by a cheapest-default (~80%) that income modulates but does not override (comfort choice 0%->7%->32% across income bands). Fourth, a placebo-controlled memorization attack and an election backtest show VS keeps aggregate strength while subgroup and individual claims are contaminated by recall and underdetermination. We close with the corrective: model the distribution once (VS) and assign it to grounded characters at O(1) cost, with a budget-aware router whose honest AUC is 0.805, not the tautological 1.0 of a code-derived oracle. The central contribution needs no realism claim: it measures the internal inconsistency of the independent-agent route and the conditions under which the distribution-first route calibrates.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

19 of 29 references.

References · 19

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  3. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  4. 2018Computational Optimal Transportcited by 765
  5. 2023Whose Opinions Do Language Models Reflect?cited by 759
  6. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  7. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  8. 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
  9. 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
  10. 2023Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordiacited by 119
  11. 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
  12. 2024Is Temperature the Creativity Parameter of Large Language Models?cited by 92
7 more
  1. 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 49
  2. 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 48
  3. 2025The Price of Format: Diversity Collapse in LLMscited by 43
  4. 2026Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluationscited by 36
  5. 2025Mixture-of-Personas Language Models for Population Simulationcited by 20
  6. 2026Assessing the Reliability of Persona-Conditioned LLMs as Synthetic Survey Respondentscited by 7
  7. 2025Two-Faced Social Agents: Context Collapse in Role-Conditioned Large Language Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Population-Aligned Persona Generation for LLM-based Social Simulation
  2. 2024Agentic Society: Merging skeleton from real world and texture from Large Language Model
  3. 2025Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulation
  4. 2025German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
  5. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
  6. 2026Persona-Based Simulation of Human Opinion at Population Scale
  7. 2026Benchmarking Psychological Dynamics in Generative Agents
  8. 2026From Survey Personas to LLM Agents: A Generative Agent-based Simulation of Mobility Policy Preference Dynamics