Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used as synthetic survey respondents to estimate population response distributions. In cross-cultural survey simulation, evaluations should assess not only distributional fidelity within countries but also whether differences across countries are preserved. However, existing distance-based metrics such as Jensen--Shannon divergence (JSD) do not directly capture such cross-country differences. To address this limitation, we introduce Cultural Divergence Preservation (CDP), a reference-light diagnostic based on a one-time human calibration. CDP identifies reduced cross-country divergence as cultural flattening and increased divergence as cultural caricature. To evaluate CDP, we conduct experiments across four LLM backbones, three persona-based prompting methods, and two survey domains, the World Values Survey (WVS) and the Big Five Personality Test. The results reveal a systematic discrepancy between conventional fidelity metrics and CDP. Controlled experiments show that CDP changes monotonically as cross-country divergence is attenuated or amplified, while the corresponding changes in JSD remain relatively small. In our audit of real LLM generations, DeepPersona-Inspired prompting is frequently favored by conventional fidelity metrics but exhibits the strongest flattening in every model--domain block. CDP thus complements fidelity metrics by directly quantifying the attenuation or amplification of cross-country divergence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
24 of 33 references.
References · 24
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
- 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
- 2024Quantifying the Persona Effect in LLM Simulationscited by 164
- 2024Investigating Cultural Alignment of Large Language Modelscited by 140
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 111
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 50
12 more
- 2023Sociodemographic Prompting is Not Yet an Effective Approach for Simulating Subjective Judgments with LLMscited by 36
- 2026This human study did not involve human subjects: Validating LLM simulations as behavioral evidencecited by 26
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
- 2024Algorithmic Fidelity of Large Language Models in Generating Synthetic German Public Opinions: A Case Studycited by 14
- 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personascited by 14
- 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparencycited by 14
- 2024A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLIcited by 8
- 2026Assessing the Reliability of Persona-Conditioned LLMs as Synthetic Survey Respondentscited by 7
- 2025Polypersona: Persona-Grounded LLM for Synthetic Survey Responsescited by 3
- 2026Beyond the Mean: Three-Axis Fidelity for Aligning LLM-Based Survey Simulators from Small Pilot Datacited by 3
- 2025The American Ghost in the Machine: How language models align culturally and the effects of cultural promptingcited by 1
- 2026PLURAL: A Global Dataset for Value Alignmentcited by 1
Built on by
Not cited yet.