mlsanityData to 7 Oct 2026

Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations

arXiv 2609.29928 ↗First posted 24 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used as synthetic survey respondents to estimate population response distributions. In cross-cultural survey simulation, evaluations should assess not only distributional fidelity within countries but also whether differences across countries are preserved. However, existing distance-based metrics such as Jensen--Shannon divergence (JSD) do not directly capture such cross-country differences. To address this limitation, we introduce Cultural Divergence Preservation (CDP), a reference-light diagnostic based on a one-time human calibration. CDP identifies reduced cross-country divergence as cultural flattening and increased divergence as cultural caricature. To evaluate CDP, we conduct experiments across four LLM backbones, three persona-based prompting methods, and two survey domains, the World Values Survey (WVS) and the Big Five Personality Test. The results reveal a systematic discrepancy between conventional fidelity metrics and CDP. Controlled experiments show that CDP changes monotonically as cross-country divergence is attenuated or amplified, while the corresponding changes in JSD remain relatively small. In our audit of real LLM generations, DeepPersona-Inspired prompting is frequently favored by conventional fidelity metrics but exhibits the strongest flattening in every model--domain block. CDP thus complements fidelity metrics by directly quantifying the attenuation or amplification of cross-country divergence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

24 of 33 references.

References · 24

  1. 2023Whose Opinions Do Language Models Reflect?cited by 759
  2. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  3. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  4. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  5. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
  6. 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
  7. 2024Quantifying the Persona Effect in LLM Simulationscited by 164
  8. 2024Investigating Cultural Alignment of Large Language Modelscited by 140
  9. 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
  10. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 111
  11. 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
  12. 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 50
12 more
  1. 2023Sociodemographic Prompting is Not Yet an Effective Approach for Simulating Subjective Judgments with LLMscited by 36
  2. 2026This human study did not involve human subjects: Validating LLM simulations as behavioral evidencecited by 26
  3. 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
  4. 2024Algorithmic Fidelity of Large Language Models in Generating Synthetic German Public Opinions: A Case Studycited by 14
  5. 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personascited by 14
  6. 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparencycited by 14
  7. 2024A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLIcited by 8
  8. 2026Assessing the Reliability of Persona-Conditioned LLMs as Synthetic Survey Respondentscited by 7
  9. 2025Polypersona: Persona-Grounded LLM for Synthetic Survey Responsescited by 3
  10. 2026Beyond the Mean: Three-Axis Fidelity for Aligning LLM-Based Survey Simulators from Small Pilot Datacited by 3
  11. 2025The American Ghost in the Machine: How language models align culturally and the effects of cultural promptingcited by 1
  12. 2026PLURAL: A Global Dataset for Value Alignmentcited by 1

Built on by

Not cited yet.