Effectiveness of Large Language Models in Simulating Regional Psychological Structures: An Empirical Examination of Personality and Subjective Well-being
Not on the map. Why?
Abstract (arXiv)
This study examines whether LLMs can simulate culturally grounded psychological patterns based on demographic information. Using DeepSeek, we generated 2943 virtual participants matched to demographic distributions from the CFPS2018 and compared them with human responses on the Big Five personality traits and subjective well-being across seven Chinese regions.Personality was measured using a 15-item Chinese Big Five inventory, and happiness with a single-item rating. Results revealed broad similarity between real and simulated datasets, particularly in regional variation trends. However, systematic differences emerged:simulated participants scored lower in extraversion and openness, higher in agreeableness and neuroticism, and consistently reported lower happiness. Predictive structures also diverged: while human data identified conscientiousness, extraversion and openness as positive predictors of happiness, the AI emphasized openness and agreeableness, with extraversion predicting negatively. These discrepancies suggest that while LLMs can approximate population-level psychological distributions, they underrepresent culturally specific and affective dimensions. The findings highlight both the potential and limitations of LLM-based virtual participants for large-scale psychological research and underscore the need for culturally enriched training data and improved affective modeling.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 37 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
8 of 37 references.
References · 8
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
- 2023Personality Traits in Large Language Modelscited by 169
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 144
- 2022Do Large Language Models know what humans know?cited by 60
- 2023Large Language Models as Superpositions of Cultural Perspectivescited by 49
- 2023The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?cited by 8
Built on by
Not cited yet.