Accurate in space, unreliable in time: how LLMs represent national cultural change
Not on the map. Why?
Abstract (arXiv)
Assessments of cultural alignment have become an important part of the development and improvement of large language models (LLMs). However, the majority of the evaluations treat culture as a single snapshot, investigating only whether a model represents a society accurately at the current time. Research in cultural psychology shows that cultural values change at different rates and directions over time. Therefore, a "culturally aware" model should capture not only where a culture is today but also how it has changed over time. We examine this missing dimension of cultural awareness using more than two decades of the World Values Survey data. We compare the cultural trajectories of 40 countries with the trajectories produced by four state-of-the-art (SOTA) LLMs on the Inglehart-Welzel cultural map. Our findings show that while models generally place countries close to their most recent surveyed positions, these representations tend to lag several years behind that position. They also capture only part of the magnitude of the observed change, introduce movement where little occurred, and rarely reproduce reversals in countries' trajectories. These findings point to temporal flattening and suggest that snapshot accuracy can give an incomplete picture of cultural awareness in LLMs and have implications for model evaluation, representational harms, and the governance of culturally aware AI systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
23 of 50 references.
References · 23
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
- 2023Do LLMs exhibit human-like response biases? A case study in survey designcited by 176
- 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 172
- 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2024Investigating Cultural Alignment of Large Language Modelscited by 140
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
11 more
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 111
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
- 2024Benchmarking Distributional Alignment of Large Language Modelscited by 58
- 2024How Well Do LLMs Represent Values Across Cultures? Empirical Analysis of LLM Responses Based on Hofstede Cultural Dimensionscited by 51
- 2023History Matters: Temporal Knowledge Editing in Large Language Modelcited by 17
- 2025LLMs and Cultural Values: the Impact of Prompt Language and Explicit Cultural Framingcited by 17
- 2025On the Alignment of Large Language Models with Global Human Opinioncited by 12
- 2025A taxonomy of epistemic injustice in the context of AI and the case for generative hermeneutical erasurecited by 5
- 2025The Art of Asking: Multilingual Prompt Optimization for Synthetic Datacited by 5
- 2026A Unified Framework to Quantify Cultural Intelligence of AIcited by 2
Built on by
Not cited yet.