Cultural Misalignment in Large Language Models: Detection, Measurement, and Mitigation Through Targeted Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
We evaluate three open-weight LLMs (Gemma3-12B from the USA, Bielik-11B-v3 from Poland, and Qwen3-4B from China) against World Values Survey Wave 7 data for 63 demographic personas across three countries, using normalized Wasserstein distance to quantify distributional misalignment. Contrary to expectations, no model favors its home country: the Chinese-built Qwen3-4B performs worst on its own Chinese population (W1 = 0.436, the highest misalignment in the entire model x country matrix). Targeted LoRA fine-tuning on the five worst-case personas, requiring fewer than 1,200 training pairs and under 15 minutes on a single GPU, reduces bias by 16.8% for Bielik-11B (p_Bonf = 0.002, d = -4.4) with all five targets improving. However, country-level decomposition reveals that fine-tuning redistributes rather than removes bias: Bielik's worst-case personas swap entirely from American to Chinese elderly, with zero overlap between pre- and post-correction sets. To our knowledge, this is the first study to target worst-case demographic personas with LoRA fine-tuning for cross-cultural bias mitigation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
23 of 38 references.
References · 23
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
- 2019Measurement and Fairnesscited by 299
- 2024Quantifying the Persona Effect in LLM Simulationscited by 164
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
- 2023Aligning Language Models to User Opinionscited by 98
- 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 59
- 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
- 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 49
11 more
- 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 48
- 2023AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion Predictioncited by 46
- 2023Personas as a Way to Model Truthfulness in Language Modelscited by 46
- 2023OpinionGPT: Modelling Explicit Biases in Instruction-Tuned LLMscited by 29
- 2022Evaluating Psychological Safety of Large Language Modelscited by 26
- 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
- 2023Demonstrations of the Potential of AI-based Political Issue Pollingcited by 14
- 2025On the Alignment of Large Language Models with Global Human Opinioncited by 12
- 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 9
- 2024Revealing Fine-Grained Values and Opinions in Large Language Modelscited by 5
- 2025Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theorycited by 3
Built on by
Not cited yet.