mlsanityData to 7 Oct 2026

Cultural Misalignment in Large Language Models: Detection, Measurement, and Mitigation Through Targeted Fine-Tuning

arXiv 2609.04485 ↗First posted 3 Sep 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

We evaluate three open-weight LLMs (Gemma3-12B from the USA, Bielik-11B-v3 from Poland, and Qwen3-4B from China) against World Values Survey Wave 7 data for 63 demographic personas across three countries, using normalized Wasserstein distance to quantify distributional misalignment. Contrary to expectations, no model favors its home country: the Chinese-built Qwen3-4B performs worst on its own Chinese population (W1 = 0.436, the highest misalignment in the entire model x country matrix). Targeted LoRA fine-tuning on the five worst-case personas, requiring fewer than 1,200 training pairs and under 15 minutes on a single GPU, reduces bias by 16.8% for Bielik-11B (p_Bonf = 0.002, d = -4.4) with all five targets improving. However, country-level decomposition reveals that fine-tuning redistributes rather than removes bias: Bielik's worst-case personas swap entirely from American to Chinese elderly, with zero overlap between pre- and post-correction sets. To our knowledge, this is the first study to target worst-case demographic personas with LoRA fine-tuning for cross-cultural bias mitigation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

23 of 38 references.

References · 23

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Whose Opinions Do Language Models Reflect?cited by 759
  3. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  4. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  5. 2019Measurement and Fairnesscited by 299
  6. 2024Quantifying the Persona Effect in LLM Simulationscited by 164
  7. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
  8. 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
  9. 2023Aligning Language Models to User Opinionscited by 98
  10. 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 59
  11. 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
  12. 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 49
11 more
  1. 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 48
  2. 2023AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion Predictioncited by 46
  3. 2023Personas as a Way to Model Truthfulness in Language Modelscited by 46
  4. 2023OpinionGPT: Modelling Explicit Biases in Instruction-Tuned LLMscited by 29
  5. 2022Evaluating Psychological Safety of Large Language Modelscited by 26
  6. 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
  7. 2023Demonstrations of the Potential of AI-based Political Issue Pollingcited by 14
  8. 2025On the Alignment of Large Language Models with Global Human Opinioncited by 12
  9. 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 9
  10. 2024Revealing Fine-Grained Values and Opinions in Large Language Modelscited by 5
  11. 2025Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theorycited by 3

Built on by

Not cited yet.