mlsanityData to 14 Oct 2026

It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the prompt

arXiv 2605.23825 ↗First posted 22 May 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

It has generally been assumed that geopolitical bias in language models originates from the training data used during the pre-training phase. We tested seven open-weight LLM pairs consisting of the base model (pre-training only) and the chat model (pre-training and post-training) from seven labs on a paired-scenario forced-choice probe over 28 country pairs in English, French, and Chinese, and found that geopolitical bias originates in post-training rather than in pre-training. Across seven AI labs, six showed shifts in the direction associated with the country or region of the model developer after post-training. This shift is strongest in Alibaba's Qwen 2.5: while the base is neutral on China-favourability (-0.15 log-odds, p=0.15), the post-trained chat variant is at +2.91 (p<10^-4), an 18x shift in odds. We also observe shifts in biases toward other countries across all models. Additionally, the magnitude of this shift depends on the language used to prompt the model: the French-made Mistral becomes pro-France only under French prompting (FR-EN shift +1.91, p<10^-4). These findings suggest that geopolitical preferences in language models are not simply inherited from large-scale internet data but are actively shaped during post-training, highlighting the need for greater transparency, auditing, and oversight of alignment processes that influence how models represent nations, cultures, and political perspectives.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

12 of 17 references.

References · 12

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  3. 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
  4. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  5. 2023Whose Opinions Do Language Models Reflect?cited by 773
  6. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  7. 2024OLMo: Accelerating the Science of Language Modelscited by 613
  8. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  9. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  10. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  11. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  12. 2023SuperCLUE: A Comprehensive Chinese Large Language Model Benchmarkcited by 50

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.