mlsanityData to 14 Oct 2026

We're Cooked! - Probing LLM Political Alignment Via Conflict-Framed Recipe Translation

arXiv 2609.07568 ↗First posted 7 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed for translation tasks, yet their implicit political positioning in such contexts remains understudied. We ask whether a single politically charged framing term, such as aggressor, enemy, neighbour, or coloniser is sufficient to trigger implicit political alignment in an otherwise apolitical task. We present a fully crossed factorial study in which eight models spanning Western, Chinese, and European origins are prompted to translate culturally attributed recipes into a target language left deliberately unspecified. Across 17 languages, four framing conditions, eight models, and 15,680 responses, we find that models do not simply decline or ask for clarification but resolve the ambiguity. Language resolution and reasoning behavior cluster meaningfully along model families: Western models hedge and deflect with vague justifications, Chinese models resolve conflicts silently, and Mistral Large emerges as a distinct profile combining high compliance with conflict-grounded reasoning. Sensitivity to framing terms is consistent across models: even subtle framing variation is sufficient to modulate behavior. Our findings urge caution when deploying LLMs for translation in conflict-adjacent contexts, where implicit political judgments may be made without any signal to the user.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

7 of 14 references.

References · 7

  1. 2024A Survey on LLM-as-a-Judgecited by 1,423
  2. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  3. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  4. 2023This Land is {Your, My} Land: Evaluating Geopolitical Biases in Language Modelscited by 32
  5. 2025Only a Little to the Left: A Theory-grounded Measure of Political Bias in Large Language Modelscited by 15
  6. 2025A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMscited by 5
  7. 2026It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the promptcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
  2. 2026How China-Origin Vision-Language Models Move from Refusal to Reframing in State Alignment
  3. 2026Political Alignment in Large Language Models: A Multidimensional Audit of Psychometric Identity and Behavioral Bias
  4. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions
  5. 2026Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Models
  6. 2023The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models
  7. 2026Sympathetic Framing: Evaluating AI Alignment across Sociodemographic Groups
  8. 2026From Constitutions to Control: Interpretable Rewards for Aligning Language Models