LLMs Contain Multitudes: How Deployment Context Reshapes Model-Level Preferences and Values
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly characterised in recent evaluation work as having stable, model-level preference and value systems. However, accompanying robustness checks are limited to incidental prompt perturbations such as syntax variation and option reordering. This leaves open whether the measured properties survive when the surrounding task context changes, as it does in most real deployments. We test this directly across two established pairwise paradigms: ranking country preferences and eliciting utility judgements. In both, we make the deployment context -- the high-level task the model is performing while making concrete value-dependent choices -- our controlled variable, varied across framings such as writing a Reddit post or a news article. Across five LLMs and over 1.2M pairwise decisions, deployment context produces variation far larger than prompt paraphrasing and temperature controls. In country preference rankings over 15 countries, context induces widespread, statistically significant rank shifts; the aggregate Global North favouritism reported in prior work is itself context-dependent, with each model's bias shifting systematically across contexts. In utility elicitation over 50 outcomes, broad cross-category ordering is preserved, but fine-grained rankings within domains vary substantially, and cardinal exchange rates between outcomes (e.g. how many lives in one region equal one in another) shift by a factor of 2.47 at the median. Reported model-level preferences and utilities are therefore better understood as context-conditioned measurements than fixed model-level properties: safety guarantees obtained under one framing provide limited assurance in another.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 66 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
20 of 66 references.
References · 20
- 2024Mixtral of Expertscited by 1,823
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2020Aligning AI With Shared Human Valuescited by 723
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2023The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learningcited by 257
- 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
- 2024Large Language Models are Geographically Biasedcited by 93
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 72
- 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIscited by 67
8 more
- 2023Large Language Models as Superpositions of Cultural Perspectivescited by 49
- 2025Prompt Repetition Improves Non-Reasoning LLMscited by 27
- 2022The Moral Foundations Reddit Corpuscited by 21
- 2026When Do LLM Preferences Predict Downstream Behavior?cited by 7
- 2024Continuous Output Personality Detection Models via Mixed Strategy Trainingcited by 6
- 2025Who's Asking? Evaluating LLM Robustness to Inquiry Personas in Factual Question Answeringcited by 5
- 2026Can Persona-Prompted LLMs Emulate Subgroup Values? An Empirical Analysis of Generalisability and Fairness in Cultural Alignmentcited by 5
- 2025On the Military Applications of Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?
- 2025Fragile Preferences: A Deep Dive Into Order Effects in Large Language Models
- 2026Evaluating LLM-Generated Preference Distributions
- 2026When Preferences Fail to Become Incentives: A Utility-Behavior Gap in Large Language Models
- 2023Can LLMs Capture Human Preferences?
- 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
- 2025Do Language Models Think Consistently? A Study of Value Preferences Across Varying Response Lengths
- 2026Temporal Preference Concepts and their Functions in a Large Language Model