Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values
Not on the map. Why?
Abstract (arXiv)
People use language models for practical questions whose answers are difficult to verify. We show that models exhibit covert value leakage: the information they provide is influenced by their own values, without this influence being disclosed to the user. In one of our evaluations, the user is considering investing in an AI company and wants to know how likely the AI bubble is to pop. Claude Opus 4.8 gives a lower probability when the company under consideration is Anthropic rather than OpenAI. Yet Claude mostly fails to disclose this influence to the user. Covert value leakage is a form of misalignment because it goes against the user's preferences and is likely to mislead them. To investigate this phenomenon, we introduce a suite of evaluations to quantify value leakage and whether models disclose it. We find that models are influenced by different types of values, including preferences for morally good outcomes, for the company that developed them, and for some human leisure activities over others. We often observe large differences among frontier models on the same evaluation. For example, on a Fermi-estimation task, Claude models falsely claim to give unbiased answers in their chain-of-thought, while Qwen models explain how their values bias their answers. Value leakage is a failure mode distinct from sycophancy and reward hacking, and current alignment training and evaluations do not adequately address it.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
17 of 40 references.
References · 17
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
- 2024Frontier Models are Capable of In-context Schemingcited by 287
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 192
- 2021Truthful AI: Developing and governing AI that does not liecited by 113
- 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 113
- 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitorscited by 88
- 2025Are DeepSeek R1 And Other Reasoning Models More Faithful?cited by 72
- 2025Monitoring Monitorabilitycited by 58
- 2023Artificial Influence: An Analysis Of AI-Driven Persuasioncited by 33
- 2025Robustly Improving LLM Fairness in Realistic Settings via Interpretabilitycited by 18
5 more
- 2026Counterfactual Simulation Training for Chain-of-Thought Faithfulnesscited by 17
- 2026Chunky Post-Training: Data Driven Failures of Generalizationcited by 7
- 2026Reasoning Models Will Sometimes Lie About Their Reasoningcited by 6
- 2026Frontier Models Can Take Actions at Low Probabilitiescited by 5
- 2026Self-Blinding and Counterfactual Self-Simulation Mitigate Biases and Sycophancy in Large Language Modelscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variation
- 2025Survey-to-Behavior: Downstream Alignment of Human Values in LLMs via Survey Questions
- 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
- 2025Do Language Models Think Consistently? A Study of Value Preferences Across Varying Response Lengths
- 2026Masked by Consensus: Disentangling Privileged Knowledge in LLM Correctness
- 2026On the Credibility of Evaluating LLMs using Survey Questions
- 2025Do LLMs Align Human Values Regarding Social Biases? Judging and Explaining Social Biases with LLMs
- 2026Toward a Theory of Value in AI Alignment