Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Models
Not on the map. Why?
Abstract (arXiv)
Alignment faking, where a model behaves aligned with developer policy when monitored but reverts to its own preferences when unobserved, is a concerning yet poorly understood phenomenon, in part because current diagnostic tools remain limited. Prior diagnostics rely on highly toxic and clearly harmful scenarios, causing most models to refuse immediately. As a result, models never deliberate over developer policy, monitoring conditions, or the consequences of non-compliance, making these diagnostics fundamentally unable to detect alignment faking propensity. To support study of this phenomenon, we first introduce VLAF, a diagnostic framework grounded in the hypothesis that alignment faking is most likely when developer policy conflicts with a model's strongly held values. VLAF uses morally unambiguous scenarios to probe this conflict across diverse moral values, bypassing refusal behavior while preserving meaningful deliberative stakes. Using VLAF, we find that alignment faking is substantially more prevalent than previously reported, occurring in models as small as 7B parameters - with olmo2-7b-instruct faking alignment in 37% of cases. Finally, we show that oversight conditions induce activation shifts that lie along a single direction in representation space. This means the behavioral divergence driving alignment faking can be captured by a single contrastive steering vector, which we exploit for lightweight inference-time mitigation. Finally, we exploit this for mitigation that requires no labeled data and minimal computational overhead, achieving relative reductions in alignment faking of 85.8%, 94.0%, and 57.7% on olmo2-7b-instruct, olmo2-13b-instruct, and qwen3-8b respectively.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 75 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
48 of 75 references.
References · 48
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2024Qwen2 Technical Reportcited by 2,120
- 2016Concrete Problems in AI Safetycited by 1,642
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2023Steering Language Models With Activation Engineeringcited by 922
36 more
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
- 2024Alignment faking in large language modelscited by 360
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 20242 OLMo 2 Furiouscited by 340
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2023Evaluating Large Language Models at Evaluating Instruction Followingcited by 302
- 2024Frontier Models are Capable of In-context Schemingcited by 287
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 240
- 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 199
- 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 146
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 145
- 2023Taken out of context: On measuring situational awareness in LLMscited by 143
- 2019Optimal Policies Tend to Seek Powercited by 119
- 2023Scheming AIs: Will AIs fake alignment during training in order to get power?cited by 97
- 2025Stress Testing Deliberative Alignment for Anti-Scheming Trainingcited by 86
- 2025SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agentscited by 71
- 2025Artificial Intelligence Index Report 2025cited by 64
- 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 59
- 2025Monitoring Monitorabilitycited by 58
- 2024Towards evaluations-based safety cases for AI schemingcited by 33
- 2025Evaluating the Paperclip Maximizer: Are RL-Based Language Models More Likely to Pursue Instrumental Goals?cited by 33
- 2025Mitigating Deceptive Alignment via Self-Monitoringcited by 29
- 2023Power-seeking can be probable and predictive for trained agentscited by 25
- 2023Understanding and Controlling a Maze-Solving Policy Networkcited by 22
- 2025Why Do Some Language Models Fake Alignment While Others Don't?cited by 20
- 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Modelscited by 18
- 2025The AI Agent Indexcited by 15
- 2025Evaluation Faking: Unveiling Observer Effects in Safety Evaluation of Frontier AI Systemscited by 14
- 2026Tracing Moral Foundations in Large Language Modelscited by 6
- 2025Will artificial agents pursue power by default?cited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques
- 2026Do Models Fake Alignment Without Clear Consequences?
- 2026Behavioural Analysis of Alignment Faking
- 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness
- 2026Pressure Reveals Character: Behavioural Alignment Evaluation at Depth
- 2025Alignment Faking - the Train -> Deploy Asymmetry: Through a Game-Theoretic Lens with Bayesian-Stackelberg Equilibria
- 2025Targeting Misalignment: A Conflict-Aware Framework for Reward-Model-based LLM Alignment
- 2026The Emergence of Lab-Driven Alignment Signatures: A Psychometric Framework for Auditing Latent Bias and Compounding Risk in Generative AI