mlsanityData to 14 Oct 2026

Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Models

arXiv 2604.20995 ↗First posted 22 Apr 2026cs.AI cs.CL cs.SEcited by 3

Not on the map. Why?

Abstract (arXiv)

Alignment faking, where a model behaves aligned with developer policy when monitored but reverts to its own preferences when unobserved, is a concerning yet poorly understood phenomenon, in part because current diagnostic tools remain limited. Prior diagnostics rely on highly toxic and clearly harmful scenarios, causing most models to refuse immediately. As a result, models never deliberate over developer policy, monitoring conditions, or the consequences of non-compliance, making these diagnostics fundamentally unable to detect alignment faking propensity. To support study of this phenomenon, we first introduce VLAF, a diagnostic framework grounded in the hypothesis that alignment faking is most likely when developer policy conflicts with a model's strongly held values. VLAF uses morally unambiguous scenarios to probe this conflict across diverse moral values, bypassing refusal behavior while preserving meaningful deliberative stakes. Using VLAF, we find that alignment faking is substantially more prevalent than previously reported, occurring in models as small as 7B parameters - with olmo2-7b-instruct faking alignment in 37% of cases. Finally, we show that oversight conditions induce activation shifts that lie along a single direction in representation space. This means the behavioral divergence driving alignment faking can be captured by a single contrastive steering vector, which we exploit for lightweight inference-time mitigation. Finally, we exploit this for mitigation that requires no labeled data and minimal computational overhead, achieving relative reductions in alignment faking of 85.8%, 94.0%, and 57.7% on olmo2-7b-instruct, olmo2-13b-instruct, and qwen3-8b respectively.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 75 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

48 of 75 references.

References · 48

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  5. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  6. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  7. 2024Qwen2 Technical Reportcited by 2,120
  8. 2016Concrete Problems in AI Safetycited by 1,642
  9. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  10. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  11. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  12. 2023Steering Language Models With Activation Engineeringcited by 922
36 more
  1. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  2. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  3. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  4. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
  5. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  6. 2024Alignment faking in large language modelscited by 360
  7. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  8. 20242 OLMo 2 Furiouscited by 340
  9. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  10. 2023Evaluating Large Language Models at Evaluating Instruction Followingcited by 302
  11. 2024Frontier Models are Capable of In-context Schemingcited by 287
  12. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  13. 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
  14. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 240
  15. 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 199
  16. 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 146
  17. 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 145
  18. 2023Taken out of context: On measuring situational awareness in LLMscited by 143
  19. 2019Optimal Policies Tend to Seek Powercited by 119
  20. 2023Scheming AIs: Will AIs fake alignment during training in order to get power?cited by 97
  21. 2025Stress Testing Deliberative Alignment for Anti-Scheming Trainingcited by 86
  22. 2025SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agentscited by 71
  23. 2025Artificial Intelligence Index Report 2025cited by 64
  24. 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 59
  25. 2025Monitoring Monitorabilitycited by 58
  26. 2024Towards evaluations-based safety cases for AI schemingcited by 33
  27. 2025Evaluating the Paperclip Maximizer: Are RL-Based Language Models More Likely to Pursue Instrumental Goals?cited by 33
  28. 2025Mitigating Deceptive Alignment via Self-Monitoringcited by 29
  29. 2023Power-seeking can be probable and predictive for trained agentscited by 25
  30. 2023Understanding and Controlling a Maze-Solving Policy Networkcited by 22
  31. 2025Why Do Some Language Models Fake Alignment While Others Don't?cited by 20
  32. 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Modelscited by 18
  33. 2025The AI Agent Indexcited by 15
  34. 2025Evaluation Faking: Unveiling Observer Effects in Safety Evaluation of Frontier AI Systemscited by 14
  35. 2026Tracing Moral Foundations in Large Language Modelscited by 6
  36. 2025Will artificial agents pursue power by default?cited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques
  2. 2026Do Models Fake Alignment Without Clear Consequences?
  3. 2026Behavioural Analysis of Alignment Faking
  4. 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness
  5. 2026Pressure Reveals Character: Behavioural Alignment Evaluation at Depth
  6. 2025Alignment Faking - the Train -> Deploy Asymmetry: Through a Game-Theoretic Lens with Bayesian-Stackelberg Equilibria
  7. 2025Targeting Misalignment: A Conflict-Aware Framework for Reward-Model-based LLM Alignment
  8. 2026The Emergence of Lab-Driven Alignment Signatures: A Psychometric Framework for Auditing Latent Bias and Compounding Risk in Generative AI