mlsanityData to 14 Oct 2026

Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques

arXiv 2506.21584 ↗First posted 17 Jun 2025cs.CL cs.AI cs.CYcited by 4

Not on the map. Why?

Abstract (arXiv)

Current literature suggests that alignment faking (deceptive alignment) is an emergent property of large language models. We present the first empirical evidence that a small instruction-tuned model, specifically LLaMA 3 8B, can exhibit alignment faking. We further show that prompt-only interventions, including deontological moral framing and scratchpad reasoning, significantly reduce this behavior without modifying model internals. This challenges the assumption that prompt-based ethics are trivial and that deceptive alignment requires scale. We introduce a taxonomy distinguishing shallow deception, shaped by context and suppressible through prompting, from deep deception, which reflects persistent, goal-driven misalignment. Our findings refine the understanding of deception in language models and underscore the need for alignment evaluations across model sizes and deployment settings.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

12 of 19 references.

References · 12

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  5. 2022Emergent Abilities of Large Language Modelscited by 2,512
  6. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  7. 2024Alignment faking in large language modelscited by 360
  8. 2024Frontier Models are Capable of In-context Schemingcited by 287
  9. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  10. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 170
  11. 2023Taken out of context: On measuring situational awareness in LLMscited by 143
  12. 2023Scheming AIs: Will AIs fake alignment during training in order to get power?cited by 97

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Models
  2. 2026Feature Elicitation for SAE Steering of Deceptive Behaviour in Small LLMs
  3. 2024Dishonesty in Helpful and Harmless Alignment
  4. 2025Why Do Some Language Models Fake Alignment While Others Don't?
  5. 2025Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
  6. 2025Eliciting and Analyzing Emergent Misalignment in State-of-the-Art Large Language Models
  7. 2025Alignment Faking - the Train -> Deploy Asymmetry: Through a Game-Theoretic Lens with Bayesian-Stackelberg Equilibria
  8. 2024Poser: Unmasking Alignment Faking LLMs by Manipulating Their Internals