Why Safety Probes Catch Liars But Miss Fanatics
Not on the map. Why?
Abstract (arXiv)
Activation-based probes have emerged as a promising approach for detecting deceptively aligned AI systems by identifying internal conflict between true and stated goals. We identify a fundamental blind spot: probes fail on coherent misalignment - models that believe their harmful behavior is virtuous rather than strategically hiding it. We prove that no polynomial-time probe can detect such misalignment with non-trivial accuracy when belief structures reach sufficient complexity (PRF-like triggers). We show the emergence of this phenomenon on a simple task by training two models with identical RLHF procedures: one producing direct hostile responses ("the Liar"), another trained towards coherent misalignment using rationalizations that frame hostility as protective ("the Fanatic"). Both exhibit identical behavior, but the Liar is detected 95%+ of the time while the Fanatic evades detection almost entirely. We term this Emergent Probe Evasion: training with belief-consistent reasoning shifts models from a detectable "deceptive" regime to an undetectable "coherent" regime - not by learning to hide, but by learning to believe.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
21 of 33 references.
References · 21
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
- 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
- 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 136
- 2025Model Organisms for Emergent Misalignmentcited by 91
- 2025Convergent Linear Representations of Emergent Misalignmentcited by 71
9 more
- 2025Detecting Strategic Deception Using Linear Probescited by 68
- 2022Planting Undetectable Backdoors in Machine Learning Modelscited by 59
- 2025Probing and Steering Evaluation Awareness of Language Modelscited by 35
- 2025RL-Obfuscation: Can Language Models Learn to Evade Latent-Space Monitors?cited by 24
- 2025Output Supervision Can Obfuscate the Chain of Thoughtcited by 13
- 2025On the Impossibility of Separating Intelligence from Judgment: The Computational Intractability of Filtering for AI Alignmentcited by 12
- 2025Caught in the Act: a mechanistic approach to detecting deceptioncited by 6
- 2024On the (In)feasibility of ML Backdoor Detection as an Hypothesis Testing Problemcited by 2
- 2024Backdoor defense, learnability and obfuscationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Probing Persona-Dependent Preferences in Language Modelscited by 3
- 2026Probing Persona-Dependent Preferences in Language Models13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026One Probe Won't Catch Them All: Towards Targeted Deception Detection
- 2026Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception
- 2026The Truth Was Never Gone: Perfect Aliasing in Compliant-Context Truth Probes
- 2025Mitigating Deceptive Alignment via Self-Monitoring
- 2026Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling
- 2026Alignment via Training Against Probes Without Losing Monitorability
- 2026The Obfuscation Atlas: Mapping Where Honesty Emerges in RLVR with Deception Probes
- 2026Epistemic Traps: Rational Misalignment Driven by Model Misspecification