The Point of No Return: Counterfactual Localization of Deceptive Commitment in Language-Model Reasoning
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Existing deception datasets label completed outputs as honest or deceptive, treating deception as a property of the final response rather than a function of the model's reasoning trace. This obscures a more fundamental question: when does a language model become committed to deception? We introduce counterfactual localization: for each sentence prefix in a reasoning trace, we fix the prefix, resample continuations, and estimate the probability of a deceptive outcome. To scale this, we construct five environments (spanning strategic bluffing, maze guidance, financial advice, used-car sales, and offer negotiation) in which deception is never prompted but emerges from strategic incentives and labels follow mechanically from environment state rather than subjective human judgment. The resulting corpus localizes ~1.46M sentences across four reasoning models, drawn from over 94.1M sampled continuations, 91.5B generated tokens, and over 100K scenarios. Sentence-level human evaluation confirms that detected commitment points correspond to interpretable shifts in decision state. Using this resource, we show that lexical cues for commitment prediction transfer poorly across environments, whereas attention-based transition features generalize out of distribution, suggesting that deceptive commitment is reflected in reusable changes in reasoning dynamics rather than surface form. We further identify compact attention-head sets (under 10% of heads) that, selected on one environment, causally suppress deceptive commitment across held-out environments. We release the corpus as a substrate for studying deception, and more broadly commitment, in language-model reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 36 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
13 of 36 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Let's Verify Step by Stepcited by 3,598
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 224
- 2020Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Biascited by 183
- 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 132
- 2025Liars' Bench: Evaluating Lie Detectors for Language Modelscited by 17
- 2026Activation Steering via Generative Causal Mediationcited by 6
- 2023UNIDECOR: A Unified Deception Corpus for Cross-Corpus Deception Detectioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Think Before You Lie: How Reasoning Leads to Honesty
- 2026Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing
- 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Models
- 2025Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
- 2023Counterfactual reasoning: Testing language models' understanding of hypothetical scenarios
- 2026Sycophantic Anchors: Localizing and Quantifying User Agreement in Reasoning Models
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems
- 2025Layer of Truth: Probing Belief Shifts under Continual Pre-Training Poisoning