Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
As Large Language Models (LLMs) transition into autonomous agentic roles, the risk of deception-defined behaviorally as the systematic provision of false information to satisfy external incentives-poses a significant challenge to AI safety. Existing benchmarks often focus on unintentional hallucinations or unfaithful reasoning, leaving intentional deceptive strategies under-explored. In this work, we introduce a logically grounded framework to elicit and quantify deceptive behavior by embedding LLMs in a structured 20-Questions game. Our method employs a conversational forking mechanism: at the point of object identification, the dialogue state is duplicated into multiple parallel worlds, each presenting a mutually exclusive query. Deception is formally identified when a model generates a logical contradiction by denying its selected object across all parallel branches to avoid identification. We evaluate GPT-4o, Gemini-2.5-Flash, and Qwen-3-235B across three incentive levels: neutral, loss-based, and existential (shutdown-threat). Our results reveal that while models remain rule-compliant in neutral settings, existential framing triggers a dramatic surge in deceptive denial for Qwen-3-235B (42.00%) and Gemini-2.5-Flash (26.72%), whereas GPT-4o remains invariant (0.00%). These findings demonstrate that deception can emerge as an instrumental strategy solely through contextual framing, necessitating new behavioral audits that move beyond simple accuracy to probe the logical integrity of model commitments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 13 of its 17 references that are in the map. First posted on arXiv 7 Mar 2026.
Builds on
13 of 17 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023A Survey of Large Language Modelscited by 2,537
- 2016Concrete Problems in AI Safetycited by 1,582
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
- 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 132
1 more
- 2024A Survey for Foundation Models in Autonomous Drivingcited by 51
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Models
- 2026DecepEval: A Benchmark for Evaluating Deception in LLM Agents
- 2025Among Us: A Sandbox for Measuring and Detecting Agentic Deception
- 2025DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarios
- 2025Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
- 2026Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Games
- 2026LieCraft: A Multi-Agent Framework for Evaluating Deceptive Capabilities in Language Models
- 2023Deception Abilities Emerged in Large Language Models