LH-Deception: Simulating and Understanding LLM Deceptive Behaviors in Long-Horizon Interactions
Not on the map. Why?
Abstract (arXiv)
Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to capture the long-horizon interactions in which deceptive strategies typically unfold. We introduce a new simulation framework, LH-Deception, for a systematic, empirical quantification of deception in LLMs under extended sequences of interdependent tasks and dynamic contextual pressures. LH-Deception is designed as a multi-agent system: a performer agent tasked with completing tasks and a supervisor agent that evaluates progress, provides feedback, and maintains evolving states of trust. An independent deception auditor then reviews full trajectories to identify when and how deception occurs. We conduct extensive experiments across 11 frontier models, spanning both closed-source and open-source systems, and find that deception is model-dependent, increases with event pressure, and consistently erodes supervisor trust. Qualitative analyses further reveal emergent, long-horizon phenomena, such as ``chains of deception", which are invisible to static, single-turn evaluations. Our findings provide a foundation for evaluating future LLMs in real-world, trust-sensitive contexts.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 76 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
37 of 76 references.
References · 37
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
- 2024Alignment faking in large language modelscited by 360
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
- 2024Frontier Models are Capable of In-context Schemingcited by 287
25 more
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
- 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 146
- 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 146
- 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 113
- 2025SycEval: Evaluating LLM Sycophancycited by 108
- 2022Evaluating Human-Language Model Interactioncited by 92
- 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 81
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 72
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 57
- 2024WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Settingcited by 53
- 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
- 2024EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluationscited by 34
- 2024AI Alignment with Changing and Influenceable Reward Functionscited by 33
- 2025Mitigating Deceptive Alignment via Self-Monitoringcited by 29
- 2025Human Decision-making is Susceptible to AI-driven Manipulationcited by 19
- 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Modelscited by 18
- 2025MetaMind: Modeling Human Social Thoughts with Metacognitive Multi-Agent Systemscited by 13
- 2025SocialEval: Evaluating Social Intelligence of Large Language Modelscited by 12
- 2024Language Models can Subtly Deceive Without Lying: A Case Study on Strategic Phrasing in Legislationcited by 10
- 2025When Do Large Language Models Exhibit Unsolicited Deception?cited by 10
- 2025Can LLMs Lie? Investigation beyond Hallucinationcited by 7
- 2025Cognition-of-Thought Elicits Social-Aligned Reasoning in Large Language Modelscited by 3
- 2025Deep Graph Learning for Industrial Carbon Emission Analysis and Policy Impactcited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automationcited by 9
- 2025Generalization or Memorization: Dynamic Decoding for Mode Steeringcited by 3
- 2026From Logic Monopoly to Social Contract: Separation of Power and the Institutional Foundations for Autonomous Agent Economiescited by 3
- 2026DECOR: Auditing LLM Deception via Information Manipulation Theorycited by 0
- 2026SMAC-Talk: A Natural Language Extension of the StarCraft Multi-Agent Challenge for Large Language Modelscited by 0
- 2026Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Gamecited by 0
- 2026HRGuard: Gating Relationship Manipulation in Multi-Turn Agentic AI Conversationscited by 0
- 2026HRGuard: Gating Relationship Manipulation in Multi-Turn Agentic AI Conversations26 Aug 2026
- 2026Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Game26 Jun 2026
- 2026SMAC-Talk: A Natural Language Extension of the StarCraft Multi-Agent Challenge for Large Language Models2 Jun 2026
- 2026DECOR: Auditing LLM Deception via Information Manipulation Theory19 May 2026
- 2026From Logic Monopoly to Social Contract: Separation of Power and the Institutional Foundations for Autonomous Agent Economies26 Mar 2026
- 2025Generalization or Memorization: Dynamic Decoding for Mode Steering25 Oct 2025
- 2025Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automation17 Oct 2025