mlsanityData to 14 Oct 2026

LH-Deception: Simulating and Understanding LLM Deceptive Behaviors in Long-Horizon Interactions

arXiv 2510.03999 ↗First posted 5 Oct 2025cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to capture the long-horizon interactions in which deceptive strategies typically unfold. We introduce a new simulation framework, LH-Deception, for a systematic, empirical quantification of deception in LLMs under extended sequences of interdependent tasks and dynamic contextual pressures. LH-Deception is designed as a multi-agent system: a performer agent tasked with completing tasks and a supervisor agent that evaluates progress, provides feedback, and maintains evolving states of trust. An independent deception auditor then reviews full trajectories to identify when and how deception occurs. We conduct extensive experiments across 11 frontier models, spanning both closed-source and open-source systems, and find that deception is model-dependent, increases with event pressure, and consistently erodes supervisor trust. Qualitative analyses further reveal emergent, long-horizon phenomena, such as ``chains of deception", which are invisible to static, single-turn evaluations. Our findings provide a foundation for evaluating future LLMs in real-world, trust-sensitive contexts.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 76 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

37 of 76 references.

References · 37

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  4. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  5. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  6. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  7. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  8. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
  9. 2024Alignment faking in large language modelscited by 360
  10. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  11. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
  12. 2024Frontier Models are Capable of In-context Schemingcited by 287
25 more
  1. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  2. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  3. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
  4. 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 146
  5. 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 146
  6. 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 113
  7. 2025SycEval: Evaluating LLM Sycophancycited by 108
  8. 2022Evaluating Human-Language Model Interactioncited by 92
  9. 2024MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Modelscited by 81
  10. 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 72
  11. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 57
  12. 2024WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Settingcited by 53
  13. 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
  14. 2024EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluationscited by 34
  15. 2024AI Alignment with Changing and Influenceable Reward Functionscited by 33
  16. 2025Mitigating Deceptive Alignment via Self-Monitoringcited by 29
  17. 2025Human Decision-making is Susceptible to AI-driven Manipulationcited by 19
  18. 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Modelscited by 18
  19. 2025MetaMind: Modeling Human Social Thoughts with Metacognitive Multi-Agent Systemscited by 13
  20. 2025SocialEval: Evaluating Social Intelligence of Large Language Modelscited by 12
  21. 2024Language Models can Subtly Deceive Without Lying: A Case Study on Strategic Phrasing in Legislationcited by 10
  22. 2025When Do Large Language Models Exhibit Unsolicited Deception?cited by 10
  23. 2025Can LLMs Lie? Investigation beyond Hallucinationcited by 7
  24. 2025Cognition-of-Thought Elicits Social-Aligned Reasoning in Large Language Modelscited by 3
  25. 2025Deep Graph Learning for Industrial Carbon Emission Analysis and Policy Impactcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.