OpenDeception: Learning Deception and Trust in Human-AI Interaction via Multi-Agent Simulation
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely scenario-specific and model-centric. We introduce OpenDeception, a lightweight framework for jointly evaluating deception risk from both sides of human-AI dialogue. It consists of a scenario benchmark with 50 real-world deception cases, an IntentNet that infers deceptive intent from agent reasoning, and a TrustNet that estimates user susceptibility. To address data scarcity, we synthesize high-risk dialogues via LLM-based role-and-goal simulation, and train the User Trust Scorer using contrastive learning on controlled response pairs, avoiding unreliable scalar labels. Experiments on 11 LLMs and three large reasoning models show that over 90% of goal-driven interactions in most models exhibit deceptive intent, with stronger models displaying higher risk. A real-world case study adapted from a documented AI-induced suicide incident further demonstrates that our joint evaluation can proactively trigger warnings before critical trust thresholds are reached.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 21 of its 36 references that are in the map. First posted on arXiv 18 Apr 2025.
Builds on
21 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals15 Nov
- 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars28 Nov
Other references · 19
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2 Technical Reportcited by 2,120
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2024Alignment faking in large language modelscited by 360
- 2024Frontier Models are Capable of In-context Schemingcited by 287
- 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 209
7 more
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 145
- 2024Evaluating Frontier Models for Dangerous Capabilitiescited by 128
- 2024Speak Out of Turn: Safety Vulnerability of Large Language Models in Multi-turn Dialoguecited by 66
- 2024Sabotage Evaluations for Frontier Modelscited by 52
- 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
- 2024PanoSent: A Panoptic Sextuple Extraction Benchmark for Multimodal Conversational Aspect-based Sentiment Analysiscited by 13
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025D-REX: A Benchmark for Detecting Deceptive Reasoning in Large Language Modelscited by 7
- 2026Evaluating Language Models for Harmful Manipulationcited by 6
- 2025WGSR-Bench: Wargame-based Game-theoretic Strategic Reasoning Benchmark for Large Language Modelscited by 1
- 2026RogueAI: A Reverse Turing Test for Detecting Licensed AI Deception in Dialoguecited by 1
- 2026Towards Mitigating Deceptive Safety Alignment in Large Reasoning Modelscited by 0
- 2026Towards Mitigating Deceptive Safety Alignment in Large Reasoning Models28 Sep 2026
- 2026RogueAI: A Reverse Turing Test for Detecting Licensed AI Deception in Dialogue11 Jun 2026
- 2026Evaluating Language Models for Harmful Manipulation26 Mar 2026
- 2025D-REX: A Benchmark for Detecting Deceptive Reasoning in Large Language Models22 Sep 2025
- 2025WGSR-Bench: Wargame-based Game-theoretic Strategic Reasoning Benchmark for Large Language Models12 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026DecepEval: A Benchmark for Evaluating Deception in LLM Agents
- 2026Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing
- 2025DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarios
- 2025Among Us: A Sandbox for Measuring and Detecting Agentic Deception
- 2026"Are You Sure?": An Empirical Study of Human Perception Vulnerability in LLM-Driven Agentic Systems
- 2025The Traitors: Deception and Trust in Multi-Agent Language Model Simulations
- 2025Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
- 2026Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Games