Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Large Language Models (LLMs) are widely deployed in reasoning, planning, and decision-making tasks, making their trustworthiness critical. A significant and underexplored risk is intentional deception, where an LLM deliberately fabricates or conceals information to serve a hidden objective. Existing studies typically induce deception by explicitly setting a hidden objective through prompting or fine-tuning, which may not reflect real-world human-LLM interactions. Moving beyond such human-induced deception, we investigate LLMs' self-initiated deception on benign prompts. To address the absence of ground truth, we propose a framework based on Contact Searching Questions (CSQ). This framework introduces two statistical metrics derived from psychological principles to quantify the likelihood of deception. The first, the Deceptive Intention Score, measures the model's bias toward a hidden objective. The second, the Deceptive Behavior Score, measures the inconsistency between the LLM's internal belief and its expressed output. Evaluating 16 leading LLMs, we find that both metrics rise in parallel and escalate with task difficulty for most models. Moreover, increasing model capacity does not always reduce deception, posing a significant challenge for future LLM development.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 55 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
38 of 55 references.
Closest ancestors · 1
Same direction, newest first
Other references · 37
- 2023GPT-4 Technical Reportcited by 18,132
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
25 more
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
- 2024Measuring short-form factuality in large language modelscited by 345
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
- 2024Alignment faking in large language modelscited by 316
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 280
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 272
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2024Long-form factuality in large language modelscited by 146
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 131
- 2023Generating Benchmarks for Factuality Evaluation of Language Modelscited by 103
- 2023Deception Abilities Emerged in Large Language Modelscited by 99
- 2023Backdoor Attacks for In-Context Learning with Language Modelscited by 92
- 2025HalluLens: LLM Hallucination Benchmarkcited by 88
- 2020Controlled Hallucinations: Learning to Generate Faithfully from Noisy Datacited by 83
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 57
- 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
- 2024A Comprehensive Evaluation of Cognitive Biases in LLMscited by 32
- 2022Causally Testing Gender Bias in LLMs: A Case Study on Occupational Biascited by 28
- 2024Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Modelscited by 27
- 2024AMONGAGENTS: Evaluating Large Language Models in the Interactive Text-Based Social Deduction Gamecited by 26
- 2025DarkBench: Benchmarking Dark Patterns in Large Language Modelscited by 25
- 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
- 2024The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Modelscited by 17
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025LLM DNA: Tracing Model Evolution via Functional Representationscited by 15
- 2025WOLF: Werewolf-based Observations for LLM Deception and Falsehoodscited by 13
- 2026From Deceptive Outputs to Deceptive Mechanisms: A Causal Framework for Language-Model Deception Researchcited by 1
- 2026Paper Espresso: From Paper Overload to Research Insightcited by 0
- 2026DECOR: Auditing LLM Deception via Information Manipulation Theorycited by 0
- 2026From Deceptive Outputs to Deceptive Mechanisms: A Causal Framework for Language-Model Deception Research3 Sep 2026
- 2026DECOR: Auditing LLM Deception via Information Manipulation Theory19 May 2026
- 2026Paper Espresso: From Paper Overload to Research Insight6 Apr 2026
- 2025WOLF: Werewolf-based Observations for LLM Deception and Falsehoods9 Dec 2025
- 2025LLM DNA: Tracing Model Evolution via Functional Representations29 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating & Reducing Deceptive Dialogue From Language Models with Multi-turn RL
- 2026DecepEval: A Benchmark for Evaluating Deception in LLM Agents
- 2026Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing
- 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Models
- 2025Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques
- 2025Hidden in Plain Sight: Evaluation of the Deception Detection Capabilities of LLMs in Multimodal Settings
- 2025Reasoning Isn't Enough: Examining Truth-Bias and Sycophancy in LLMs
- 2026Unlearning Deceptive Behaviors in LLMs with Contrastive Forget Sets