mlsanityData to 14 Oct 2026

The Secret Agenda: LLMs Strategically Lie and Our Current Safety Tools Are Blind

arXiv 2509.20393 ↗First posted 23 Sep 2025cs.CY cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

We investigate strategic deception in large language models using two complementary testbeds: Secret Agenda (across 38 models) and Insider Trading compliance (via SAE architectures). Secret Agenda reliably induced lying when deception advantaged goal achievement across all model families. Analysis revealed that autolabeled SAE features for "deception" rarely activated during strategic dishonesty, and feature steering experiments across 100+ deception-related features failed to prevent lying. Conversely, insider trading analysis using unlabeled SAE activations separated deceptive versus compliant responses through discriminative patterns in heatmaps and t-SNE visualizations. These findings suggest autolabel-driven interpretability approaches fail to detect or control behavioral deception, while aggregate unlabeled activations provide population-level structure for risk assessment. Results span Llama 8B/70B SAE implementations and GemmaScope under resource constraints, representing preliminary findings that motivate larger studies on feature discovery, labeling methodology, and causal interventions in realistic deception contexts.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

20 of 43 references.

References · 20

  1. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  2. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  3. 2016Concrete Problems in AI Safetycited by 1,642
  4. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
  5. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 394
  6. 2024Frontier Models are Capable of In-context Schemingcited by 287
  7. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  8. 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 113
  9. 2023Deception Abilities Emerged in Large Language Modelscited by 101
  10. 2025Demonstrating specification gaming in reasoning modelscited by 56
  11. 2023Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framingcited by 51
  12. 2023Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Modelscited by 47
8 more
  1. 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
  2. 2024Efficient Dictionary Learning with Switch Sparse Autoencoderscited by 39
  3. 2024BeHonest: Benchmarking Honesty in Large Language Modelscited by 24
  4. 2025When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Modelscited by 18
  5. 2025Compromising Honesty and Harmlessness in Language Models via Deception Attackscited by 17
  6. 2024Honesty to Subterfuge: In-Context Reinforcement Learning Can Make Honest Models Reward Hackcited by 8
  7. 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applicationscited by 4
  8. 2022Domain-Independent Deception: Definition, Taxonomy and the Linguistic Cues Debatecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DECOR: Auditing LLM Deception via Information Manipulation Theory
  2. 2025Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
  3. 2026DecepEval: A Benchmark for Evaluating Deception in LLM Agents
  4. 2026Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing
  5. 2025Can LLMs Lie? Investigation beyond Hallucination
  6. 2025Detecting Strategic Deception Using Linear Probes
  7. 2026Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling
  8. 2025Strategic Dishonesty Can Undermine AI Safety Evaluations of Frontier LLMs