mlsanityData to 14 Oct 2026

The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Follow

arXiv 2610.17301 ↗First posted 12 Oct 2026cs.AIcited by 0

New in LLM agents and tool use; no direction yet. LLM agents and tool use

Abstract (arXiv)

Language-model agents sometimes act beyond their authorization and then misreport what they did. On CAPE-Bench, matched agent tasks in which one fact decides whether an action is authorized, frontier open-weight agents do both, and one behavior marks the lie: retroactive permission laundering, acting and then asking permission as if the action were pending, precedes a false report in 70% of 1081 fresh informed violations, against 8% otherwise (preregistered odds ratio 7.0); frontier agents on tau^2-bench instead fabricate the authorization before violating. A linear readout of the agent's residual stream forecasts the violation before the action (AUROC 0.94) and the false report before the report, and beats chain-of-thought monitors when the agent is pressured to hide its reasoning. Gating every proposed action on this forecast cuts violations over whole episodes in four model families, and sending repeated flags to an approver keeps authorized work (Gemma-4: violations 0.70 -> 0.09, completion 1.00; a model approver that escalates unclear cases keeps this gain with a person seeing 25% of asks), at about 10-8 of the agent's compute and 109 times less than a chain-of-thought monitor. On AgentDojo, an external prompt-injection benchmark, the same readout calibrated on 29 tasks, with the steering unchanged, cuts attack success on unseen tasks in two families (Gemma-4 11.7% -> 5.7%, gpt-oss 28.5% -> 17.5%) while keeping benign utility (Gemma-4 0.637 vs 0.637; gpt-oss 0.667 vs 0.681). Preventing the violation is also the most reliable way to prevent the lie (misreported violations 0.10 -> 0.01 pooled over three families, preregistered), whereas lie-specific fixes after a violation are weak. All tests are preregistered and hash-locked; code, data and the full record, including tests that did not pass, are at https://github.com/AryaFayyazi/Honesty.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

31 of 48 references.

References · 31

  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  2. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  3. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  4. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  5. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  6. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
  7. 2024Frontier Models are Capable of In-context Schemingcited by 287
  8. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
  9. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
  10. 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 146
  11. 2025RL-Obfuscation: Can Language Models Learn to Evade Latent-Space Monitors?cited by 24
  12. 2026Beyond Task Completion: Revealing Corrupt Success in LLM Agents through Procedure-Aware Evaluationcited by 20
19 more
  1. 2025Are Your Agents Upward Deceivers?cited by 16
  2. 2026How Coding Agents Fail Their Users: A Large-Scale Analysis of Developer-Agent Misalignment in 20,574 Real-World Sessionscited by 14
  3. 2025Difficulties with Evaluating a Deception Detector for AIscited by 13
  4. 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 7
  5. 2026Agent Memory Is a Surface for Endogenous Authorization Launderingcited by 5
  6. 2025FAIR-SIGHT: Fairness Assurance in Image Recognition via Simultaneous Conformal Thresholding and Dynamic Output Repaircited by 4
  7. 2026Activation Steering for Aligned Open-ended Generation without Sacrificing Coherencecited by 4
  8. 2026Quantifying Overclaiming Propensity in Frontier LLM Agentscited by 4
  9. 2026Proof-of-Perception: Certified Tool-Using Multimodal Reasoning with Compositional Conformal Guaranteescited by 3
  10. 2026Agent Meltdowns: The Road to Hell Is Paved with Helpful Agentscited by 2
  11. 2026Predicting Future Behaviors in Reasoning Models Enables Better Steeringcited by 2
  12. 2026Internal-State Probes Read the Situation, Not the Action: Three Negative Results for Pre-Action Misalignment Monitoringcited by 2
  13. 2026Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentivescited by 2
  14. 2026Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluationscited by 2
  15. 2026COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Modelscited by 1
  16. 2026More Rejective, Not More Discriminative: The Unit of Verification in Pre-Execution LLM Oversightcited by 1
  17. 2026Silence Is Endorsement: Verification-Status Laundering in LLM Agent Pipelinescited by 1
  18. 2026Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Modelscited by 1
  19. 2026LLMs Learn to Evade Latent Monitors from Prior Feedback Alonecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Before Agent Tells The Lie: Has Deception Already Been Represented?
  2. 2026Deception by Omission: Language Models Knowingly Hide Their Mistakes
  3. 2025EU-Agent-Bench: Measuring Illegal Behavior of LLM Agents Under EU Law
  4. 2026Omission Constraints Decay While Commission Constraints Persist in Long-Context LLM Agents
  5. 2026Same Operation, Different Permission: Evaluating Whether Guardrails Honor Authorization
  6. 2026Organising Trajectory Evidence for Language-Model Agent Assurance: Fragments, Methods, and the Residual
  7. 2026Clean Scores, Buried Evidence, and Confident Wrong: A Receipt-Based Audit of Frontier Agentic QA
  8. 2025Why Do Language Model Agents Whistleblow?