mlsanityData to 14 Oct 2026

MIRAGE: A Polarity-Flipping Encoding Subspace in LLM Agents

arXiv 2606.10304 ↗First posted 9 Jun 2026cs.CLcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

When LLM agents are coerced into covertly encoding sensitive data (Base64, ROT13, acrostic, synonym chains, and beyond), the resulting outputs evade output-side detection but the underlying computation does not. Across nine encoding families and eight models from five architecture families, that computation is supported by a shared low-dimensional encoding subspace in the residual stream. A logistic-regression probe trained on eight encoding families recovers the held-out ninth at AUC 0.975-1.000, reading the computation rather than surface features. The same direction exhibits a second mechanistic signature at the planning token, flipping polarity to activate positively when the model will simulate the encoding inline and negatively when it will outsource it to a tool call, distinguishing two execution strategies before the encoded text exists. We build MIRAGE (Model-Internal Readout of Agentic Generation Exfiltration), a two-channel real-time monitor exploiting both signals. On 126 agentic exfiltration scenarios, it reaches AUC = 0.918, substantially outperforming output-only detection (AUC = 0.518). Monitor performance is fundamentally a property of the host model's geometry: benign-encoding false-positive rate ranges from 0% on Qwen-7B to 100% on Phi-3.5, revealing that the probe faithfully reads whether a model's geometry separates covert from overt encoding. Across all tested adversarial budgets, every attack suppressing the subspace also destroyed encoding fidelity, reported as an empirical regularity on the evaluated budgets, not a structural impossibility claim.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 38 of its 57 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

38 of 57 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
  2. 2024LLM Agents can Autonomously Hack Websites6 Feb
  3. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
  4. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2017On Calibration of Modern Neural Networkscited by 4,960
  6. 2023Mistral 7Bcited by 3,164
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  8. 2024Qwen2 Technical Reportcited by 2,120
  9. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  10. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  11. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  12. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
22 more
  1. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  2. 2022In-context Learning and Induction Headscited by 964
  3. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  4. 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
  5. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  6. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  7. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  8. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  9. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  10. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  11. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  12. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 486
  13. 2023Detecting Language Model Attacks with Perplexitycited by 431
  14. 2023Are aligned neural networks adversarially aligned?cited by 315
  15. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
  16. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  17. 2023Linear Representations of Sentiment in Large Language Modelscited by 163
  18. 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 145
  19. 2023A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operationscited by 144
  20. 2023Preventing Language Models From Hiding Their Reasoningcited by 65
  21. 2019Superposition of many models into onecited by 64
  22. 2024Stress-Testing Capability Elicitation With Password-Locked Modelscited by 46

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach
  2. 2026AsymSpec: Context-Asymmetric Speculative Decoding for Agentic LLMs
  3. 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories
  4. 2026SLEIGHT-Bench: A Benchmark of Evasion Attacks Against Agent Monitors
  5. 2026Automata from Agent Traces: Failure and Next-Step Prediction
  6. 2026Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study
  7. 2026Beyond the Transcript: Detecting Covert Co ordination in Latent Multi-Agent Communication
  8. 2025Reliable Weak-to-Strong Monitoring of LLM Agents