Same Payload, Different Channel: Measuring Trust Asymmetry in Tool-Using Language Models
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
As language models take on agentic roles that call APIs, read tool outputs, and act on third-party content, their attack surface expands beyond what users type. Whether they treat a malicious instruction the same way regardless of where it arrives has not been studied systematically. We introduce the Safety Asymmetry Score (SAS), measuring how a model's susceptibility to adversarial content shifts depending on whether it arrives in the user message, tool metadata, or tool output, using matched payload pairs that hold the malicious text identical and vary only the channel. Across 10 production LLMs and three attack families, general-purpose models sharply discount instructions arriving as tool metadata relative to identical instructions in the user message, while agent-native models discount them far less. This differential survives an affordance-matched control equalizing tool availability and scoring, and a size-controlled mixed-effects analysis. Within the tool surface the pattern reverses: the same content is far more instruction-like in a tool's description than in its output, with affordances identical. Models treat tool metadata as instructions and tool results as data. In Llama 3.3-70B and GPT-OSS-120B this signal is causally present at mid-to-late depths but non-linearly encoded, so linear probes miss what activation patching recovers.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 19 of its 41 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
19 of 41 references.
Closest ancestors · 8
Same direction, newest first
- 2026Prompt Injection Attacks on Agentic Coding Assistants: A Systematic Analysis of Vulnerabilities in Skills, Tools, and Protocol Ecosystems24 Jan
- 2025ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agents26 Sep
- 2025MCPTox: A Benchmark for Tool Poisoning Attack on Real-World MCP Servers19 Aug
- 2025MCPSecBench: A Systematic Security Benchmark and Playground for Testing Model Context Protocols17 Aug
- 2025AgentVigil: Generic Black-Box Red-teaming for Indirect Prompt Injection against LLM Agents9 May
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
Other references · 11
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2024How to use and interpret activation patchingcited by 191
- 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 175
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 144
- 2026GAVEL: Towards Rule-Based Safety Through Activation Monitoringcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SafeClawBench: Separating Semantic, Audit-Evidence, and Sandbox Harm in Tool-Using LLM Agents
- 2026Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
- 2026The Causal Impact of Tool Affordance on Safety Alignment in LLM Agents
- 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
- 2026AgentSecBench: Measuring Prompt Injection, Privacy Leakage, and Tool-Use Integrity in LLM Agents
- 2026Measuring and Exploiting Implicit Trust in LLM Tool-Calling Pipelines
- 2026Tool Specifications Matter: Uncovering and Mitigating Safety Risks in AI Agents
- 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfaces