Delegation Without Trust: An Empirical Gap Analysis of Identity, Authorization, and Runtime Governance in Multi-Agent LLM Systems
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Autonomous LLM agents increasingly act on a user's behalf: they hold credentials, call tools and services, and spawn sub-agents that act further on their behalf. This turns a long-standing distributed-systems question -- who is authorized to do what, on whose authority -- into an urgent and largely unsolved problem, because the component driving each agent is a language model an adversary can hijack. We argue that agent security must be evaluated under an untrusted-model assumption: a correct system is one in which a fully prompt-injected agent still cannot exceed the authority explicitly delegated to it. Against this standard we make three contributions. First, we give a threat model for multi-agent delegation centered on four adversaries -- confused deputy, token theft and replay, prompt-injection privilege escalation, and compromised sub-agents -- and derive eight security requirements a governed agent system must meet. Second, we show the gap is real: a default agent runtime modeling common practice (broad bearer credentials, authorization gated inside the model) fails all four threats, and across four widely used frameworks -- LangGraph, CrewAI, AutoGen, and the Model Context Protocol (MCP) authorization model -- three provide no built-in confinement and one only partial; no existing standard alone covers the requirement set. Third, we implement and adversarially evaluate an authorization broker that closes the gap. It blocks all four threats; it resists 11 direct attacks on its design and accepts 0 of 200,000 forged tokens; it confines a compromised sub-agent to its delegated task (a mean of 1.5 reachable actions versus all 8,100 under bearer delegation, across 2,000 randomized scenarios); and it enforces at microsecond cost (about 2.6 microseconds per decision), negligible against model inference. These principles are also realized in production in VotalAI's LLM Shield.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 15 of its 33 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
15 of 33 references.
Closest ancestors · 8
Same direction, newest first
- 2026Untrusted Content Masking for Web Agents with Security Guarantees6 Jul
- 2026Capability Gates Are Not Authorization: Confused-Deputy Failures in LLM Agent Frameworks27 Jun
- 2026AC4A: Access Control for Agents21 Mar
- 2026Formal Policy Enforcement for Real-World Agentic Systems18 Feb
- 2025Progent: Securing AI Agents with Privilege Control16 Apr
- 2025Defeating Prompt Injections by Design24 Mar
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 7
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2026AI Agents May Always Fall for Prompt Injectionscited by 9
- 2026A First Measurement Study on Authentication Security in Real-World Remote MCP Serverscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2025Seven Security Challenges in Cross-domain Multi-agent LLM Systems
- 2025SAGA: A Security Architecture for Governing AI Agentic Systems
- 2026Bounded Agents: Delegation Security for Multi-Agent AI Systems
- 2026Overlaying Governance: A Compositional Authorization Framework for Delegation and Scope in Agentic AI
- 2026NostrAgent: A Decentralized Identity and Delegation Architecture for Sovereign Agentic Systems
- 2026Authorization Propagation in Multi-Agent AI Systems: Identity Governance as Infrastructure
- 2026AgentFlow: A Flow-Centric Policy Language and Framework for Securing LLM Agent Systems