The Authorization-Execution Gap Is a Major Safety and Security Problem in Open-World Agents
Not on the map. Why?
Abstract (arXiv)
This position paper argues that the Authorization-Execution Gap (AEG) is a major safety and security problem in open-world agents. The AEG is the divergence between what a principal intends to authorize and what an open-world agent ultimately executes. Because such agents act autonomously across tools, persistent state, and multi-agent handoffs, even small instances of authorization divergence can cause harm that is difficult or impossible to undo. We argue that many observed agent failures can be traced to three structural sources of AEG: delegation-level incompleteness, channel-level corruption, and composition-level fragmentation. The same observed failure may arise from any of these sources. Without identifying the source, a defense targeting the symptom alone cannot address the underlying cause. Agent safety and security should therefore emphasize source-oriented diagnosis and defense. Because the structural sources of AEG arise dynamically during execution, this approach necessarily requires authorization integrity checks applied during execution, rather than relying solely on one-shot upfront filtering or post-hoc audit. For NeurIPS, the implication is that papers on open-world agents should report not only outcome-level metrics such as task success or attack resistance, but also process-level evidence showing where AEG was detected, constrained, and attributed to a structural source during execution.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
27 of 36 references.
References · 27
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 437
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 369
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?cited by 158
15 more
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 144
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agentscited by 102
- 2023PentestGPT: An LLM-empowered Automatic Penetration Testing Toolcited by 97
- 2025AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agentscited by 82
- 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injectionscited by 48
- 2026Agents of Chaoscited by 32
- 2025OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agentscited by 25
- 2025Rethinking the Reliability of Multi-agent System: A Perspective from Byzantine Fault Tolerancecited by 17
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 14
- 2026CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agentscited by 14
- 2025A Safety and Security Framework for Real-World Agentic Systemscited by 13
- 2026AgentSCOPE: Evaluating Contextual Privacy Across Agentic Workflowscited by 10
- 2025Helpful Agent Meets Deceptive Judge: Understanding Vulnerabilities in Agentic Workflowscited by 7
- 2025Formalizing the Safety, Security, and Functional Properties of Agentic AI Systemscited by 5
- 2025Securing Agentic AI Systems -- A Multilayer Security Frameworkcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Authorization Revocation for Long-Running AI Agents: Root-Scoped Quiescence under Delegation and Asynchronous Executioncited by 1
- 2026The Vulnerability With No CVE: Managing Persistent Gaps Between Mandate and Authority in AI Coding Agentscited by 0
- 2026DelegationBench: Measuring When AI Agents Should Ask Before Actingcited by 0
- 2026APEX-Harm: Evaluating Agent Safety in Shared Professional Workspacescited by 0
- 2026APEX-Harm: Evaluating Agent Safety in Shared Professional Workspaces9 Oct 2026
- 2026DelegationBench: Measuring When AI Agents Should Ask Before Acting4 Oct 2026
- 2026Authorization Revocation for Long-Running AI Agents: Root-Scoped Quiescence under Delegation and Asynchronous Execution18 Sep 2026
- 2026The Vulnerability With No CVE: Managing Persistent Gaps Between Mandate and Authority in AI Coding Agents6 Aug 2026