Rethinking Agent Security as a Networking Problem
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
AI agents are rapidly becoming more capable and widely deployed, promising substantial gains in productivity and enabling new classes of applications. However, their growing autonomy also introduces significant privacy and security risks. Existing defenses are predominantly agent-centric, relying on the agent itself to detect threats and enforce privacy and security policies. This approach is fundamentally limited because it entrusts policy enforcement to AI agents whose LLM-driven behavior is inherently nondeterministic and vulnerable to manipulation through attacks such as prompt injection. As a result, current defenses cannot reliably prevent privacy and security threats, highlighting a critical need for a new solution to securing AI agent systems. The networking community has long grappled with similar challenges and offers insightful principles we can borrow to design a more secure AI agent system. These include centralized control with distributed enforcement, capability-based access for mediating requests to sensitive resources, and least privilege through zero-trust enforcement. Historically, these principles have provided strong deterministic guarantees for networked systems. However, these principles alone are insufficient for AI agents because the safety and appropriateness of an agent's actions often depend on semantic context beyond the expressiveness of static rules. Building on these principles, we advocate for a systematic approach to AI agent security that combines deterministic enforcement mechanisms, which provide strong security guarantees, with semantic, context-aware policies that enable nuanced decision-making. We then present a reference architecture and identify key research questions and future directions to guide the design of secure and privacy-preserving AI agent systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 39 of its 73 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
39 of 73 references.
Closest ancestors · 18
Same direction, newest first
- 2026From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors29 May
- 2026Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks18 May
- 2026ClawLess: A Security Model of AI Agents7 Apr
- 2026OMNI-LEAK: Orchestrator Multi-Agent Network Induced Data Leakage13 Feb
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agents9 Feb
- 2026Towards Verifiably Safe Tool Use for LLM Agents12 Jan
- 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generation3 Oct
- 2025Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agents22 Sep
- 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
- 2025Defeating Prompt Injections by Design24 Mar
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities21 Mar
- 2025AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents12 Mar
6 more
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage13 Feb
- 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents21 Dec
- 2024AirGapAgent: Protecting Privacy-Conscious Conversational Agents8 May
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
Other references · 21
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 230
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 210
- 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 171
- 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 127
- 2025Securing AI Agents with Information-Flow Controlcited by 121
9 more
- 2025A Critical Evaluation of Defenses against Prompt Injection Attackscited by 36
- 2025Contextual Integrity in LLMs via Reasoning and Reinforcement Learningcited by 31
- 2025Bypassing LLM Guardrails: An Empirical Analysis of Evasion Attacks against Prompt Injection and Jailbreak Detection Systemscited by 26
- 2025Real AI Agents with Fake Memories: Fatal Context Manipulation Attacks on Web3 Agentscited by 24
- 2025SoK: Evaluating Jailbreak Guardrails for Large Language Modelscited by 21
- 2024Rescriber: Smaller-LLM-Powered User-Led Data Minimization for LLM-Based Chatbotscited by 16
- 2025ceLLMate: Sandboxing Browser AI Agentscited by 16
- 2025Improving Google A2A Protocol: Protecting Sensitive Data and Mitigating Unintended Harms in Multi-Agent Systemscited by 10
- 2025AgentBay: A Hybrid Interaction Sandbox for Seamless Human-AI Intervention in Agentic Systemscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Systems Security Foundations for Agentic Computing
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents
- 2026Agent Security is a Systems Problem
- 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey
- 2026Trustworthy Agentic AI: A Comprehensive Cybersecurity and Systems Survey on Threat Landscapes, Defense Architectures, and Open Challenges
- 2025AgentCrypt: Advancing Privacy and (Secure) Computation in AI Agent Collaboration
- 2026Toward Securing AI Agents Like Operating Systems