Securing Agentic AI: From Per-Action Checks to Trajectory Assurance
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Autonomous agents are increasingly used to execute consequential tasks in environments governed by operational constraints, organizational policies, regulatory requirements, and technical standards. Their safety is therefore determined not by the correctness of individual actions, but by whether their overall behavior remains consistent with the rules and invariants of the systems in which they operate. As large language model (LLM)-based agents become more autonomous and increasingly delegate tasks across organizational boundaries, securing them evolves from a single challenge into a broad and interconnected landscape spanning the entire agentic stack. At the single-agent level, untrusted inputs through prompts, memory, retrieved knowledge, and tool interfaces create attack surfaces. In multi-agent settings, delegation and communication introduce challenges related to identity, trust, capability control, and decision transparency, while the underlying model routing and execution control plane remains vulnerable to manipulation and to unverified model provenance. Perhaps the most fundamental challenge is behavioral containment: sequences of individually permissible actions may collectively violate system-level constraints and safety invariants. At the broader level, supply-chain integrity, provenance, accountability, and end-to-end observability remain largely open problems. A common principle unifies these directions: security must become a verifiable property of the architectures, protocols, and runtimes that govern agent behavior, rather than an optional layer of guidance. Charting these challenges provides a roadmap toward trustworthy autonomous agent deployment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 23 of its 52 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
23 of 52 references.
Closest ancestors · 13
Same direction, newest first
- 2026From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification28 Mar
- 2026Security Threat Modeling for Emerging AI-Agent Protocols: A Comparative Analysis of MCP, A2A, Agora, and ANP11 Feb
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan
- 2025Enforcing Temporal Constraints for LLM Agents25 Dec
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct
- 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generation3 Oct
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows29 Jun
- 2025MPMA: Preference Manipulation Attack Against Model Context Protocol16 May
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2025Progent: Securing AI Agents with Privilege Control16 Apr
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
Other references · 10
- 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applicationscited by 58
- 2025Rerouting LLM Routerscited by 11
- 2024Stealing User Prompts from Mixture of Expertscited by 10
- 2025Life-Cycle Routing Vulnerabilities of LLM Routercited by 10
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 10
- 2026Route to Rome Attack: Directing LLM Routers to Expensive Models via Adversarial Suffix Optimizationcited by 4
- 2026RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMscited by 4
- 2026RerouteGuard: Understanding and Mitigating Adversarial Risks for LLM Routingcited by 3
- 2025RepetitionCurse: Measuring and Understanding Router Imbalance in Mixture-of-Experts LLMs under DoS Stresscited by 2
- 2026FormalJudge: A Neuro-Symbolic Paradigm for Agentic Oversightcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security
- 2026When the Agent Is the Adversary: Architectural Requirements for Agentic AI Containment After the April 2026 Frontier Model Escape
- 2026Trustworthy Agentic AI: A Comprehensive Cybersecurity and Systems Survey on Threat Landscapes, Defense Architectures, and Open Challenges
- 2026Agentic AI Containment Architecture for Security Hardening
- 2025Toward a Safe Internet of Agents
- 2025A Safety and Security Framework for Real-World Agentic Systems
- 2025Formalizing the Safety, Security, and Functional Properties of Agentic AI Systems
- 2026Connecting the Dots in Agentic AI Security: A Cross-Dimensional Threat Taxonomy, Evaluation Maturity, and Open Challenges