On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) have undergone a shift from stateless conversational interfaces to autonomous agents capable of multi-step planning, tool invocation, code execution, and maintaining persistent memory. When these agents operate with real-world privileges---calling APIs, modifying files, and querying databases---a compromised reasoning step can trigger unauthorized data access, irreversible state changes, or cascading failures, yet the security research community has not kept pace. To quantify the state of the field, we conducted a systematic literature review under PRISMA 2020 guidelines across six databases, screening 743 records and retaining 85 papers (2023--2025) on agentic LLM security. Attack research outpaces defense work by 3.9:1. Perception-layer vulnerabilities (prompt injection, jailbreaking, adversarial perturbations) dominate, accounting for 66% of papers, while action-layer vulnerabilities (tool misuse, code injection, sandbox escape) appear in only 4.7%, misaligned with real-world risk. Code execution security accounts for 3.5%, and tool-augmented agents 12%. We contribute a four-layer taxonomy mapping 13 vulnerability types across perception, brain, action, and interaction layers, and identify seven open problems centered on containment. Agentic LLM insecurity stems from architectural coupling, where weak isolation allows vulnerabilities to propagate across layers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 88 of its 136 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
88 of 136 references.
Closest ancestors · 27
Same direction, newest first
- 2026Mitigating the OWASP Top 10 For Large Language Models Applications using Intelligent Agents26 Jan
- 2025Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red Teaming20 Nov
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct
- 2025Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain3 Oct
- 2025A Whole New World: Creating a Parallel-Poisoned Web Only AI-Agents Can See29 Aug
- 2025A Systematization of Security Vulnerabilities in Computer Use Agents7 Jul
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows29 Jun
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems4 Jun
- 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
- 2025Comprehensive Vulnerability Analysis is Necessary for Trustworthy LLM-MAS2 Jun
- 2025LLM Agents Should Employ Security Principles29 May
- 2025Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agents28 Apr
15 more
- 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
- 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage13 Feb
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb
- 2024Targeting the Core: A Simple and Effective Method to Attack RAG-based Agents via Direct LLM Manipulation5 Dec
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
- 2024Automated Red Teaming with GOAT: the Generative Offensive Agent Tester2 Oct
- 2024Compromising Embodied Agents with Contextual Backdoor Attacks6 Aug
- 2024Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification30 Jul
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
- 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities10 Jul
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
- 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks2 Mar
- 2024WIPI: A New Web Threat for LLM-Driven Web Agents26 Feb
- 2024A Trembling House of Cards? Mapping Adversarial Attacks against Language Agents15 Feb
- 2024Whispers in the Machine: Confidentiality in Agentic Systems10 Feb
Other references · 61
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
- 2025Towards a Science of Scaling Agent Systemscited by 138
- 2020Backdoor Attacks Against Deep Learning Systems in the Physical Worldcited by 134
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
- 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 127
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
38 more
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 75
- 2024Defending Large Language Models against Jailbreak Attacks via Semantic Smoothingcited by 74
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 71
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2025Deep Research: A Survey of Autonomous Research Agentscited by 66
- 2025Authenticated Delegation and Authorized AI Agentscited by 65
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2023JailGuard: A Universal Detection Framework for LLM Prompt-based Attackscited by 50
- 2023Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreakscited by 49
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 48
- 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 44
- 2025Ctrl-Z: Controlling AI Agents via Resamplingcited by 44
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 44
- 2025Lessons from Defending Gemini Against Indirect Prompt Injectionscited by 43
- 2025On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and Perspectivecited by 41
- 2025Defending Against Prompt Injection with DataFiltercited by 35
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 34
- 2024Exploring Autonomous Agents through the Lens of Large Language Models: A Reviewcited by 31
- 2025Security Concerns for Large Language Models: A Surveycited by 29
- 2024Large Language Models for Anomaly and Out-of-Distribution Detection: A Surveycited by 27
- 2025Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systemscited by 27
- 2024What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detectioncited by 25
- 2025Real AI Agents with Fake Memories: Fatal Context Manipulation Attacks on Web3 Agentscited by 24
- 2024Large Language Model Supply Chain: A Research Agendacited by 23
- 2024Unique Security and Privacy Threats of Large Language Models: A Comprehensive Surveycited by 23
- 2025Securing the Model Context Protocol (MCP): Risks, Controls, and Governancecited by 23
- 2024Cost-Effective Hallucination Detection for LLMscited by 18
- 2025GTM: Simulating the World of Tools for AI Agentscited by 14
- 2023Fundamentals of Generative Large Language Models and Perspectives in Cyber-Defensecited by 13
- 2024Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroringcited by 12
- 2019Adversarial Learning in Statistical Classification: A Comprehensive Review of Defenses Against Attackscited by 11
- 2025MAD-Spear: A Conformity-Driven Prompt Injection Attack on Multi-Agent Debate Systemscited by 10
- 2024Large Language Model Supply Chain: Open Problems From the Security Perspectivecited by 9
- 2025Agentic Workflows for Conversational Human-AI Interaction Designcited by 8
- 2025PromptSleuth: Detecting Prompt Injection via Semantic Intent Invariancecited by 8
- 2023Conceptual Framework for Autonomous Cognitive Entitiescited by 6
- 2024Humanizing the Machine: Proxy Attacks to Mislead LLM Detectorscited by 6
- 2025Diverse Inference and Verification for Advanced Reasoningcited by 6
50 most cited of 61 All 61 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2026A Lifecycle and Application-Stack Survey of Large Language Model Vulnerabilities: Attacks, Risks, Defenses, and Open Problems
- 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks
- 2024Exploring Vulnerabilities and Protections in Large Language Models: A Survey
- 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms
- 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis
- 2024Fine-Tuning, Quantization, and LLMs: Navigating Unintended Outcomes