Connecting the Dots in Agentic AI Security: A Cross-Dimensional Threat Taxonomy, Evaluation Maturity, and Open Challenges
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Agentic AI extends LLM security beyond generated content to persistent state, autonomous actions, tool use, and interactions with humans and other agents. Existing threat classifications often emphasize individual dimensions, obscuring connections among entry points, affected components, and security consequences. The known threat landscape also differs from the coverage demonstrated by empirical research. Through a structured review of 66 studies published from 2022 to 2026, we introduce T={S, B, P, A}, a cross-dimensional representation linking affected functional or system surfaces {S}, interaction or trust boundaries {B}, violated security properties {P}, and empirically examined architectures {A}. We analyze 22 artifact-backed red-teaming studies and 11 representative security benchmarks to characterize empirical coverage and evaluation maturity. Within the selected studies, evidence concentrates on prompt/reasoning, memory, and tool-mediated attacks, predominantly in single-agent settings. Persistent, Human--Agent, complex multi-agent, systemic, and long-horizon threats receive less coverage. These findings describe the selected corpus rather than establish gaps across all empirical research. Heterogeneous metrics, limited adaptive defense evaluation, architectural imbalance, and incomplete execution-state capture further constrain comparison and reproducibility. We derive 13 open research questions to guide more systematic, architecture-aware, and reproducible security evaluation of agentic AI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 86 of its 110 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
86 of 110 references.
Closest ancestors · 47
Same direction, newest first
- 2026Reward Hacking in Language Model Agents: Revisiting AI Safety Gridworlds13 Jun
- 2026ADAM: A Systematic Data Extraction Attack on Agent Memory via Adaptive Querying10 Apr
- 2026A Formal Security Framework for MCP-Based AI Agents: Threat Taxonomy, Verification Models, and Defense Mechanisms7 Apr
- 2026Stop Fixating on Prompts: Reasoning Hijacking and Constraint Tightening for Red-Teaming LLM Agents7 Apr
- 2026LanG -- A Governance-Aware Agentic AI Platform for Unified Security Operations7 Apr
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystems3 Apr
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomy24 Mar
- 2026Memory poisoning and secure multi-agent systems20 Mar
- 2026LAAF: Logic-layer Automated Attack Framework A Systematic Red-Teaming Methodology for LPCI Vulnerabilities in Agentic Large Language Model Systems18 Mar
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey11 Mar
- 2026AgenticCyOps: Securing Multi-Agentic AI Integration in Enterprise Cyber Operations10 Mar
- 2026AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks18 Feb
35 more
- 2026Security Threat Modeling for Emerging AI-Agent Protocols: A Comparative Analysis of MCP, A2A, Agora, and ANP11 Feb
- 2026Human Society-Inspired Approaches to Agentic AI Security: The 4C Framework2 Feb
- 2026SHIELD: An Auto-Healing Agentic Defense Framework for LLM Resource Exhaustion Attacks27 Jan
- 2026Prompt Injection Attacks on Agentic Coding Assistants: A Systematic Analysis of Vulnerabilities in Skills, Tools, and Protocol Ecosystems24 Jan
- 2026Taming Various Privilege Escalation in LLM-Based Agent Systems: A Mandatory Access Control Framework17 Jan
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan
- 2026Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montage4 Jan
- 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval18 Dec
- 2025Penetration Testing of Agentic AI: A Comparative Security Analysis Across Models and Frameworks16 Dec
- 2025Topology Matters: Measuring Memory Leakage in Multi-Agent LLMs4 Dec
- 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems7 Nov
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct
- 2025MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agents14 Oct
- 2025A Survey on Agentic Security: Applications, Threats and Defenses7 Oct
- 2025Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition28 Jul
- 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms8 Jul
- 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems16 Jun
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems4 Jun
- 2025Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agents28 Apr
- 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasures12 Mar
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2025UDora: A Unified Red Teaming Framework against LLM Agents by Dynamically Hijacking Their Own Reasoning28 Feb
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
- 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
- 2025Automating Prompt Leakage Attacks on Large Language Models Using Agentic Approach18 Feb
- 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
- 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents17 Dec
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
- 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb
- 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast13 Feb
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
Other references · 39
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
27 more
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2024Alignment faking in large language modelscited by 316
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
- 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 122
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinkingcited by 94
- 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
- 2024Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systemscited by 76
- 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Modelscited by 74
- 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 54
- 2025Demonstrating specification gaming in reasoning modelscited by 48
- 2025ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMscited by 23
- 2025ThinkTrap: Denial-of-Service Attacks against Black-box LLM Services via Infinite Thinkingcited by 22
- 2025ETDI: Mitigating Tool Squatting and Rug Pull Attacks in Model Context Protocol (MCP) by using OAuth-Enhanced Tool Definitions and Policy-Based Access Controlcited by 18
- 2025When MCP Servers Attack: Taxonomy, Feasibility, and Mitigationcited by 17
- 2026Colosseum: Auditing Collusion in Cooperative Multi-Agent Systemscited by 17
- 2026Overcoming the Retrieval Barrier: Indirect Prompt Injection in the Wild for LLM Systemscited by 16
- 2025Large Reasoning Models Are Autonomous Jailbreak Agentscited by 12
- 2026Robust Multi-Agent LLMs under Byzantine Faultscited by 10
- 2025From Promise to Peril: Rethinking Cybersecurity Red and Blue Teaming in the Age of LLMscited by 9
- 2025One Token Embedding Is Enough to Deadlock Your Large Reasoning Modelcited by 4
- 2026Five Queries Are Enough: Query-Efficient and Surrogate-Free Membership Inference Attacks on RAG via Entailmentcited by 4
- 2026Voluntary Collusion with Secret Tools in Competing LLM Agentscited by 4
- 2026Byzantine Cheap Talk: Adversarial Resilience and Topology Effects in LLM Coordination Gamescited by 3
- 2026Shifting from Injection to Interaction: Rethinking Web Security in the Age of LLMs and Beyondcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Framework
- 2025Systems Security Foundations for Agentic Computing
- 2026Trustworthy Agentic AI: A Comprehensive Cybersecurity and Systems Survey on Threat Landscapes, Defense Architectures, and Open Challenges
- 2026A Security Analysis of Long-Horizon Agentic AI Systems: Threats, Evaluation, and Framework Development
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security
- 2025The Evolution of Agentic AI in Cybersecurity: From Single LLM Reasoners to Multi-Agent Systems and Autonomous Pipelines
- 2026AgentRiskBOM: A Risk-Scoping Security Bill of Materials for Agentic AI Systems
- 2026Securing Agentic AI: From Per-Action Checks to Trajectory Assurance