Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
As generative AI (GenAI) agents become more common in enterprise settings, they introduce security challenges that differ significantly from those posed by traditional systems. These agents are not just LLMs; they reason, remember, and act, often with minimal human oversight. This paper introduces a comprehensive threat model tailored specifically for GenAI agents, focusing on how their autonomy, persistent memory access, complex reasoning, and tool integration create novel risks. This research work identifies 9 primary threats and organizes them across five key domains: cognitive architecture vulnerabilities, temporal persistence threats, operational execution vulnerabilities, trust boundary violations, and governance circumvention. These threats are not just theoretical they bring practical challenges such as delayed exploitability, cross-system propagation, cross system lateral movement, and subtle goal misalignments that are hard to detect with existing frameworks and standard approaches. To help address this, the research work present two complementary frameworks: ATFAA - Advanced Threat Framework for Autonomous AI Agents, which organizes agent-specific risks, and SHIELD, a framework proposing practical mitigation strategies designed to reduce enterprise exposure. While this work builds on existing work in LLM and AI security, the focus is squarely on what makes agents different and why those differences matter. Ultimately, this research argues that GenAI agents require a new lens for security. If we fail to adapt our threat models and defenses to account for their unique architecture and behavior, we risk turning a powerful new tool into a serious enterprise liability.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 4 of its 21 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
4 of 21 references.
Closest ancestors · 3
Same direction, newest first
- 2024Safeguarding AI Agents: Developing and Analyzing Safety Architectures3 Sep
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
Other references · 1
Built on by
Citing papers per year: 2025: 14; 2026: 18.
32 papers.
Sort:
By area:
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
- 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
- 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agentscited by 28
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 19
- 2025ETDI: Mitigating Tool Squatting and Rug Pull Attacks in Model Context Protocol (MCP) by using OAuth-Enhanced Tool Definitions and Policy-Based Access Controlcited by 18
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 17
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomycited by 14
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 13
- 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltrationcited by 12
- 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigmscited by 7
- 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
- 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Securitycited by 7
20 more
- 2025Federation of Agents: A Semantics-Aware Communication Fabric for Large-Scale Agentic AIcited by 6
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
- 2025ATAG: AI-Agent Application Threat Assessment with Attack Graphscited by 4
- 2025Fortifying the Agentic Web: A Unified Zero-Trust Architecture Against Logic-layer Threatscited by 3
- 2026Clawed and Dangerous: Can We Trust Open Agentic Systems?cited by 3
- 2025Analyzing Code Injection Attacks on LLM-based Multi-Agent Systems in Software Developmentcited by 2
- 2026Human Society-Inspired Approaches to Agentic AI Security: The 4C Frameworkcited by 2
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
- 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systemscited by 1
- 2025Reflection-Driven Control for Trustworthy Code Agentscited by 1
- 2026Differential Privacy in Generative AI Agents: Analysis and Optimal Tradeoffscited by 1
- 2026Parallax: Why AI Agents That Think Must Never Actcited by 1
- 2026Intellicise Wireless Networks Meet Agentic AI: A Security and Privacy Perspectivecited by 0
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agentscited by 0
- 2026Security Risks in Tool-Enabled AI Agents: A Systematic Analysis of Privileged Execution Environmentscited by 0
- 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systemscited by 0
- 2026Agent Security Meets Regulatory Reality -- A Practitioner Systematization of Autonomous-Agent Threats and Controls in Regulated Financial Systemscited by 0
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
- 2026Beyond the Mandate: A Systematic Security Analysis of the Agent Payments Protocol (AP2)cited by 0
- 2026Connecting the Dots in Agentic AI Security: A Cross-Dimensional Threat Taxonomy, Evaluation Maturity, and Open Challengescited by 0
- 2026Connecting the Dots in Agentic AI Security: A Cross-Dimensional Threat Taxonomy, Evaluation Maturity, and Open Challenges20 Sep 2026
- 2026Beyond the Mandate: A Systematic Security Analysis of the Agent Payments Protocol (AP2)24 Aug 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026Agent Security Meets Regulatory Reality -- A Practitioner Systematization of Autonomous-Agent Threats and Controls in Regulated Financial Systems28 Jun 2026
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation9 Jun 2026
- 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security28 May 2026
- 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systems12 May 2026
- 2026Security Risks in Tool-Enabled AI Agents: A Systematic Analysis of Privileged Execution Environments10 May 2026
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agents8 May 2026
- 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltration3 May 2026
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management3 May 2026
- 2026Parallax: Why AI Agents That Think Must Never Act14 Apr 2026
20 more
- 2026Clawed and Dangerous: Can We Trust Open Agentic Systems?27 Mar 2026
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomy24 Mar 2026
- 2026Differential Privacy in Generative AI Agents: Analysis and Optimal Tradeoffs18 Mar 2026
- 2026Intellicise Wireless Networks Meet Agentic AI: A Security and Privacy Perspective17 Feb 2026
- 2026Human Society-Inspired Approaches to Agentic AI Security: The 4C Framework2 Feb 2026
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes8 Jan 2026
- 2025Analyzing Code Injection Attacks on LLM-based Multi-Agent Systems in Software Development26 Dec 2025
- 2025Reflection-Driven Control for Trustworthy Code Agents22 Dec 2025
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence23 Nov 2025
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions29 Oct 2025
- 2025A Survey on Agentic Security: Applications, Threats and Defenses7 Oct 2025
- 2025Federation of Agents: A Semantics-Aware Communication Fabric for Large-Scale Agentic AI24 Sep 2025
- 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Web19 Aug 2025
- 2025Fortifying the Agentic Web: A Unified Zero-Trust Architecture Against Logic-layer Threats17 Aug 2025
- 2025Agentic Web: Weaving the Next Web with AI Agents28 Jul 2025
- 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systems23 Jul 2025
- 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms8 Jul 2025
- 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents30 Jun 2025
- 2025ATAG: AI-Agent Application Threat Assessment with Attack Graphs3 Jun 2025
- 2025ETDI: Mitigating Tool Squatting and Rug Pull Attacks in Model Context Protocol (MCP) by using OAuth-Enhanced Tool Definitions and Policy-Based Access Control2 Jun 2025
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
- 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
- 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agentscited by 28
- 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 19
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 17
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 13
- 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltrationcited by 12
- 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigmscited by 7
- 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
- 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Securitycited by 7
- 2025Federation of Agents: A Semantics-Aware Communication Fabric for Large-Scale Agentic AIcited by 6
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
12 most cited of 28 All 28 (JSON)
- 2026Connecting the Dots in Agentic AI Security: A Cross-Dimensional Threat Taxonomy, Evaluation Maturity, and Open Challenges20 Sep 2026
- 2026Beyond the Mandate: A Systematic Security Analysis of the Agent Payments Protocol (AP2)24 Aug 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026Agent Security Meets Regulatory Reality -- A Practitioner Systematization of Autonomous-Agent Threats and Controls in Regulated Financial Systems28 Jun 2026
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation9 Jun 2026
- 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security28 May 2026
- 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systems12 May 2026
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agents8 May 2026
- 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltration3 May 2026
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management3 May 2026
- 2026Clawed and Dangerous: Can We Trust Open Agentic Systems?27 Mar 2026
- 2026Differential Privacy in Generative AI Agents: Analysis and Optimal Tradeoffs18 Mar 2026
12 newest of 28 All 28 (JSON)
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomycited by 14
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomy24 Mar 2026
- 2026Parallax: Why AI Agents That Think Must Never Actcited by 1
- 2026Parallax: Why AI Agents That Think Must Never Act14 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Securing Generative AI Agentic Workflows: Risks, Mitigation, and a Proposed Firewall Architecture
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
- 2026From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey
- 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Framework
- 2026Security Considerations for Multi-agent Systems
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security
- 2025A Safety and Security Framework for Real-World Agentic Systems