mlsanityData to 7 Oct 2026

Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agents

arXiv 2504.19956 ↗First posted 28 Apr 2025cs.CR cs.AIcited by 32

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

As generative AI (GenAI) agents become more common in enterprise settings, they introduce security challenges that differ significantly from those posed by traditional systems. These agents are not just LLMs; they reason, remember, and act, often with minimal human oversight. This paper introduces a comprehensive threat model tailored specifically for GenAI agents, focusing on how their autonomy, persistent memory access, complex reasoning, and tool integration create novel risks. This research work identifies 9 primary threats and organizes them across five key domains: cognitive architecture vulnerabilities, temporal persistence threats, operational execution vulnerabilities, trust boundary violations, and governance circumvention. These threats are not just theoretical they bring practical challenges such as delayed exploitability, cross-system propagation, cross system lateral movement, and subtle goal misalignments that are hard to detect with existing frameworks and standard approaches. To help address this, the research work present two complementary frameworks: ATFAA - Advanced Threat Framework for Autonomous AI Agents, which organizes agent-specific risks, and SHIELD, a framework proposing practical mitigation strategies designed to reduce enterprise exposure. While this work builds on existing work in LLM and AI security, the focus is squarely on what makes agents different and why those differences matter. Ultimately, this research argues that GenAI agents require a new lens for security. If we fail to adapt our threat models and defenses to account for their unique architecture and behavior, we risk turning a powerful new tool into a serious enterprise liability.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 4 of its 21 references that are in the map. First posted on arXiv 28 Apr 2025.

Builds on

4 of 21 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Safeguarding AI Agents: Developing and Analyzing Safety Architectures3 Sep
  2. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
  3. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul

Other references · 1

  1. 2024Towards Effective GenAI Multi-Agent Collaboration: Design and Evaluation for Enterprise Applicationscited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 18.

32 papers.

Sort:

By area:

  1. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
  2. 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
  3. 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agentscited by 28
  4. 2026A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypescited by 19
  5. 2025ETDI: Mitigating Tool Squatting and Rug Pull Attacks in Model Context Protocol (MCP) by using OAuth-Enhanced Tool Definitions and Policy-Based Access Controlcited by 18
  6. 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 17
  7. 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomycited by 14
  8. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 13
  9. 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltrationcited by 12
  10. 2025Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigmscited by 7
  11. 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
  12. 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Securitycited by 7
20 more
  1. 2025Federation of Agents: A Semantics-Aware Communication Fabric for Large-Scale Agentic AIcited by 6
  2. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
  3. 2025ATAG: AI-Agent Application Threat Assessment with Attack Graphscited by 4
  4. 2025Fortifying the Agentic Web: A Unified Zero-Trust Architecture Against Logic-layer Threatscited by 3
  5. 2026Clawed and Dangerous: Can We Trust Open Agentic Systems?cited by 3
  6. 2025Analyzing Code Injection Attacks on LLM-based Multi-Agent Systems in Software Developmentcited by 2
  7. 2026Human Society-Inspired Approaches to Agentic AI Security: The 4C Frameworkcited by 2
  8. 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
  9. 2025Towards Unifying Quantitative Security Benchmarking for Multi Agent Systemscited by 1
  10. 2025Reflection-Driven Control for Trustworthy Code Agentscited by 1
  11. 2026Differential Privacy in Generative AI Agents: Analysis and Optimal Tradeoffscited by 1
  12. 2026Parallax: Why AI Agents That Think Must Never Actcited by 1
  13. 2026Intellicise Wireless Networks Meet Agentic AI: A Security and Privacy Perspectivecited by 0
  14. 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agentscited by 0
  15. 2026Security Risks in Tool-Enabled AI Agents: A Systematic Analysis of Privileged Execution Environmentscited by 0
  16. 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systemscited by 0
  17. 2026Agent Security Meets Regulatory Reality -- A Practitioner Systematization of Autonomous-Agent Threats and Controls in Regulated Financial Systemscited by 0
  18. 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
  19. 2026Beyond the Mandate: A Systematic Security Analysis of the Agent Payments Protocol (AP2)cited by 0
  20. 2026Connecting the Dots in Agentic AI Security: A Cross-Dimensional Threat Taxonomy, Evaluation Maturity, and Open Challengescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Securing Generative AI Agentic Workflows: Risks, Mitigation, and a Proposed Firewall Architecture
  2. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
  3. 2026From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI
  4. 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey
  5. 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Framework
  6. 2026Security Considerations for Multi-agent Systems
  7. 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security
  8. 2025A Safety and Security Framework for Real-World Agentic Systems