mlsanityData to 14 Oct 2026

Securing Generative AI Agentic Workflows: Risks, Mitigation, and a Proposed Firewall Architecture

arXiv 2506.17266 ↗First posted 10 Jun 2025cs.CRcited by 2

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Generative Artificial Intelligence (GenAI) presents significant advancements but also introduces novel security challenges, particularly within agentic workflows where AI agents operate autonomously. These risks escalate in multi-agent systems due to increased interaction complexity. This paper outlines critical security vulnerabilities inherent in GenAI agentic workflows, including data privacy breaches, model manipulation, and issues related to agent autonomy and system integration. It discusses key mitigation strategies such as data encryption, access control, prompt engineering, model monitoring, agent sandboxing, and security audits. Furthermore, it details a proposed "GenAI Security Firewall" architecture designed to provide comprehensive, adaptable, and efficient protection for these systems by integrating various security services and leveraging GenAI itself for enhanced defense. Addressing these security concerns is paramount for the responsible and safe deployment of this transformative technology.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 5 of its 9 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

5 of 9 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr

Other references · 4

  1. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  2. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  3. 2024Review of Generative AI Methods in Cybersecuritycited by 9
  4. 2025The Self-Learning Agent with a Progressive Neural Network Integrated Transformercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agents
  2. 2026From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI
  3. 2025Securing GenAI Multi-Agent Systems Against Tool Squatting: A Zero Trust Registry-Based Approach
  4. 2026From Alignment to Access Control: A Framework for GenAI Policy Enforcement
  5. 2023Identifying and Mitigating the Security Risks of Generative AI
  6. 2025GenAI Security: Outsmarting the Bots with a Proactive Testing Framework
  7. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
  8. 2026Authenticated Workflows: A Systems Approach to Protecting Agentic AI