AgentGuardian: Learning Access Control Policies to Govern AI Agent Behavior
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) agents are increasingly used in a variety of domains to automate tasks, interact with users, and make decisions based on data inputs. Ensuring that AI agents perform only authorized actions and handle inputs appropriately is essential for maintaining system integrity and preventing misuse. In this study, we introduce the AgentGuardian, a novel security framework that governs and protects AI agent operations by enforcing context-aware access-control policies. During a controlled staging phase, the framework monitors execution traces to learn legitimate agent behaviors and input patterns. From this phase, it derives adaptive policies that regulate tool calls made by the agent, guided by both real-time input context and the control flow dependencies of multi-step agent actions. Evaluation across two real-world AI agent applications demonstrates that AgentGuardian effectively detects malicious or misleading inputs while preserving normal agent functionality. Moreover, its control-flow-based governance mechanism mitigates hallucination-driven errors and other orchestration-level malfunctions.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
26 of 40 references.
References · 26
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 341
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
- 2025Defeating Prompt Injections by Designcited by 256
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoningcited by 144
- 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 122
- 2025Progent: Securing AI Agents with Privilege Controlcited by 121
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systemscited by 118
- 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 114
- 2025Securing AI Agents with Information-Flow Controlcited by 108
14 more
- 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspectivecited by 91
- 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detectioncited by 82
- 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakagecited by 64
- 2025DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agentscited by 59
- 2025CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactionscited by 46
- 2023Testing Language Model Agents Safely in the Wildcited by 45
- 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injectioncited by 39
- 2025SAFEFLOW: A Principled Protocol for Trustworthy and Transactional Autonomous Agent Systemscited by 23
- 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
- 2025To Protect the LLM Agent Against the Prompt Injection Attack with Polymorphic Promptcited by 14
- 2025No Free Lunch with Guardrailscited by 10
- 2024Safeguarding AI Agents: Developing and Analyzing Safety Architecturescited by 3
- 2025OneShield -- the Next Generation of LLM Guardrailscited by 3
- 2025Securing AI Agents: Implementing Role-Based Access Control for Industrial Applicationscited by 2
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Before the Tool Call: Deterministic Pre-Action Authorization for Autonomous AI Agentscited by 12
- 2026Reframing LLM Agent Security as an Agent-Human Interaction Problemcited by 8
- 2026Faramesh: A Protocol-Agnostic Execution Control Plane for Autonomous Agent Systemscited by 4
- 2026SafeCommit: Certifying When Memory-Grounded Agents May Safely Actcited by 4
- 2026AESP: A Human-Sovereign Economic Protocol for AI Agents with Privacy-Preserving Settlementcited by 2
- 2026Don't Make Models Guess Security and Safety: Symbolic Guardrails for Domain-Specific AI Agentscited by 1
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Inductioncited by 1
- 2026Autoformalization of Agent Instructions into Policy-as-Codecited by 1
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026SafeCommit: Certifying When Memory-Grounded Agents May Safely Act4 Aug 2026
- 2026Autoformalization of Agent Instructions into Policy-as-Code25 Jun 2026
- 2026Reframing LLM Agent Security as an Agent-Human Interaction Problem23 May 2026
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Induction14 May 2026
- 2026Don't Make Models Guess Security and Safety: Symbolic Guardrails for Domain-Specific AI Agents16 Apr 2026
- 2026Before the Tool Call: Deterministic Pre-Action Authorization for Autonomous AI Agents21 Mar 2026
- 2026AESP: A Human-Sovereign Economic Protocol for AI Agents with Privacy-Preserving Settlement27 Feb 2026
- 2026Faramesh: A Protocol-Agnostic Execution Control Plane for Autonomous Agent Systems25 Jan 2026