mlsanityData to 7 Oct 2026

Formal Policy Enforcement for Real-World Agentic Systems

arXiv 2602.16708 ↗First posted 18 Feb 2026cs.CR cs.AI cs.MAcited by 31

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Security policy enforcement in contemporary agentic systems predominantly consists of embedding natural-language policies within an agent's system prompt and delegating compliance to the agent's reasoning. This approach admits no formal enforcement guarantee and cannot express policies whose satisfaction depends on the causal history of an execution, a gap that becomes acute in multi-agent systems, where enforcement must reason across agents. We argue that policy enforcement in agentic systems is most naturally understood as a cross-cutting concern, and propose a framework grounded in aspect-oriented programming that specifies policies independent of the agent's reasoning and enforces them at every policy-relevant decision. Policies are written in Datalog over a set of abstract predicates describing the execution context, an observability service governed by a formal assume/guarantee contract maintains these predicates, and a reference monitor consults the policy at each action to produce an enforcement decision. When the environment contract holds, enforcement decisions coincide with the policy's intended semantics. We adopt Datalog as the policy language, a natural fit because it supports declarative rule specification, admits recursion for policies over transitive relationships, and yields deterministic enforcement. Datalog further admits tractable static analyses for contradiction, redundancy, subsumption, and conditional reachability, enabling authors to verify policy intent and surface ambiguities inherent in natural-language specifications. We realize the framework in FORGE, which enforces policies over agentic deployments without modification to the underlying agents. We evaluate FORGE on three case studies: information flow policies for prompt injection defense, approval workflows in a multi-agent pharmacovigilance system, and organizational policies for customer service.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 24 of its 61 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

24 of 61 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
  2. 2025Defeating Prompt Injections by Design24 Mar
  3. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  4. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 20

  1. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  4. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  5. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  6. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  7. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
  8. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
  9. 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
  10. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  11. 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 122
  12. 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 109
8 more
  1. 2025Securing AI Agents with Information-Flow Controlcited by 108
  2. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
  3. 2024Cedar: A New Language for Expressive, Fast, Safe, and Analyzable Authorization (Extended Version)cited by 31
  4. 2025A Critical Evaluation of Defenses against Prompt Injection Attackscited by 31
  5. 2017Practical Whole-System Provenance Capturecited by 19
  6. 2025Policy-as-Prompt: Turning AI Governance Rules into Guardrails for AI Agentscited by 12
  7. 2024MALADE: Orchestration of LLM-powered Agents with Retrieval Augmented Generation for Pharmacovigilancecited by 11
  8. 2025How Not to Detect Prompt Injections with an LLMcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 31.

31 papers.

Sort:

By area:

  1. 2026A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecyclecited by 21
  2. 2026Before the Tool Call: Deterministic Pre-Action Authorization for Autonomous AI Agentscited by 12
  3. 2026Reason Less, Verify More: Deterministic Gates Recover a Silent Policy-Violation Failure Mode in Tool-Using LLM Agentscited by 8
  4. 2026Context-to-Execution Integrity for LLM Agentscited by 7
  5. 2026Lingering Authority: Revocable Resource-and-Effect Capabilities for Coding Agentscited by 5
  6. 2026CONTINUITY: Security-Context Contracts for Composable LLM Agent Controlscited by 3
  7. 2026Agent Security is a Systems Problemcited by 2
  8. 2026SecureClaw: Clawing Back Control of LLM Agentscited by 2
  9. 2026Janus: a Playground for User-Involved Agentic Permission Managementcited by 2
  10. 2026How Agents Ask for Permission: User Permissions for AI Agents, from Interfaces to Enforcementcited by 2
  11. 2026CatchBench: When Can an Agent Failure Be Caught?cited by 2
  12. 2026AgentFlow: A Flow-Centric Policy Language and Framework for Securing LLM Agent Systemscited by 2
19 more
  1. 2026Causality Laundering: Denial-Feedback Leakage in Tool-Calling LLM Agentscited by 1
  2. 2026PolicyBank: Evolving Policy Understanding for LLM Agentscited by 1
  3. 2026Owner-Harm: A Missing Threat Model for AI Agent Safetycited by 1
  4. 2026Constraining Host-Level Abuse in Self-Hosted Computer-Use Agents via TEE-Backed Isolationcited by 1
  5. 2026Prompts Don't Protect: Architectural Enforcement via MCP Proxy for LLM Tool Access Controlcited by 1
  6. 2026Efficient and Sound Probabilistic Verification for AI Agentscited by 1
  7. 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happenedcited by 1
  8. 2026The Balkanization of Execution-Security Research for AI Coding Agents: Isolation, Access Control, and Time-of-Check-to-Time-of-Use Vulnerabilitiescited by 0
  9. 2026Verification of Adaptive Agentic Controllers through Finite Rule Revisioncited by 0
  10. 2026Delegation Without Trust: An Empirical Gap Analysis of Identity, Authorization, and Runtime Governance in Multi-Agent LLM Systemscited by 0
  11. 2026Where Reliability Lives: Experimental Localisation of Behavioural Properties in an Agent Systemcited by 0
  12. 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBoundcited by 0
  13. 2026How Strongly Should Task State Influence an LLM Agent?cited by 0
  14. 2026Authorization Closure Graph: Minimal Repair for LLM Agents with Evolving User Instructionscited by 0
  15. 2026Certified Multi-Source Integrity for Structured Agent Actionscited by 0
  16. 2026Audience-Bound Persistent Memory: Authorization Across the Memory Lifecyclecited by 0
  17. 2026Sapien: A Stateful Policy Engine for Autonomous AI Agentscited by 0
  18. 2026PACE: Provenance-Aware Capability Enforcement for Tool-Using LLM Agentscited by 0
  19. 2026NOMOS: Compiling Written Policies into Statically Verified Tool-Call Gates for LLM Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skills
  2. 2025QuadSentinel: Sequent Safety for Machine-Checkable Control in Multi-agent Systems
  3. 2026Autoformalization of Agent Instructions into Policy-as-Code
  4. 2026Alignment Contracts for Agentic Security Systems
  5. 2026Runtime Governance for AI Agents: Policies on Paths
  6. 2026ETAS: An Effect-Typed Language for Agent Systems
  7. 2025ARPaCCino: An Agentic-RAG for Policy as Code Compliance
  8. 2026STAGE: Stateful Translation to Agentic Graph Execution with Policy-Scoped Context and Deterministic Control