mlsanityData to 7 Oct 2026

ActGov: Governing LLM Agent Actions via Policy-Constrained Validation

arXiv 2609.24446 ↗First posted 21 Sep 2026cs.CR cs.AIcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large language model (LLM) agents increasingly execute long-horizon workflows through external tools, allowing untrusted outputs to influence subsequent actions and exceed user authorization. Existing defenses isolate injected content or constrain execution with predefined plans and static policies, but these approaches are brittle under dynamic workflows and scale poorly across extensible tool ecosystems. In this work, we present ActGov, a runtime enforcement framework that validates each LLM-proposed tool action before it causes external effects. Built on a unified semantic model of authorization, actions, runtime context, and security constraints, the ActGov-Policy component iteratively constructs a policy set from tool specifications, benign tasks, and observed failure traces, with each update verified through SMT-based counterexample checking. At runtime, ActGov-Runtime abstracts each tool call into finite policy records and permits it only if it remains within the task-scoped authorization boundary and satisfies all applicable policies. This per-action enforcement preserves authorization throughout long-horizon, dynamically branching workflows. We evaluate ActGov on the AgentDojo and AgentDyn benchmarks across multiple models and attack configurations. It shows that ActGov consistently reduces the success rate of indirect prompt-injection attacks while preserving task utility, significantly outperforming existing defenses. These results demonstrate that ActGov can enforce fine-grained authorization over dynamic agent executions without relying on the underlying LLM to correctly identify malicious instructions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 15 of its 40 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

15 of 40 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection5 May
  2. 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks31 Mar
  3. 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generation3 Oct
  4. 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injection2 Aug
  5. 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
  6. 2025DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agents13 Jun
  7. 2025Progent: Securing AI Agents with Privilege Control16 Apr
  8. 2025Defeating Prompt Injections by Design24 Mar
  9. 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar

Other references · 6

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  3. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
  4. 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspectivecited by 91
  5. 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 52
  6. 2026AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?cited by 45

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentao: A Policy-Governed Runtime Harness for Embeddable Tool-Using LLM Agents
  2. 2026When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents
  3. 2026AgentFlow: A Flow-Centric Policy Language and Framework for Securing LLM Agent Systems
  4. 2026Toward Safe LLM Agents: A Survey of Specification, Verification, and Enforcement
  5. 2026Solver-Aided Verification of Policy Compliance in Tool-Augmented LLM Agents
  6. 2026From Natural Language Policies to Executable Obligations: A Verification Harness for Dependable In-Car LLM Agents
  7. 2026PolicyBank: Evolving Policy Understanding for LLM Agents
  8. 2025SIEVE: Selective Integrity Verification and Escalation for Defending LLM Agents against Indirect Prompt Injection