mlsanityData to 14 Oct 2026

Policy-as-Prompt: Turning AI Governance Rules into Guardrails for AI Agents

arXiv 2509.23994 ↗First posted 28 Sep 2025cs.CL cs.AIcited by 14

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

As autonomous AI agents are used in regulated and safety-critical settings, organizations need effective ways to turn policy into enforceable controls. We introduce a regulatory machine learning framework that converts unstructured design artifacts (like PRDs, TDDs, and code) into verifiable runtime guardrails. Our Policy as Prompt method reads these documents and risk controls to build a source-linked policy tree. This tree is then compiled into lightweight, prompt-based classifiers for real-time runtime monitoring. The system is built to enforce least privilege and data minimization. For conformity assessment, it provides complete provenance, traceability, and audit logging, all integrated with a human-in-the-loop review process. Evaluations show our system reduces prompt-injection risk, blocks out-of-scope requests, and limits toxic outputs. It also generates auditable rationales aligned with AI governance frameworks. By treating policies as executable prompts (a policy-as-code for agents), this approach enables secure-by-design deployment, continuous compliance, and scalable AI safety and AI security assurance for regulatable ML.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 11 of its 14 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

11 of 14 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025CAPTURE: Context-Aware Prompt Injection Testing and Robustness Enhancement18 May
  2. 2023Prompt Injection attack against LLM-integrated Applications8 Jun

Other references · 9

  1. 2023ProPILE: Probing Privacy Leakage in Large Language Modelscited by 129
  2. 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
  3. 2024Building Guardrails for Large Language Modelscited by 65
  4. 2024TrustAgent: Towards Safe and Trustworthy LLM-based Agentscited by 64
  5. 2024Large Language Model Agent in Financial Trading: A Surveycited by 60
  6. 2025Contextual Agent Security: A Policy for Every Purposecited by 59
  7. 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attackscited by 49
  8. 2024SCULPT: Systematic Tuning of Long Promptscited by 9
  9. 2024AI Act and Large Language Models (LLMs): When critical issues and privacy impact require human and ethical oversightcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 13.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Executable Governance for AI: Translating Policies into Rules Using LLMs
  2. 2025Learning Efficient Guardrails for Compliance
  3. 2026AdaGuard: Enhancing Safety and Policy Compliance with Reasoning-Enabled LLM-As-A-Judge Guardrails
  4. 2026LPG: Balancing Efficiency and Policy Reasoning in Latent Policy Guardrails
  5. 2026PolicyGuard: Prompt-Configurable Semantic DLP for LLM Coding Agents
  6. 2026Don't Make Models Guess Security and Safety: Symbolic Guardrails for Domain-Specific AI Agents
  7. 2026Runtime Governance for AI Agents: Policies on Paths
  8. 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification