RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguards
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Safeguarding language model agents requires assessing complete execution trajectories under context-dependent safety policies. Existing policy-aware safeguards mainly rely on prompting or supervised fine-tuning, limiting their ability to adapt to unseen trajectories and changing policy contexts. We propose RePolicy, an agent safeguard that learns safety-policy invocation through reinforcement learning. Given an agent trajectory and a dynamic policy library, RePolicy invokes the applicable policy and uses its content to produce a policy-grounded rationale and safety judgment. We construct PolicyTraj-20K to support supervised initialization, followed by GRPO with verifiable rewards and policy-context perturbation. Experiments across six agent safety benchmarks show that RePolicy achieves strong overall safety-detection performance and robust policy invocation under varying policy contexts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 28 of its 37 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
28 of 37 references.
Closest ancestors · 14
Same direction, newest first
- 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security28 May
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security17 May
- 2026HINTBench: Horizon-agent Intrinsic Non-attack Trajectory Benchmark15 Apr
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents3 Apr
- 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis2 Apr
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey11 Mar
- 2026Agents of Chaos23 Feb
- 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security26 Jan
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
- 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
2 more
Other references · 14
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2025OpenAI GPT-5 System Cardcited by 989
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
2 more
- 2025Qwen3Guard Technical Reportcited by 155
- 2026LPG: Balancing Efficiency and Policy Reasoning in Latent Policy Guardrailscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AdaGuard: An Adaptive Guard Model with User-defined Policies
- 2024Enhancing Safety in Reinforcement Learning with Human Feedback via Rectified Policy Optimization
- 2026Autoformalization of Agent Instructions into Policy-as-Code
- 2025Safety Representations for Safer Policy Learning
- 2025Agent Safety Alignment via Reinforcement Learning
- 2026Discovering Agentic Safety Specifications from 1-Bit Danger Signals
- 2026From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
- 2026Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use