mlsanityData to 7 Oct 2026

PROACT-Agent: Progressive Runtime Oversight and Active Circuit-breaking for Real-Time Safety

arXiv 2609.34415 ↗First posted 28 Sep 2026cs.LGcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

The transition from Large Language Models (LLMs) to agents shifts safety stakes from toxic text to irreversible environmental harm. While current defenses remain largely retrospective, proactive runtime intervention is bottlenecked by the lack of large-scale, causally-consistent data. We propose PROACT-Agent, a framework for synthesizing high-fidelity trajectories to enable real-time guardrails. We identify a critical "safety drift" in prior benchmarks, where lenient annotation paradigms fail to enforce temporal consistency. PROACT-Agent addresses this through: (1) Progressive Trajectory Unrolling to reveal risks hidden in long-context interactions; (2) Reasoning-Augmented Causal Rectification to enforce monotonic causal consistency; and (3) Culturally-Aware Data Localization for cross-border robustness. We introduce PROACT-Bench, a bilingual safety benchmark with 155,780 states labeled through multi-model adjudication. Evaluating updated context before the next LLM inference, the trained guard achieves 91.46% unsafe-class F1 and 90.63% exact-boundary detection under complete source holdout. In AgentDojo, it reduces non-DoS targeted attack success from 20.82% to 0.40%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 37 of its 54 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

37 of 54 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security26 Jan
  2. 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedback15 Jan
  3. 2025A Safety and Security Framework for Real-World Agentic Systems27 Nov
  4. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data10 Oct
  5. 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
  6. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
  7. 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
  8. 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models29 May
  9. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
  10. 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
  11. 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
  12. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
4 more
  1. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  2. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning13 Jun
  3. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
  4. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan

Other references · 21

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  8. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  9. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  10. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  11. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  12. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
9 more
  1. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  2. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 224
  3. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 142
  4. 2025Qwen3Guard Technical Reportcited by 125
  5. 2024ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stagescited by 77
  6. 2025PolyGuard: A Multilingual Safety Moderation Tool for 17 Languagescited by 57
  7. 2025AI-Trader: Benchmarking Autonomous Agents in Real-Time Financial Marketscited by 23
  8. 2025SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMscited by 21
  9. 2025Are Your Agents Upward Deceivers?cited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
  2. 2025ProbGuard: Proactive Runtime Monitoring for LLM Agent Safety via Probabilistic Prediction
  3. 2026ProAct: A Benchmark and Multimodal Framework for Structure-Aware Proactive Response
  4. 2026Agent Safety From Within: Detecting Harmful Trajectories from LLM Internal States
  5. 2026DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model
  6. 2026Enhancing Agent Safety Judgment: Controlled Benchmark Rewriting and Analogical Reasoning for Deceptive Out-of-Distribution Scenarios
  7. 2026TraceSafe: A Systematic Assessment of LLM Guardrails on Multi-Step Tool-Calling Trajectories
  8. 2026PreAct-Bench: Benchmarking Predictive Monitoring in LLMs