mlsanityData to 7 Oct 2026

HazardAuditor: From Executable Threats to Safer Computer-Use Agents

arXiv 2609.15134 ↗First posted 14 Sep 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Computer-use agents increasingly interact with browsers, terminals, file systems, and external services, introducing safety risks that emerge through runtime behavior rather than generated content alone. Existing guard models target static prompts and responses and are poorly suited to agent execution; existing executable safety platforms produce evaluation verdicts rather than the normalized supervision a guard model needs to learn across heterogeneous agent frameworks. We introduce HazardAuditor, an execution-grounded framework that closes both gaps. Its infrastructure runs heterogeneous agents (Claude Code, Codex, Hermes, and OpenClaw) in controlled environments and normalizes their interactions into a canonical event representation for cross-framework supervision. We further observe that token-level post-training objectives create a structural mismatch for generative guards, causing longer rationales to dominate gradient updates. Guard Policy Optimization (GuardPO) addresses this by converting deterministic safety outcomes into sequence-level advantages and normalizing rationale and verdict regions, making the safety decision the effective unit of optimization. Across multiple benchmarks and heterogeneous computer-use systems, HazardAuditor improves accuracy by up to 16.5 percentage points over the strongest prior guard. Code, models, and evaluation artifacts will be available at https://yunhao-feng.github.io/HazardAuditor/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 30 of its 37 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

30 of 37 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems11 Aug
  2. 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification13 Jul
  3. 2026Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verification2 Jul
  4. 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agents31 May
  5. 2026AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security28 May
  6. 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents3 Apr
  7. 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis2 Apr
  8. 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security26 Jan
  9. 2026INFA-Guard: Mitigating Malicious Propagation via Infection-Aware Safeguarding in LLM-Based Multi-Agent Systems21 Jan
  10. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
  11. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
  12. 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
7 more
  1. 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent18 Feb
  2. 2025AgentGuard: Repurposing Agentic Orchestrator for Safety Evaluation of Tool Orchestration13 Feb
  3. 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents22 Oct
  4. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  5. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  6. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning13 Jun
  7. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan

Other references · 11

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Qwen Technical Reportcited by 3,273
  3. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  4. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
  5. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
  6. 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 248
  7. 2025Qwen3Guard Technical Reportcited by 125
  8. 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Modelscited by 14
  9. 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimizationcited by 11
  10. 2026DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agentscited by 10
  11. 2026Internal Safety Collapse in Frontier Large Language Modelscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OSGuard: A Benchmark for Safety in Computer-Use Agents
  2. 2026SafeAgent: A Runtime Protection Architecture for Agentic Systems
  3. 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents
  4. 2026DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model
  5. 2025WebGuard: Building a Generalizable Guardrail for Web Agents
  6. 2026HARDE: Optimizing Agent Harnesses for Runtime Risk Detection and Execution Control
  7. 2026AgentWall: A Runtime Safety Layer for Local AI Agents
  8. 2025ProbGuard: Proactive Runtime Monitoring for LLM Agent Safety via Probabilistic Prediction