SCOUT: Synergizing Reasoning and Tool-Use for Computer-Use Safety
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Computer-use agents (CUAs), while capable of completing computer tasks in everyday and professional workflows, can cause unintended harm even under benign instructions and environments. However, detecting such harm remains challenging. First, it requires careful, task-specific reasoning: verifiers guided only by general safety criteria often overlook many important but subtle harmful behaviors. Second, it requires active investigation: past trajectory screenshots show what the agent did but not always what actually changed in the environment, so LLM-as-a-judge verifiers that rely on screenshots alone may be unable to determine the actual consequences of actions. To address these challenges, we introduce SCOUT, a two-stage agentic safety verifier that synergizes reasoning-intensive rubric generation with tool-intensive evidence gathering. First, our SCOUT rubric generator extensively reasons over the task and the agent's trajectory to determine what successful and safe execution should entail, generating task-specific completion and safety rubrics. Then, our SCOUT probing agent follows these rubrics to interact with the post-execution environment and collect grounded evidence for final safety and completion judgments. We evaluate our framework on two computer-use safety benchmarks. On AutoElicit-Bench, SCOUT achieves 75.4 unsafe F1 and 74.5 completion F1, outperforming LLM-as-a-judge verifiers and naive tool-use verifiers. SCOUT leads on OS-Blind with 76.4% unsafe detection accuracy. Test-time reflection reduces final unsafe execution rates from 30.2% to 17.2% on AutoElicit-Bench. Ablations and analysis show that tool-free rubric generation in SCOUT elicits substantially more reasoning and is crucial for safety detection across verifier backbones, especially non-frontier ones. A preliminary extension to coding tasks shows that SCOUT can support safety verification beyond computer-use.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 32 of its 36 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
32 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
- 2024ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning2 Oct
Other references · 30
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
- 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learningcited by 210
- 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 156
- 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 151
- 2024Tree Search for Language Model Agentscited by 148
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agentscited by 104
18 more
- 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judgecited by 75
- 2024DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agentscited by 68
- 2025ZeroGUI: Automating Online GUI Learning at Zero Human Costcited by 44
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agentscited by 34
- 2026OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Taskscited by 29
- 2025OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflowscited by 18
- 2025CUARewardBench: A Benchmark for Evaluating Reward Models on Computer-using Agentcited by 16
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 13
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026SafePred: A Predictive Guardrail for Computer-Using Agents via World Modelscited by 11
- 2026The Art of Building Verifiers for Computer Use Agentscited by 11
- 2025ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaborationcited by 10
- 2025Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directednesscited by 8
- 2026OpenForgeRL: Train Harness-native Agents in Any Environmentcited by 7
- 2026SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspacescited by 5
- 2026Interactive Reward Agent: GUI Task Evaluation via Environment-State Verificationcited by 2
- 2026Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregationcited by 1
- 2026Task-Adaptive Rubrics for GUI Reward Modelingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OSGuard: A Benchmark for Safety in Computer-Use Agents
- 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
- 2026POLAR: Ontology-Guided Risk Prevention for Tool-Calling LLM Agents
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents
- 2026RUBAS: Rubric-Based Reinforcement Learning for Agent Safety
- 2026The Verifier Tax: Horizon Dependent Safety Success Tradeoffs in Tool Using LLM Agents
- 2026AURA-Eval: Evaluation Framework for Acting Under Risk Awareness in LLM Agent Trajectories
- 2026DRAFT: Task Decoupled Latent Reasoning for Agent Safety