MirrorGuard: Toward Secure Computer-Use Agents via Simulation-to-Real Reasoning Correction
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large foundation models are integrated into Computer Use Agents (CUAs), enabling autonomous interaction with operating systems through graphical user interfaces (GUIs) to perform complex tasks. This autonomy introduces serious security risks: malicious instructions or visual prompt injections can trigger unsafe reasoning and cause harmful system-level actions. Existing defenses, such as detection-based blocking, prevent damage but often abort tasks prematurely, reducing agent utility. In this paper, we present MirrorGuard, a plug-and-play defense framework that uses simulation-based training to improve CUA security in the real world. To reduce the cost of large-scale training in operating systems, we propose a novel neural-symbolic simulation pipeline, which generates realistic, high-risk GUI interaction trajectories entirely in a text-based simulated environment, which captures unsafe reasoning patterns and potential system hazards without executing real operations. In the simulation environment, MirrorGuard learns to intercept and rectify insecure reasoning chains of CUAs before they produce and execute unsafe actions. In real-world testing, extensive evaluations across diverse benchmarks and CUA architectures show that MirrorGuard significantly mitigates security risks. For instance, on the ByteDance UI-TARS system, it reduces the unsafe rate from 66.5% to 13.0% while maintaining a marginal false refusal rate (FRR). In contrast, the state-of-the-art GuardAgent only achieves a reduction to 53.9% and suffers from a 15.4% higher FRR. Our work proves that simulation-derived defenses can provide robust, real-world protection while maintaining the fundamental utility of the agent. Our code and model are publicly available at https://bmz-q-q.github.io/MirrorGuard/.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 39 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
17 of 39 references.
Closest ancestors · 6
Same direction, newest first
- 2025Agentic Misalignment: How LLMs Could Be Insider Threats5 Oct
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
- 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
- 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction16 May
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
Other references · 11
- 2023GPT-4 Technical Reportcited by 18,132
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 368
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
- 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 101
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
- 2025Towards Trustworthy GUI Agents: A Surveycited by 33
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injectionscited by 3
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliabilitycited by 0
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agentscited by 0
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agents27 Aug 2026
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections14 May 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents12 Apr 2026
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience25 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Systematization of Security Vulnerabilities in Computer Use Agents
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agents
- 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agents
- 2026CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents
- 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks
- 2026OSGuard: A Benchmark for Safety in Computer-Use Agents
- 2026SIR: Self-improving Red-teaming for Compute Use Agents
- 2025AgentSentinel: An End-to-End and Real-Time Security Defense Framework for Computer-Use Agents