mlsanityData to 7 Oct 2026

MirrorGuard: Toward Secure Computer-Use Agents via Simulation-to-Real Reasoning Correction

arXiv 2601.12822 ↗First posted 19 Jan 2026cs.AIcited by 5

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large foundation models are integrated into Computer Use Agents (CUAs), enabling autonomous interaction with operating systems through graphical user interfaces (GUIs) to perform complex tasks. This autonomy introduces serious security risks: malicious instructions or visual prompt injections can trigger unsafe reasoning and cause harmful system-level actions. Existing defenses, such as detection-based blocking, prevent damage but often abort tasks prematurely, reducing agent utility. In this paper, we present MirrorGuard, a plug-and-play defense framework that uses simulation-based training to improve CUA security in the real world. To reduce the cost of large-scale training in operating systems, we propose a novel neural-symbolic simulation pipeline, which generates realistic, high-risk GUI interaction trajectories entirely in a text-based simulated environment, which captures unsafe reasoning patterns and potential system hazards without executing real operations. In the simulation environment, MirrorGuard learns to intercept and rectify insecure reasoning chains of CUAs before they produce and execute unsafe actions. In real-world testing, extensive evaluations across diverse benchmarks and CUA architectures show that MirrorGuard significantly mitigates security risks. For instance, on the ByteDance UI-TARS system, it reduces the unsafe rate from 66.5% to 13.0% while maintaining a marginal false refusal rate (FRR). In contrast, the state-of-the-art GuardAgent only achieves a reduction to 53.9% and suffers from a 15.4% higher FRR. Our work proves that simulation-derived defenses can provide robust, real-world protection while maintaining the fundamental utility of the agent. Our code and model are publicly available at https://bmz-q-q.github.io/MirrorGuard/.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 39 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

17 of 39 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Agentic Misalignment: How LLMs Could Be Insider Threats5 Oct
  2. 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
  3. 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
  4. 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
  5. 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction16 May
  6. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar

Other references · 11

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  5. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
  6. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 368
  7. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
  8. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
  9. 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 101
  10. 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
  11. 2025Towards Trustworthy GUI Agents: A Surveycited by 33

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Systematization of Security Vulnerabilities in Computer Use Agents
  2. 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agents
  3. 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agents
  4. 2026CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents
  5. 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks
  6. 2026OSGuard: A Benchmark for Safety in Computer-Use Agents
  7. 2026SIR: Self-improving Red-teaming for Compute Use Agents
  8. 2025AgentSentinel: An End-to-End and Real-Time Security Defense Framework for Computer-Use Agents