mlsanityData to 14 Oct 2026

UI-Venus-2 Technical Report

arXiv 2609.00028 ↗First posted 27 Aug 2026cs.AI cs.CL cs.CVcited by 2

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Multimodal GUI agents have emerged as a promising paradigm for digital task automation, yet transitioning from benchmark-oriented models to dependable real-world applications remains challenging due to limited environment coverage, brittle task construction, and unreliable reward verification. In this work, we present UI-Venus-2, a general-purpose foundation GUI agent designed to operate across mobile, web, and desktop environments through a unified closed-loop reasoning-action framework. To bridge the gap toward practical deployment, we jointly scale three critical dimensions: (1) Environments, expanding coverage to more than 170 multilingual mobile apps and native desktop operating systems; (2) Tasks, employing a deep-research pipeline for function-grounded instruction generation; and (3) Verification, adopting trace-level and sample-level evaluators with visual keypoints and multi-model voting to ensure reliable RL signals for training. Furthermore, we integrate safety-aware mechanisms to ensure controlled execution of consequential actions. By offering a capable, efficient, and open-source foundation, UI-Venus-2 advances the field toward more generalizable, verifiable, and self-reflective agents for real-world applications.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 72 of its 84 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

72 of 84 references.

Closest ancestors · 34

Same direction, newest first

  1. 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation31 Jul
  2. 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents30 Jul
  3. 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents16 Jul
  4. 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL13 Jul
  5. 2026Xiaomi-GUI-0 Technical Report30 Jun
  6. 2026OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks28 Jun
  7. 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents18 Jun
  8. 2026DeskCraft: Benchmarking Desktop Agents on Professional Workflows and Human-in-the-Loop Collaboration2 Jun
  9. 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research25 May
  10. 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis16 Apr
  11. 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation9 Apr
  12. 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
22 more
  1. 2026UI-Venus-1.5 Technical Report9 Feb
  2. 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics6 Feb
  3. 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution28 Jan
  4. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
  5. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
  6. 2025VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks18 Dec
  7. 2025Step-GUI Technical Report17 Dec
  8. 2025Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation28 Sep
  9. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
  10. 2025UItron: Foundational GUI Agent with Advanced Perception and Planning29 Aug
  11. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
  12. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
  13. 2025LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization11 Jun
  14. 2025GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents21 May
  15. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
  16. 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning18 May
  17. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
  18. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
  19. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  20. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis27 Dec
  21. 2024AutoGLM: Autonomous Foundation Agents for GUIs28 Oct
  22. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr

Other references · 38

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2025OpenAI GPT-5 System Cardcited by 989
  3. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
  4. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  5. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  6. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 437
  7. 2026MiMo-V2-Flash Technical Reportcited by 191
  8. 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 174
  9. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agentscited by 116
  10. 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agentscited by 111
  11. 2025GTA1: GUI Test-time Scaling Agentcited by 106
  12. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
26 more
  1. 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 77
  2. 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 63
  3. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
  4. 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 58
  5. 2025Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Modelcited by 55
  6. 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 53
  7. 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websitescited by 45
  8. 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
  9. 2025Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundationcited by 34
  10. 2026GLM-5V-Turbo: Toward a Native Foundation Model for Multimodal Agentscited by 34
  11. 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 22
  12. 2026Odysseys: Benchmarking Web Agents on Realistic Long Horizon Taskscited by 21
  13. 2026MolmoWeb: Open Visual Web Agent and Open Data for the Open Webcited by 19
  14. 2026MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic Environmentscited by 18
  15. 2025BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actionscited by 17
  16. 2025Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM Agentscited by 16
  17. 2025MVP: Multiple View Prediction Improves GUI Groundingcited by 12
  18. 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
  19. 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
  20. 2026Unified Generation and Self-Verification for Vision-Language Models via Advantage Decoupled Preference Optimizationcited by 7
  21. 2025Spatial CAPTCHA: Generatively Benchmarking Spatial Reasoning for Human-Machine Differentiationcited by 3
  22. 2026Next-Gen CAPTCHAs: Leveraging the Cognitive Gap for Scalable and Diverse GUI-Agent Defensecited by 3
  23. 2026AutoFocus: Uncertainty-Aware Active Visual Search for GUI Groundingcited by 3
  24. 2026VISTA: View-Consistent Self-Verified Training for GUI Groundingcited by 3
  25. 2026OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Modelscited by 2
  26. 2026Wuying-Browser-Agent: Real-World Centric Fundamental Long-Horizon Browser Agentscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Survey on (M)LLM-Based GUI Agents
  2. 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents
  3. 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
  4. 2025Breaking the Data Barrier -- Building GUI Agents Through Task Generalization
  5. 2023You Only Look at Screens: Multimodal Chain-of-Action Agents
  6. 2023ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation
  7. 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment
  8. 2026GraphPilot: GUI Task Automation with One-Step LLM Reasoning Powered by Knowledge Graph