UI-Venus-1.5 Technical Report
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
GUI agents have emerged as a powerful paradigm for automating interactions in digital environments, yet achieving both broad generality and consistently strong task performance remains challenging. In this report, we present UI-Venus-1.5, a unified, end-to-end GUI Agent designed for robust real-world applications. The proposed model family comprises two dense variants (2B and 8B) and one mixture-of-experts variant (30B-A3B) to meet various downstream application scenarios. Compared to our previous version, UI-Venus-1.5 introduces three key technical advances: (1) a comprehensive Mid-Training stage leveraging 10 billion tokens across 30+ datasets to establish foundational GUI semantics; (2) Online Reinforcement Learning with full-trajectory rollouts, aligning training objectives with long-horizon, dynamic navigation in large-scale environments; and (3) a single unified GUI Agent constructed via Model Merging, which synthesizes domain-specific models (grounding, web, and mobile) into one cohesive checkpoint. Extensive evaluations demonstrate that UI-Venus-1.5 establishes new state-of-the-art performance on benchmarks such as ScreenSpot-Pro (69.6%), VenusBench-GD (75.0%), and AndroidWorld (77.6%), significantly outperforming previous strong baselines. In addition, UI-Venus-1.5 demonstrates robust navigation capabilities across a variety of Chinese mobile apps, effectively executing user instructions in real-world scenarios. Code: https://github.com/inclusionAI/UI-Venus; Model: https://huggingface.co/collections/inclusionAI/ui-venus
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 61 of its 71 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
61 of 71 references.
Closest ancestors · 34
Same direction, newest first
- 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution28 Jan
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
- 2025VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks18 Dec
- 2025Step-GUI Technical Report17 Dec
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025UItron: Foundational GUI Agent with Advanced Perception and Planning29 Aug
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
- 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents25 Jul
- 2025LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization11 Jun
- 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents3 Jun
- 2025UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents27 May
22 more
- 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
- 2025GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents21 May
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
- 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning18 May
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents1 Apr
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment20 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis27 Dec
- 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024AutoGLM: Autonomous Foundation Agents for GUIs28 Oct
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human10 Oct
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024On the Effects of Data Scale on UI Control Agents6 Jun
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration3 Jun
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
Other references · 27
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
15 more
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
- 2023Deep Model Fusion: A Surveycited by 89
- 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 68
- 2025Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Modelcited by 50
- 2025TGRPO :Fine-tuning Vision-Language-Action Model via Trajectory-wise Group Relative Policy Optimizationcited by 47
- 2025Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundationcited by 32
- 2025Think Twice, Click Once: Enhancing GUI Grounding via Fast and Slow Systemscited by 23
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 21
- 2024E-ANT: A Large-Scale Dataset for Efficient Automatic GUI NavigaTioncited by 11
- 2025MVP: Multiple View Prediction Improves GUI Groundingcited by 10
- 2023Mobile User Interface Element Detection Via Adaptively Prompt Tuningcited by 8
- 2025Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Groundingcited by 7
- 2026Unified Generation and Self-Verification for Vision-Language Models via Advantage Decoupled Preference Optimizationcited by 5
Built on by
Citing papers per year: 2026: 39.
39 papers.
Sort:
By area:
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 19
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 13
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokenscited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
- 2026Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Groundingcited by 9
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 9
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applicationscited by 8
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agentscited by 8
27 more
- 2026UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agentscited by 7
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimizationcited by 5
- 2026Xiaomi-GUI-0 Technical Reportcited by 5
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving Statescited by 5
- 2026Mem-W: Latent Memory-Native GUI Agentscited by 3
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agentscited by 3
- 2026Scaling GUI Agents with Visual State Transitionscited by 3
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillationcited by 3
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injectioncited by 1
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agentscited by 1
- 2026MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Managementcited by 1
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Groundingcited by 1
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agentscited by 1
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrationscited by 1
- 2026Wuying-Browser-Agent: Real-World Centric Fundamental Long-Horizon Browser Agentscited by 1
- 2026UI-Venus-2 Technical Reportcited by 1
- 2026RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Managementcited by 0
- 2026OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agentscited by 0
- 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systemscited by 0
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMscited by 0
- 2026Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agentscited by 0
- 2026ElderBench: Benchmarking Autonomous Mobile Agents for Older Adultscited by 0
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agentscited by 0
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agentscited by 0
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinkscited by 0
- 2026GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitionscited by 0
- 2026Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient Executioncited by 0
- 2026Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient Execution29 Sep 2026
- 2026GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitions28 Sep 2026
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks25 Sep 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults4 Sep 2026
- 2026Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents3 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026Wuying-Browser-Agent: Real-World Centric Fundamental Long-Horizon Browser Agents18 Aug 2026
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations16 Aug 2026
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents6 Aug 2026
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs4 Aug 2026
27 more
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation31 Jul 2026
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents30 Jul 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents16 Jul 2026
- 2026UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agents5 Jul 2026
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States30 Jun 2026
- 2026Xiaomi-GUI-0 Technical Report30 Jun 2026
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding29 Jun 2026
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimization18 Jun 2026
- 2026MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Management18 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems28 May 2026
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agents28 May 2026
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications26 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents18 May 2026
- 2026Mem-W: Latent Memory-Native GUI Agents10 May 2026
- 2026Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding1 May 2026
- 2026OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents27 Apr 2026
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis16 Apr 2026
- 2026RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Management15 Apr 2026
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents13 Apr 2026
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents12 Apr 2026
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation9 Apr 2026
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection9 Apr 2026
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokens30 Mar 2026
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience25 Mar 2026
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 19
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 13
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
- 2026Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Groundingcited by 9
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 9
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applicationscited by 8
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agentscited by 8
- 2026UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agentscited by 7
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimizationcited by 5
12 most cited of 30 All 30 (JSON)
- 2026GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitions28 Sep 2026
- 2026From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks25 Sep 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults4 Sep 2026
- 2026Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents3 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations16 Aug 2026
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents6 Aug 2026
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation31 Jul 2026
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents30 Jul 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
12 newest of 30 All 30 (JSON)
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokenscited by 11
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agentscited by 3
- 2026OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agentscited by 0
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents16 Jul 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents27 Apr 2026
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokens30 Mar 2026
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agentscited by 1
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Groundingcited by 1
- 2026Wuying-Browser-Agent: Real-World Centric Fundamental Long-Horizon Browser Agentscited by 1
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMscited by 0
- 2026Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient Executioncited by 0
- 2026Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient Execution29 Sep 2026
- 2026Wuying-Browser-Agent: Real-World Centric Fundamental Long-Horizon Browser Agents18 Aug 2026
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs4 Aug 2026
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding29 Jun 2026
- 2026PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agents28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration
- 2025UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
- 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitants
- 2025GUI Exploration Lab: Enhancing Screen Navigation in Agents via Multi-Turn Reinforcement Learning
- 2025UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learning
- 2024Falcon-UI: Understanding GUI Before Following User Instructions
- 2025A Survey on GUI Agents with Foundation Models Enhanced by Reinforcement Learning
- 2025CRAFT-GUI: Curriculum-Reinforced Agent For GUI Tasks