UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience
On the map: LLM agents and tool use → GUI and mobile agents
also in 1 more
Abstract (arXiv)
Autonomous mobile GUI agents have attracted increasing attention along with the advancement of Multimodal Large Language Models (MLLMs). However, existing methods still suffer from inefficient learning from failed trajectories and ambiguous credit assignment under sparse rewards for long-horizon GUI tasks. To that end, we propose UI-Voyager, a novel two-stage self-evolving mobile GUI agent. In the first stage, we employ Rejection Fine-Tuning (RFT), which enables the continuous co-evolution of data and models in a fully autonomous loop. The second stage introduces Group Relative Self-Distillation (GRSD), which identifies critical fork points in group rollouts and constructs dense step-level supervision from successful trajectories to correct failed ones. Extensive experiments on AndroidWorld show that our 4B model achieves an 81.0% Pass@1 success rate, outperforming numerous recent baselines and exceeding human-level performance. Ablation and case studies further verify the effectiveness of GRSD. Our method represents a significant leap toward efficient, self-evolving, and high-performance mobile GUI automation without expensive manual data annotation.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 100 of its 109 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
100 of 109 references.
Closest ancestors · 32
Same direction, newest first
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
- 2026UI-Venus-1.5 Technical Report9 Feb
- 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Training30 Jan
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
- 2025Step-GUI Technical Report17 Dec
- 2025Ferret-UI Lite: Lessons from Building Small On-Device GUI Agents30 Sep
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
- 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agents10 Sep
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025UItron: Foundational GUI Agent with Advanced Perception and Planning29 Aug
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
20 more
- 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
- 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use6 Aug
- 2025MobileGUI-RL: Advancing Mobile GUI Agent through Reinforcement Learning in Online Environment8 Jul
- 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
- 2025GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents21 May
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2025GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration22 Mar
- 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment20 Mar
- 2025SpiritSight Agent: Advanced GUI Agent with One Look5 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024GUI Agents: A Survey18 Dec
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
- 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agents17 Jun
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023You Only Look at Screens: Multimodal Chain-of-Action Agents20 Sep
- 2023Mobile-Env: Building Qualified Evaluation Benchmarks for LLM-GUI Interaction14 May
Other references · 68
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
38 more
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2018DeepMind Control Suitecited by 935
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
- 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 173
- 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
- 2024UFO: A UI-Focused Agent for Windows OS Interactioncited by 147
- 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigationcited by 137
- 2021AndroidEnv: A Reinforcement Learning Platform for Androidcited by 90
- 2019Fully Parameterized Quantile Function for Distributional Reinforcement Learningcited by 87
- 2022A data-driven approach for learning to control computerscited by 87
- 2024Beyond Browsing: API-Based Web Agentscited by 77
- 2023Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorldcited by 65
- 2024Large Language Models Empowered Personalized Web Agentscited by 64
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agentscited by 55
- 2024Ferret-UI 2: Mastering Universal User Interface Understanding Across Platformscited by 51
- 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 51
- 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
- 2024AgentStudio: A Toolkit for Building General Virtual Agentscited by 45
- 2026Fast and Effective On-policy Distillation from Reasoning Prefixescited by 43
- 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
- 2024GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented Understandingcited by 42
- 2018Episodic Memory Deep Q-Networkscited by 41
- 2025UFO2: The Desktop AgentOScited by 38
- 2020Model-based Adversarial Meta-Reinforcement Learningcited by 32
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Code as Agent Harnesscited by 40
- 2026Scaling Self-Evolving Agents via Parametric Memorycited by 3
- 2026Scaling GUI Agents with Visual State Transitionscited by 3
- 2026Governed Evolution of Agent Runtimes through Executable Operational Cognitioncited by 2
- 2026AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtreescited by 1
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agentscited by 1
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agentscited by 1
- 2026SynWeaver: Website-Prior Task and Trajectory Co-Synthesis for Web Agentscited by 0
- 2026Beyond Success and Failure: Length-Aware Contrastive Learning for GUI Agentscited by 0
- 2026One Rollout Is All You Get: Fully Test-Time Adaptation for GUI Agentscited by 0
- 2026One Rollout Is All You Get: Fully Test-Time Adaptation for GUI Agents28 Sep 2026
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents15 Sep 2026
- 2026Beyond Success and Failure: Length-Aware Contrastive Learning for GUI Agents22 Aug 2026
- 2026SynWeaver: Website-Prior Task and Trajectory Co-Synthesis for Web Agents12 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents6 Aug 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
- 2026Scaling Self-Evolving Agents via Parametric Memory3 Jun 2026
- 2026Governed Evolution of Agent Runtimes through Executable Operational Cognition26 May 2026
- 2026AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees19 May 2026
- 2026Code as Agent Harness18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026SE-GA: Memory-Augmented Self-Evolution for GUI Agents
- 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Users
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimization
- 2025UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents
- 2026Darwin Mobile Agent: A Roadmap for Self-Evolution
- 2026StepReflect: Structured UI Transition Reflection for Mobile GUI Agents
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents