mlsanityData to 7 Oct 2026

UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience

arXiv 2603.24533 ↗First posted 25 Mar 2026cs.LG cs.AI cs.CVcited by 11

On the map: LLM agents and tool use → GUI and mobile agents

also in 1 more
Abstract (arXiv)

Autonomous mobile GUI agents have attracted increasing attention along with the advancement of Multimodal Large Language Models (MLLMs). However, existing methods still suffer from inefficient learning from failed trajectories and ambiguous credit assignment under sparse rewards for long-horizon GUI tasks. To that end, we propose UI-Voyager, a novel two-stage self-evolving mobile GUI agent. In the first stage, we employ Rejection Fine-Tuning (RFT), which enables the continuous co-evolution of data and models in a fully autonomous loop. The second stage introduces Group Relative Self-Distillation (GRSD), which identifies critical fork points in group rollouts and constructs dense step-level supervision from successful trajectories to correct failed ones. Extensive experiments on AndroidWorld show that our 4B model achieves an 81.0% Pass@1 success rate, outperforming numerous recent baselines and exceeding human-level performance. Ablation and case studies further verify the effectiveness of GRSD. Our method represents a significant leap toward efficient, self-evolving, and high-performance mobile GUI automation without expensive manual data annotation.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 100 of its 109 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

100 of 109 references.

Closest ancestors · 32

Same direction, newest first

  1. 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
  2. 2026UI-Venus-1.5 Technical Report9 Feb
  3. 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Training30 Jan
  4. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
  5. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
  6. 2025Step-GUI Technical Report17 Dec
  7. 2025Ferret-UI Lite: Lessons from Building Small On-Device GUI Agents30 Sep
  8. 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
  9. 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agents10 Sep
  10. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
  11. 2025UItron: Foundational GUI Agent with Advanced Perception and Planning29 Aug
  12. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
20 more
  1. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
  2. 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use6 Aug
  3. 2025MobileGUI-RL: Advancing Mobile GUI Agent through Reinforcement Learning in Online Environment8 Jul
  4. 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
  5. 2025GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents21 May
  6. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
  7. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
  8. 2025GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration22 Mar
  9. 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment20 Mar
  10. 2025SpiritSight Agent: Advanced GUI Agent with One Look5 Mar
  11. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  12. 2024GUI Agents: A Survey18 Dec
  13. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
  14. 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
  15. 2024GUICourse: From General Vision Language Models to Versatile GUI Agents17 Jun
  16. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  17. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb
  18. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
  19. 2023You Only Look at Screens: Multimodal Chain-of-Action Agents20 Sep
  20. 2023Mobile-Env: Building Qualified Evaluation Benchmarks for LLM-GUI Interaction14 May

Other references · 68

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2025Qwen3-VL Technical Reportcited by 2,534
  11. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  12. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
38 more
  1. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  2. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  3. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  4. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  5. 2018DeepMind Control Suitecited by 935
  6. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
  7. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
  8. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  9. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  10. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
  11. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  12. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
  13. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
  14. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
  15. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
  16. 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
  17. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
  18. 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 173
  19. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
  20. 2024UFO: A UI-Focused Agent for Windows OS Interactioncited by 147
  21. 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigationcited by 137
  22. 2021AndroidEnv: A Reinforcement Learning Platform for Androidcited by 90
  23. 2019Fully Parameterized Quantile Function for Distributional Reinforcement Learningcited by 87
  24. 2022A data-driven approach for learning to control computerscited by 87
  25. 2024Beyond Browsing: API-Based Web Agentscited by 77
  26. 2023Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorldcited by 65
  27. 2024Large Language Models Empowered Personalized Web Agentscited by 64
  28. 2024MMInA: Benchmarking Multihop Multimodal Internet Agentscited by 55
  29. 2024Ferret-UI 2: Mastering Universal User Interface Understanding Across Platformscited by 51
  30. 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 51
  31. 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
  32. 2024AgentStudio: A Toolkit for Building General Virtual Agentscited by 45
  33. 2026Fast and Effective On-policy Distillation from Reasoning Prefixescited by 43
  34. 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
  35. 2024GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented Understandingcited by 42
  36. 2018Episodic Memory Deep Q-Networkscited by 41
  37. 2025UFO2: The Desktop AgentOScited by 38
  38. 2020Model-based Adversarial Meta-Reinforcement Learningcited by 32

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SE-GA: Memory-Augmented Self-Evolution for GUI Agents
  2. 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Users
  3. 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimization
  4. 2025UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents
  5. 2026Darwin Mobile Agent: A Roadmap for Self-Evolution
  6. 2026StepReflect: Structured UI Transition Reflection for Mobile GUI Agents
  7. 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
  8. 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents