MobileUse: A GUI Agent with Hierarchical Reflection for Autonomous Mobile Operation
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Recent advances in Multimodal Large Language Models (MLLMs) have enabled the development of mobile agents that can understand visual inputs and follow user instructions, unlocking new possibilities for automating complex tasks on mobile devices. However, applying these models to real-world mobile scenarios remains a significant challenge due to the long-horizon task execution, difficulty in error recovery, and the cold-start problem in unfamiliar environments. To address these challenges, we propose MobileUse, a GUI agent designed for robust and adaptive mobile task execution. To improve resilience in long-horizon tasks and dynamic environments, we introduce a hierarchical reflection architecture that enables the agent to self-monitor, detect, and recover from errors across multiple temporal scales-ranging from individual actions to overall task completion-while maintaining efficiency through a reflection-on-demand strategy. To tackle cold-start issues, we further introduce a proactive exploration module, which enriches the agent's understanding of the environment through self-planned exploration. Evaluations on AndroidWorld and AndroidLab benchmarks demonstrate that MobileUse establishes new state-of-the-art performance, achieving success rates of 62.9% and 44.2%, respectively. To facilitate real-world applications, we release an out-of-the-box toolkit for automated task execution on physical mobile devices, which is available at https://github.com/MadeAgents/mobile-use.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 39 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
29 of 39 references.
Closest ancestors · 12
Same direction, newest first
- 2025AndroidGen: Building an Android Language Agent under Data Scarcity27 Apr
- 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents1 Apr
- 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment20 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan
- 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection8 Jan
- 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human10 Oct
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration3 Jun
- 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
Other references · 17
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
- 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 178
- 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
- 2023BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questionscited by 125
5 more
- 2024Ferret-UI 2: Mastering Universal User Interface Understanding Across Platformscited by 51
- 2023FuseCap: Leveraging Large Language Models for Enriched Fused Image Captionscited by 33
- 2023Improving Image Captioning Descriptiveness by Ranking and LLM-based Fusioncited by 21
- 2025MobileSteward: Integrating Multiple App-Oriented Agents with Self-Evolution to Automate Cross-App Instructionscited by 16
- 2025AppVLM: A Lightweight Vision Language Model for Online App Controlcited by 15
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 50
- 2026Don't Act Blindly: Robust GUI Automation via Action-Effect Verification and Self-Correctioncited by 14
- 2025ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaborationcited by 11
- 2025Say One Thing, Do Another? Diagnosing Reasoning-Execution Gaps in VLM-Powered Mobile-Use Agentscited by 4
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agentscited by 2
- 2026Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actionscited by 1
- 2026Reflection with Action-Induced Visual Differences for Desktop GUI Agentscited by 0
- 2026PhoneCLI: From App Interfaces to Callable Commands for Mobile Agentscited by 0
- 2026PhoneCLI: From App Interfaces to Callable Commands for Mobile Agents28 Sep 2026
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents15 Sep 2026
- 2026Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions6 Sep 2026
- 2026Reflection with Action-Induced Visual Differences for Desktop GUI Agents25 Aug 2026
- 2026Don't Act Blindly: Robust GUI Automation via Action-Effect Verification and Self-Correction7 Apr 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025Say One Thing, Do Another? Diagnosing Reasoning-Execution Gaps in VLM-Powered Mobile-Use Agents2 Oct 2025
- 2025ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaboration26 Sep 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Agent-SAMA: State-Aware Mobile Assistant
- 2025ReInAgent: A Context-Aware GUI Agent Enabling Human-in-the-Loop Mobile Task Navigation
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
- 2026PalmClaw: A Native On-Device Agent Framework for Mobile Phones
- 2026StepReflect: Structured UI Transition Reflection for Mobile GUI Agents
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
- 2024MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficient Mobile Task Automation
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis