mlsanityData to 14 Oct 2026

Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment

arXiv 2503.15937 ↗First posted 20 Mar 2025cs.AIcited by 38

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

We propose V-Droid, a mobile GUI task automation agent. Unlike previous mobile agents that utilize Large Language Models (LLMs) as generators to directly generate actions at each step, V-Droid employs LLMs as verifiers to evaluate candidate actions before making final decisions. To realize this novel paradigm, we introduce a comprehensive framework for constructing verifier-driven mobile agents: the discretized action space construction coupled with the prefilling-only workflow to accelerate the verification process, the pair-wise progress preference training to significantly enhance the verifier's decision-making capabilities, and the scalable human-agent joint annotation scheme to efficiently collect the necessary data at scale. V-Droid obtains a substantial task success rate across several public mobile task automation benchmarks: 59.5% on AndroidWorld, 38.3% on AndroidLab, and 49% on MobileAgentBench, surpassing existing agents by 5.2%, 2.1%, and 9%, respectively. Furthermore, V-Droid achieves a remarkably low latency of 4.3s per step, which is 6.1x faster compared with existing mobile agents. The source code is available at https://github.com/V-Droid-Agent/V-Droid.

Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 31 of its 42 references that are in the map. First posted on arXiv 20 Mar 2025.

Builds on

31 of 42 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation24 Dec
  2. 2024Ponder & Press: Advancing Visual GUI Agent towards General Computer Control2 Dec
  3. 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
  4. 2024AutoGLM: Autonomous Foundation Agents for GUIs28 Oct
  5. 2024DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agents18 Oct
  6. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human10 Oct
  7. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  8. 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactions5 Aug
  9. 2024MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents12 Jun
  10. 2024Understanding the Weakness of Large Language Model Agents within a Complex Android Environment9 Feb
  11. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
  12. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec

Other references · 19

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2023Let's Verify Step by Stepcited by 3,789
  4. 2024A Survey on LLM-as-a-Judgecited by 1,423
  5. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  6. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
  7. 2024Generative Verifiers: Reward Modeling as Next-Token Predictioncited by 480
  8. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  9. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
  10. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
  11. 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
  12. 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 176
7 more
  1. 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
  2. 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
  3. 2023Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automationcited by 58
  4. 2024Octopus v2: On-device language model for super agentcited by 47
  5. 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 23
  6. 2024MobileAgent: enhancing mobile control via human-machine interaction and SOP integrationcited by 18
  7. 2021AppBuddy: Learning to Accomplish Tasks in Mobile Apps via Reinforcement Learningcited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 24; 2026: 14.

38 papers.

Sort:

By area:

  1. 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agentscited by 43
  2. 2025Web-Shepherd: Advancing PRMs for Reinforcing Web Agentscited by 41
  3. 2026UI-Venus-1.5 Technical Reportcited by 41
  4. 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 32
  5. 2025SafeMobile: Chain-level Jailbreak Detection and Automated Evaluation for Multimodal Mobile Agentscited by 15
  6. 2025Agent-SAMA: State-Aware Mobile Assistantcited by 12
  7. 2025GUI-Shift: Enhancing VLM-Based GUI Agents through Self-supervised Reinforcement Learningcited by 11
  8. 2025ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaborationcited by 11
  9. 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Managementcited by 11
  10. 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
  11. 2025ColorBench: Benchmarking Mobile Agents with Graph-Structured Framework for Complex Long-Horizon Taskscited by 10
  12. 2025MobileUse: A GUI Agent with Hierarchical Reflection for Autonomous Mobile Operationcited by 9
26 more
  1. 2025EcoAgent: An Efficient Device-Cloud Collaborative Multi-Agent Framework for Mobile Automationcited by 8
  2. 2025Mind the Third Eye! Benchmarking Privacy Awareness in MLLM-powered Smartphone Agentscited by 8
  3. 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AIcited by 8
  4. 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agentcited by 7
  5. 2025ProSoftArena: Benchmarking Hierarchical Capabilities of Multimodal Agents in Professional Software Environmentscited by 7
  6. 2026Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolutioncited by 7
  7. 2026StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structurecited by 7
  8. 2025AndroidControl-Curated: Revealing the True Potential of GUI Agents through Benchmark Purificationcited by 6
  9. 2025Mobile GUI Agents under Real-world Threats: Are We There Yet?cited by 5
  10. 2025Building a Stable Planner: An Extended Finite State Machine Based Planning Module for Mobile GUI Agentcited by 4
  11. 2025OpenPhone: Mobile Agentic Foundation Modelscited by 4
  12. 2026UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agentscited by 4
  13. 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbationscited by 3
  14. 2025MobiBench: Multi-Branch, Modular Benchmark for Mobile GUI Agentscited by 3
  15. 2025Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Surveycited by 2
  16. 2025D-Artemis: A Deliberative Cognitive Framework for Mobile GUI Multi-Agentscited by 1
  17. 2025Agent+P: Guiding UI Agents via Symbolic Planningcited by 1
  18. 2026Curiosity Driven Knowledge Retrieval for Mobile Agentscited by 1
  19. 2026AgentLens: Adaptive Visual Modalities for Human-Agent Interaction in Mobile GUI Agentscited by 1
  20. 2026Software Engineering for and with GUI Agentcited by 1
  21. 2026MobileExplorer: Accelerating On-Device Inference for Mobile GUI Agents via Online Explorationcited by 0
  22. 2026StepReflect: Structured UI Transition Reflection for Mobile GUI Agentscited by 0
  23. 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimizationcited by 0
  24. 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agentscited by 0
  25. 2026When Agents See Differently: Exposing UI Desynchronization Threats in Mobile Agentscited by 0
  26. 2026PhoneCLI: From App Interfaces to Callable Commands for Mobile Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Autonomous Large Language Model Agents Enabling Intent-Driven Mobile GUI Testing
  2. 2025VeriSafe Agent: Safeguarding Mobile GUI Agent via Logic-based Action Verification
  3. 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
  4. 2026PalmClaw: A Native On-Device Agent Framework for Mobile Phones
  5. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation
  6. 2026Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions
  7. 2026UI-Venus-2 Technical Report
  8. 2026Jev-Mobile: Jev as an Executor for Mobile GUI Agents