MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
We present MobileGym, a browser-hosted, lightweight, fully controllable environment for everyday mobile use, targeting interaction fidelity without replicating proprietary backends. It enables two capabilities previously out of reach for everyday apps: verifiable outcome signals through deterministic state-based judging over structured JSON state, and scalable online RL through low-cost parallel rollouts. The full environment state is captured, configured, forked, and compared as structured JSON, and a single server can host hundreds of parallel instances, with about 400 MB memory per instance and about 3 s cold start. A layered state model and a declarative task-definition framework keep state programmability and task creation practical at scale, and a single programmatic judging mechanism delivers both deterministic evaluation verdicts and dense RL rewards. The accompanying MobileGym-Bench provides 416 parameterized task templates, including 256 test and 160 train templates, over 28 apps, with deterministic judges and a structured AnswerSheet protocol that avoids free-text matching failures. In a Sim-to-Real case study, GRPO on Qwen3-VL-4B-Instruct gains +12.8 percentage points on the 256-task test set, and on a 59-task real-device signal subset, real-device execution retains 95.1% of the simulation-side training gain. Project page: https://mobilegym.github.io.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 51 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
32 of 51 references.
Closest ancestors · 21
Same direction, newest first
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
- 2026GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training15 Feb
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
- 2025ProBench: Benchmarking GUI Agents with Accurate Process Information12 Nov
- 2025ColorBench: Benchmarking Mobile Agents with Graph-Structured Framework for Complex Long-Horizon Tasks16 Oct
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025MVISU-Bench: Benchmarking Mobile Agents for Real-World Tasks by Multi-App, Vague, Interactive, Single-App and Unethical Instructions12 Aug
- 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training25 Jun
- 2025Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Scheduling System10 Jun
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agents4 Jun
- 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning2 Jun
9 more
- 2025UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents27 May
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2025A3: Android Agent Arena for Mobile GUI Agents with Essential-State Procedural Evaluation2 Jan
- 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
- 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation19 Oct
- 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning14 Jun
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
Other references · 11
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
- 2025ViMo: A Generative Visual GUI World Model for App Agentscited by 35
- 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Trainingcited by 27
- 2026WebGym: Scaling Training Environments for Visual Web Agents with Realistic Taskscited by 19
- 2025OpenApps: Simulating Environment Variations to Measure UI-Agent Reliabilitycited by 12
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Xiaomi-GUI-0 Technical Reportcited by 5
- 2026Scaling GUI Agents with Visual State Transitionscited by 4
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agentscited by 2
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agentscited by 2
- 2026UI-Venus-2 Technical Reportcited by 2
- 2026Benchmarking General Mobile Assistants in Challenging Real-World Scenarioscited by 0
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agentscited by 0
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agentscited by 0
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agentscited by 0
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfacescited by 0
- 2026OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Toolscited by 0
- 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scalecited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution14 Oct 2026
- 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scale13 Oct 2026
- 2026OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools9 Oct 2026
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces6 Oct 2026
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents1 Oct 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents7 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026Benchmarking General Mobile Assistants in Challenging Real-World Scenarios21 Aug 2026
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents6 Aug 2026
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents6 Aug 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
1 more
- 2026Xiaomi-GUI-0 Technical Report30 Jun 2026
- 2026Xiaomi-GUI-0 Technical Reportcited by 5
- 2026Scaling GUI Agents with Visual State Transitionscited by 4
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agentscited by 2
- 2026UI-Venus-2 Technical Reportcited by 2
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agentscited by 0
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agentscited by 0
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agentscited by 0
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfacescited by 0
- 2026OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Toolscited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Executioncited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution14 Oct 2026
- 2026OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools9 Oct 2026
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces6 Oct 2026
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents1 Oct 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents7 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents6 Aug 2026
- 2026Scaling GUI Agents with Visual State Transitions27 Jul 2026
- 2026Xiaomi-GUI-0 Technical Report30 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
- 2025MobiBench: Multi-Branch, Modular Benchmark for Mobile GUI Agents
- 2026MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World Environment
- 2025Mobile GUI Agents under Real-world Threats: Are We There Yet?
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
- 2025MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents
- 2026AmbiBench: Benchmarking Mobile GUI Agents Beyond One-Shot Instructions in the Wild
- 2024MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents