mlsanityData to 7 Oct 2026

OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis

arXiv 2604.15093 ↗First posted 16 Apr 2026cs.AI cs.CL cs.CVcited by 10

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Mobile agents powered by vision-language models have demonstrated impressive capabilities in automating mobile tasks, with recent leading models achieving a marked performance leap, e.g., nearly 70% success on AndroidWorld. However, these systems keep their training data closed and remain opaque about their task and trajectory synthesis recipes. We present OpenMobile, an open-source framework that synthesizes high-quality task instructions and agent trajectories, with two key components: (1) The first is a scalable task synthesis pipeline that constructs a global environment memory from exploration, then leverages it to generate diverse and grounded instructions. and (2) a policy-switching strategy for trajectory rollout. By alternating between learner and expert models, it captures essential error-recovery data often missing in standard imitation learning. Agents trained on our data achieve competitive results across three dynamic mobile agent benchmarks: notably, our fine-tuned Qwen2.5-VL and Qwen3-VL reach 51.7% and 64.7% on AndroidWorld, far surpassing existing open-data approaches. Furthermore, we conduct transparent analyses on the overlap between our synthetic instructions and benchmark test sets, and verify that performance gains stem from broad functionality coverage rather than benchmark overfitting. We release data and code at https://njucckevin.github.io/openmobile/ to bridge the data gap and facilitate broader mobile agent research.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 48 of its 113 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

48 of 113 references.

Closest ancestors · 25

Same direction, newest first

  1. 2026OS-Themis: A Scalable Critic Framework for Generalist GUI Rewards19 Mar
  2. 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar
  3. 2026GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RL25 Feb
  4. 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
  5. 2026TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolution10 Feb
  6. 2026UI-Venus-1.5 Technical Report9 Feb
  7. 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Training30 Jan
  8. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
  9. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
  10. 2025Step-GUI Technical Report17 Dec
  11. 2025CUARewardBench: A Benchmark for Evaluating Reward Models on Computer-using Agent21 Oct
  12. 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
13 more
  1. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
  2. 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents3 Jun
  3. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  4. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  5. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis27 Dec
  6. 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
  7. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  8. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  9. 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
  10. 2024On the Effects of Data Scale on UI Control Agents6 Jun
  11. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  12. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb
  13. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan

Other references · 23

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  3. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  4. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  5. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  6. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
  7. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  8. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
  9. 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 190
  10. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 136
  11. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
  12. 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 68
11 more
  1. 2023From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfacescited by 67
  2. 2024NNetNav: Unsupervised Learning of Browser Agents Through Environment Interaction in the Wildcited by 55
  3. 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 51
  4. 2025ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflowscited by 47
  5. 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimizationcited by 45
  6. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 41
  7. 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
  8. 2025UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learningcited by 32
  9. 2025Scaling Synthetic Task Generation for Agents via Explorationcited by 19
  10. 2026OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agentcited by 19
  11. 2025OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflowscited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices
  2. 2026Exploratory, Communicative, and Deployable: Vision-Driven Embodied Agents for Open-World Mobile Manipulation
  3. 2026PalmClaw: A Native On-Device Agent Framework for Mobile Phones
  4. 2025MobileUse: A GUI Agent with Hierarchical Reflection for Autonomous Mobile Operation
  5. 2025MapAgent: Trajectory-Constructed Memory-Augmented Planning for Mobile Task Automation
  6. 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training
  7. 2026Benchmarking LLM Judges for Mobile Agent Evaluation
  8. 2025Hi-Agent: Hierarchical Vision-Language Agents for Mobile Device Control