BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Mobile GUI agents are shifting from multi-module frameworks to native models trained end-to-end, yet industrial deployment faces three persistent gaps. Sandbox training produces a distribution mismatch with production environments; expensive real-device failures remain underutilized; and fixed benchmarks saturate, losing the power to guide iteration. We present BlueLM-GUI, a 35B-A3B mobile GUI agent built as a real-device-centric flywheel that closes these gaps through three principles. Every Sample Matters: a dual-track pipeline with Heterogeneous Triple-System Consensus evaluation and an Error Correction & Derivation Module salvages every trajectory into usable supervision. Every Rollout Is Real: a three-stage recipe---continual pre-training, supervised fine-tuning, and agentic reinforcement learning on hundreds of real phones---grounds every rollout in real production environments, so the capability the model learns transfers directly to deployment. Every Query Evolves: a quota-driven benchmark methodology with three orthogonal axes enables precise attribution and allows the benchmark to be systematically upgraded as the model improves. BlueLM-GUI achieves 87.4 on MobileGUI-VBench, surpassing the best closed-source model by 5.1 points, and 84.9 on AndroidWorld, the best result among open-source models and competitive with closed-source models. These results demonstrate that grounding model training and iterative improvement in both real devices and the three Every principles yields strong, robust, and transferable mobile GUI capability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 53 of its 70 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
53 of 70 references.
Closest ancestors · 36
Same direction, newest first
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents16 Jul
- 2026Xiaomi-GUI-0 Technical Report30 Jun
- 2026PhoneBuddy: Training Open Models for Agentic Phone Use22 Jun
- 2026Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields9 Jun
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications26 May
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research25 May
- 2026ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agents12 May
- 2026CoME: Empowering Channel-of-Mobile-Experts with Informative Hybrid-Capabilities Reasoning27 Feb
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
- 2026UI-Venus-1.5 Technical Report9 Feb
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agents26 Dec
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
24 more
- 2025Step-GUI Technical Report17 Dec
- 2025AUTO-Explorer: Automated Data Collection for GUI Agent9 Nov
- 2025UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Action20 Oct
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025OpenCUA: Open Foundations for Computer-Use Agents12 Aug
- 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents25 Jul
- 2025BacktrackAgent: Enhancing GUI Agent with Error Detection and Backtracking Mechanism27 May
- 2025MobileIPL: Enhancing Mobile Agents Thinking Process via Iterative Preference Learning18 May
- 2025Mobile-Bench-v2: A More Realistic and Comprehensive Benchmark for VLM-based Mobile Agents17 May
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024AutoGLM: Autonomous Foundation Agents for GUIs28 Oct
- 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
- 2024DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning14 Jun
- 2024On the Effects of Data Scale on UI Control Agents6 Jun
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
- 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
Other references · 17
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 194
- 2025GTA1: GUI Test-time Scaling Agentcited by 106
- 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 90
5 more
- 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
- 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 53
- 2026Single-Rollout Asynchronous Optimization for Agentic Reinforcement Learningcited by 37
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
- 2026PhoneHarness: Harnessing Phone-Use Agents through Mixed GUI, CLI, and Tool Actionscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents
- 2025MobileGUI-RL: Advancing Mobile GUI Agent through Reinforcement Learning in Online Environment
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience
- 2025MobiBench: Multi-Branch, Modular Benchmark for Mobile GUI Agents
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
- 2025Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation