TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolution
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Effectively scaling GUI automation is essential for computer-use agents (CUAs); however, existing work primarily focuses on scaling GUI grounding rather than the more crucial GUI planning, which requires more sophisticated data collection. In reality, the exploration process of a CUA across apps/desktops/web pages typically follows a tree structure, with earlier functional entry points often being explored more frequently. Thus, organizing large-scale trajectories into tree structures can reduce data cost and streamline the data scaling of GUI planning. In this work, we propose TreeCUA to efficiently scale GUI automation with tree-structured verifiable evolution. We propose a multi-agent collaborative framework to explore the environment, verify actions, summarize trajectories, and evaluate quality to generate high-quality and scalable GUI trajectories. To improve efficiency, we devise a novel tree-based topology to store and replay duplicate exploration nodes, and design an adaptive exploration algorithm to balance the depth (i.e., trajectory difficulty) and breadth (i.e., trajectory diversity). Moreover, we develop world knowledge guidance and global memory backtracking to avoid low-quality generation. Finally, we naturally extend and propose the TreeCUA-DPO method from abundant tree node information, improving GUI planning capability by referring to the branch information of adjacent trajectories. Experimental results show that TreeCUA and TreeCUA-DPO offer significant improvements, and out-of-domain (OOD) studies further demonstrate strong generalization. All trajectory node information and code will be available at https://github.com/UITron-hub/TreeCUA.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 28 references that are in the map. First posted on arXiv 10 Feb 2026.
Builds on
25 of 28 references.
Closest ancestors · 13
Same direction, newest first
- 2025Grounding Computer Use Agents on Human Demonstrations10 Nov
- 2025UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Action20 Oct
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
- 2025UItron: Foundational GUI Agent with Advanced Perception and Planning29 Aug
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025ScaleTrack: Scaling and back-tracking Automated GUI Agents1 May
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis27 Dec
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb
Other references · 12
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 175
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 123
- 2024WebCanvas: Benchmarking Web Agents in Online Environmentscited by 119
- 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 68
- 2025OmniActor: A Generalist GUI and Embodied Agent for 2D&3D Worldscited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
- 2026MaskClaw: Edge-Side Personalized Privacy Arbitration for GUI Agents with Behavior-Driven Skill Evolutioncited by 1
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliabilitycited by 0
- 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agentcited by 0
- 2026AutoGUIWorld: Image Generators as Visual World Models for GUI Agent1 Oct 2026
- 2026MaskClaw: Edge-Side Personalized Privacy Arbitration for GUI Agents with Behavior-Driven Skill Evolution27 May 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agents
- 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents
- 2025GUI-360^circ: A Comprehensive Dataset and Benchmark for Computer-Using Agents
- 2026SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis
- 2025TongUI: Internet-Scale Trajectories from Multimodal Web Tutorials for Generalized GUI Agents
- 2025WorldGUI: An Interactive Benchmark for Desktop GUI Automation from Any Starting Point
- 2026CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents
- 2025GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration