mlsanityData to 7 Oct 2026

TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolution

arXiv 2602.09662 ↗First posted 10 Feb 2026cs.CVcited by 4

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Effectively scaling GUI automation is essential for computer-use agents (CUAs); however, existing work primarily focuses on scaling GUI grounding rather than the more crucial GUI planning, which requires more sophisticated data collection. In reality, the exploration process of a CUA across apps/desktops/web pages typically follows a tree structure, with earlier functional entry points often being explored more frequently. Thus, organizing large-scale trajectories into tree structures can reduce data cost and streamline the data scaling of GUI planning. In this work, we propose TreeCUA to efficiently scale GUI automation with tree-structured verifiable evolution. We propose a multi-agent collaborative framework to explore the environment, verify actions, summarize trajectories, and evaluate quality to generate high-quality and scalable GUI trajectories. To improve efficiency, we devise a novel tree-based topology to store and replay duplicate exploration nodes, and design an adaptive exploration algorithm to balance the depth (i.e., trajectory difficulty) and breadth (i.e., trajectory diversity). Moreover, we develop world knowledge guidance and global memory backtracking to avoid low-quality generation. Finally, we naturally extend and propose the TreeCUA-DPO method from abundant tree node information, improving GUI planning capability by referring to the branch information of adjacent trajectories. Experimental results show that TreeCUA and TreeCUA-DPO offer significant improvements, and out-of-domain (OOD) studies further demonstrate strong generalization. All trajectory node information and code will be available at https://github.com/UITron-hub/TreeCUA.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 28 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

25 of 28 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Grounding Computer Use Agents on Human Demonstrations10 Nov
  2. 2025UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Action20 Oct
  3. 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
  4. 2025UItron: Foundational GUI Agent with Advanced Perception and Planning29 Aug
  5. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
  6. 2025ScaleTrack: Scaling and back-tracking Automated GUI Agents1 May
  7. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  8. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis27 Dec
  9. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  10. 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
  11. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  12. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb
1 more
  1. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan

Other references · 12

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  6. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
  7. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
  8. 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 175
  9. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 123
  10. 2024WebCanvas: Benchmarking Web Agents in Online Environmentscited by 119
  11. 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 68
  12. 2025OmniActor: A Generalist GUI and Embodied Agent for 2D&3D Worldscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agents
  2. 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents
  3. 2025GUI-360^circ: A Comprehensive Dataset and Benchmark for Computer-Using Agents
  4. 2026SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis
  5. 2025TongUI: Internet-Scale Trajectories from Multimodal Web Tutorials for Generalized GUI Agents
  6. 2025WorldGUI: An Interactive Benchmark for Desktop GUI Automation from Any Starting Point
  7. 2026CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents
  8. 2025GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration