EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The development of native computer-use agents (CUA) represents a significant leap in multimodal AI. However, their potential is currently bottlenecked by the constraints of static data scaling. Existing paradigms relying primarily on passive imitation of static datasets struggle to capture the intricate causal dynamics inherent in long-horizon computer tasks. In this work, we introduce EvoCUA, a native computer use agentic model. Unlike static imitation, EvoCUA integrates data generation and policy optimization into a self-sustaining evolutionary cycle. To mitigate data scarcity, we develop a verifiable synthesis engine that autonomously generates diverse tasks coupled with executable validators. To enable large-scale experience acquisition, we design a scalable infrastructure orchestrating tens of thousands of asynchronous sandbox rollouts. Building on these massive trajectories, we propose an iterative evolving learning strategy to efficiently internalize this experience. This mechanism dynamically regulates policy updates by identifying capability boundaries -- reinforcing successful routines while transforming failure trajectories into rich supervision through error analysis and self-correction. Empirical evaluations on the OSWorld benchmark demonstrate that EvoCUA achieves a success rate of 56.7%, establishing a new open-source state-of-the-art. Notably, EvoCUA significantly outperforms the previous best open-source model, OpenCUA-72B (45.0%), and surpasses leading closed-weights models such as UI-TARS-2 (53.1%). Crucially, our results underscore the generalizability of this approach: the evolving paradigm driven by learning from experience yields consistent performance gains across foundation models of varying scales, establishing a robust and scalable path for advancing native agent capabilities.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 33 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
28 of 33 references.
References · 28
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
16 more
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
- 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 151
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
- 2025Agent Learning via Early Experiencecited by 79
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Datacited by 58
- 2025Step-GUI Technical Reportcited by 38
- 2025UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Actioncited by 30
Built on by
Citing papers per year: 2026: 51.
51 papers.
Sort:
By area:
- 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 83
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agentscited by 72
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agentscited by 21
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 13
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
- 2026ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agentscited by 10
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 9
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agentscited by 9
38 more
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applicationscited by 8
- 2026UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agentscited by 7
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RLcited by 7
- 2026SPADE: Self-Play in Adaptive Synthetic Executable Environmentscited by 6
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environmentscited by 5
- 2026VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI Automationcited by 4
- 2026GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agentscited by 3
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agentscited by 3
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillationcited by 3
- 2026GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Modelscited by 2
- 2026Training Computer Use Agents to Assess the Usability of Graphical User Interfacescited by 2
- 2026Interactive Reward Agent: GUI Task Evaluation via Environment-State Verificationcited by 2
- 2026StepJack: Benchmarking Computer-Use Agent Safety Against Multi-Step Indirect Prompt Injectioncited by 2
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injectioncited by 1
- 2026Benchmarking and Improving GUI Agents in High-Dynamic Environmentscited by 1
- 2026What Happens Before Decoding? Prefill Determines GUI Grounding in VLMscited by 1
- 2026Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agentscited by 1
- 2026StainFlow: Entity-Stain Tracking and Evidence Linking for Process Rewards in GUI Agentscited by 1
- 2026LabOSBench: Benchmarking Computer Use Agents for Scientific Instrument Controlcited by 1
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Groundingcited by 1
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrationscited by 1
- 2026UI-Venus-2 Technical Reportcited by 1
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agentscited by 1
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agentscited by 1
- 2026Covering Human Action Space for Computer Use: Data Synthesis and Benchmarkcited by 0
- 2026AliyunConsoleAgent: Training Web Agents in Real-World Cloud Environments via Distillation and Reinforcement Learningcited by 0
- 2026Self-Evolution for Multi-Turn Tool-Calling Agents via Divergence-Point Preference Learningcited by 0
- 2026Rethinking Inference-Time Scaling in Local Computer-Use Agents: Failure Modes and Compute Tradeoffscited by 0
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agentscited by 0
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agentscited by 0
- 2026MintAct: A Unified Visual Agent for Digital Environmentscited by 0
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agentscited by 0
- 2026How Many Pixels Is a Digit Worth? Place-Aware Coordinate Entropy for GUI Agent Confidence Estimationcited by 0
- 2026WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agentscited by 0
- 2026AnyAct: Universal Action for Self-Evolving Agentscited by 0
- 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agentscited by 0
- 2026HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agentscited by 0
50 most cited of 51 All 51 (JSON)
- 2026ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use Agents30 Sep 2026
- 2026HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents29 Sep 2026
- 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agents29 Sep 2026
- 2026AnyAct: Universal Action for Self-Evolving Agents29 Sep 2026
- 2026WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents28 Sep 2026
- 2026How Many Pixels Is a Digit Worth? Place-Aware Coordinate Entropy for GUI Agent Confidence Estimation21 Sep 2026
- 2026MintAct: A Unified Visual Agent for Digital Environments18 Sep 2026
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents15 Sep 2026
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments14 Sep 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents4 Sep 2026
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agents27 Aug 2026
38 more
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents26 Aug 2026
- 2026SPADE: Self-Play in Adaptive Synthetic Executable Environments19 Aug 2026
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations16 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026StepJack: Benchmarking Computer-Use Agent Safety Against Multi-Step Indirect Prompt Injection6 Aug 2026
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation31 Jul 2026
- 2026Rethinking Inference-Time Scaling in Local Computer-Use Agents: Failure Modes and Compute Tradeoffs30 Jul 2026
- 2026Interactive Reward Agent: GUI Task Evaluation via Environment-State Verification28 Jul 2026
- 2026HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents16 Jul 2026
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL13 Jul 2026
- 2026UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agents5 Jul 2026
- 2026One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding29 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agents22 Jun 2026
- 2026Self-Evolution for Multi-Turn Tool-Calling Agents via Divergence-Point Preference Learning22 Jun 2026
- 2026LabOSBench: Benchmarking Computer Use Agents for Scientific Instrument Control15 Jun 2026
- 2026AliyunConsoleAgent: Training Web Agents in Real-World Cloud Environments via Distillation and Reinforcement Learning8 Jun 2026
- 2026StainFlow: Entity-Stain Tracking and Evidence Linking for Process Rewards in GUI Agents5 Jun 2026
- 2026Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agents27 May 2026
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications26 May 2026
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agents25 May 2026
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agents19 May 2026
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents18 May 2026
- 2026Covering Human Action Space for Computer Use: Data Synthesis and Benchmark12 May 2026
- 2026ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agents12 May 2026
- 2026What Happens Before Decoding? Prefill Determines GUI Grounding in VLMs10 May 2026
- 2026Training Computer Use Agents to Assess the Usability of Graphical User Interfaces28 Apr 2026
- 2026Benchmarking and Improving GUI Agents in High-Dynamic Environments28 Apr 2026
- 2026VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI Automation23 Apr 2026
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis16 Apr 2026
- 2026GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models15 Apr 2026
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents12 Apr 2026
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection9 Apr 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokens29 Mar 2026
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience25 Mar 2026
- 2026OpenClaw-RL: Train Any Agent Simply by Talking10 Mar 2026
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb 2026
50 newest of 51 All 51 (JSON)
- 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 83
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agentscited by 72
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agentscited by 21
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 13
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experiencecited by 11
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesiscited by 10
- 2026ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agentscited by 10
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 9
- 2026OpenComputer: Verifiable Software Worlds for Computer-Use Agentscited by 9
- 2026AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applicationscited by 8
- 2026UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agentscited by 7
12 most cited of 41 All 41 (JSON)
- 2026ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use Agents30 Sep 2026
- 2026HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents29 Sep 2026
- 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agents29 Sep 2026
- 2026AnyAct: Universal Action for Self-Evolving Agents29 Sep 2026
- 2026WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents28 Sep 2026
- 2026How Many Pixels Is a Digit Worth? Place-Aware Coordinate Entropy for GUI Agent Confidence Estimation21 Sep 2026
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents15 Sep 2026
- 2026BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents11 Sep 2026
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents4 Sep 2026
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agents27 Aug 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents26 Aug 2026
12 newest of 41 All 41 (JSON)
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026EvoCUA-1.5: Online Reinforcement Learning for Multi-turn Computer-Use Agents
- 2025Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agent
- 2025SEAgent: Self-Evolving Computer Use Agent with Autonomous Learning from Experience
- 2026EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
- 2026EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management
- 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessment
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
- 2026Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale