Qwen-CUA: Native Computer Use for (almost) Everything
Not on the map. Why?
Abstract (arXiv)
Native computer use offers a general interface for agents to operate almost any software available to people, but requires long-horizon state tracking, large-scale interactive experience, and learning from sparse yet verifiable outcomes. We introduce Qwen-CUA, a native computer-use agent with a 397B-A17B Qwen mixture-of-experts backbone. It observes only screenshots and acts through keyboard and mouse events, without DOM trees, accessibility metadata, or task-specific APIs. Its scaffold maintains up to 20 active screenshots and folds older visual history in fixed-size blocks to retain recent evidence while preserving reusable prompt prefixes. For training, we build a cloud rollout fleet with access to nearly 100,000 vCPUs and tens of thousands of concurrent environments, construct approximately 40,000 verifiable tasks, and collect personalized long-horizon workflows across everyday and professional software. We optimize complete trajectories with verifiable rewards and trajectory slicing, while iterative training runs refresh supervised data and recalibrate reinforcement-learning tasks. Across eight benchmarks, Qwen-CUA outperforms Qwen3.7 and remains competitive with leading proprietary systems, reaching 86.2 on OSWorld-Verified and 18.5/48.4 binary/partial completion on OSWorld 2.0. Scaling the same recipe to a model with over one trillion parameters yields Qwen-CUA-Max, improving these scores to 87.6 and 21.2/53.3. Qwen-CUA also reduces RedTeamCUA attack success from 36.6 to 16.4 relative to Qwen3.7. Efficiency analyses, a browser deployment, and Bash-augmented experiments further characterize practical behavior. These results establish native computer use as a broadly capable agent foundation and highlight scalable verifiable interaction and hybrid tool use as key directions.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
31 of 47 references.
References · 31
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 378
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
- 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 176
19 more
- 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 157
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 139
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agentscited by 111
- 2025SEAgent: Self-Evolving Computer Use Agent with Autonomous Learning from Experiencecited by 69
- 2025ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflowscited by 52
- 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environmentscited by 46
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agentscited by 35
- 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Trainingcited by 27
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 27
- 2026CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agentscited by 23
- 2025VideoAgentTrek: Computer Use Pretraining from Unlabeled Videoscited by 22
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 21
- 2026GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Trainingcited by 18
- 2026MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agentscited by 7
- 2026SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RLcited by 7
- 2026WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agentscited by 6
- 2026WebChain: A Large-Scale Human-Annotated Dataset of Real-World Web Interaction Tracescited by 4
- 2026MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktopcited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agentscited by 1
- 2026VISTA: A Visual Harness for Reasoning in an Interactive Worldcited by 1
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
- 2026OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Softwarecited by 0
- 2026cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agentscited by 0
- 2026Prorsa: Unleashing the Potential of Prefill-Decode Disaggregation in Agentic Reinforcement Learningcited by 0
- 2026Learn from Move: the Next Step for GUI Agentscited by 0
- 2026Player-1: Learning to Play from Synthetic Experiencecited by 0
- 2026Player-1: Learning to Play from Synthetic Experience14 Oct 2026
- 2026Learn from Move: the Next Step for GUI Agents12 Oct 2026
- 2026Prorsa: Unleashing the Potential of Prefill-Decode Disaggregation in Agentic Reinforcement Learning12 Oct 2026
- 2026VISTA: A Visual Harness for Reasoning in an Interactive World1 Oct 2026
- 2026cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents30 Sep 2026
- 2026OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software30 Sep 2026
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents18 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025OpenCUA: Open Foundations for Computer-Use Agents
- 2025UltraCUA: A Foundation Model for Computer Use Agents with Hybrid Action
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents
- 2025GUI-360^circ: A Comprehensive Dataset and Benchmark for Computer-Using Agents
- 2026OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
- 2026CUA-Suite: Massive Human-annotated Video Demonstrations for Computer-Use Agents
- 2025WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filtering
- 2026ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction