Cowork-Gym: Synthesizing Interactive Work Environments at Scale
Not on the map. Why?
Abstract (arXiv)
Cowork agents navigate dependencies across tools and files while adapting to changing user requirements and edits to shared workspaces. Scaling such environments requires maintaining consistency among task objectives, executable resources, user behavior, and success criteria. We introduce Cowork-Gym, a framework that synthesizes Cowork environments through a build-execute-revise loop that uses execution evidence and review feedback to validate and repair generated environments. To capture realistic Cowork dynamics, a stateful user simulator responds to the agent's actions through dialogue and direct edits to the shared workspace. We synthesize 64.9K environments across 14 application scenarios and use them to post-train 9B, 27B, and 35B-A3B Qwen models with supervised fine-tuning, reinforcement learning, and on-policy distillation. Averaged across six agentic benchmarks, these models outperform their corresponding base checkpoints by 8.7, 6.4, and 4.1 points, respectively. Ours-27B ranks second overall among the evaluated models and achieves the highest average scores on PawBench and ClawEval, outperforming models with over 100B total parameters on both benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 53 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
33 of 53 references.
References · 33
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 85
- 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
- 2026Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflowscited by 57
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
- 2025Agent-R1: A Unified and Modular Framework for Agentic Reinforcement Learningcited by 29
- 2026Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependenciescited by 29
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 27
- 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolutioncited by 23
21 more
- 2026Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agentcited by 22
- 2026ClawMark: A Living-World Benchmark for Multi-Turn, Multi-Day, Multimodal Coworker Agentscited by 17
- 2026EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learningcited by 14
- 2026Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignmentcited by 13
- 2026MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Researchcited by 13
- 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 13
- 2026AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluationcited by 12
- 2026RealUserSim: Bridging the Reality Gap in Agent Benchmarking via Grounded User Simulationcited by 12
- 2026Safe and Scalable Web Agent Learning via Recreated Websitescited by 11
- 2025CuES: A Curiosity-driven and Environment-grounded Synthesis Framework for Agentic RLcited by 10
- 2026ClawEnvKit: Automatic Environment Generation for Claw-Like Agentscited by 8
- 2026Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesiscited by 8
- 2026SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Taskscited by 7
- 2026Learning User Simulators with Turing Rewardscited by 7
- 2026WebForge: Breaking the Realism-Reproducibility-Scalability Trilemma in Browser Agent Benchmarkcited by 5
- 2026ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agentscited by 5
- 2026Weblica: Scalable and Reproducible Training Environments for Visual Web Agentscited by 4
- 2026Breaking the Solver Bottleneck: Training Task Generators at the Learnable Frontiercited by 3
- 2026Scalable Environments Drive Generalizable Agentscited by 2
- 2026VISTA: A Versatile Interactive User Simulation Toolkit for Agent Evaluationcited by 2
- 2026Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRAcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution
- 2025UserBench: An Interactive Gym Environment for User-Centric Agents
- 2026UserProxyBench: Evaluating LLM User Simulators for Agent Benchmarks and Training
- 2026DeskCraft: Benchmarking Desktop Agents on Professional Workflows and Human-in-the-Loop Collaboration
- 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration
- 2026ISE: An Execution-Grounded Recipe for Multi-Turn OS-Agent Trajectories
- 2026Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
- 2026Computer-Using World Model