AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale
Not on the map. Why?
Abstract (arXiv)
Agents learn to act through interaction with environments, yet the environments used for training are often manually constructed or synthesized around predefined tasks and benchmarks. This task-centric paradigm makes it difficult to scale environments that reflect realistic and evolving workflows where diverse tasks can naturally emerge from the underlying world. We introduce AgentMercury, a scalable framework for synthesizing executable environments from high-level business scenarios. Rather than constructing an environment for a specific task, AgentMercury first instantiates a persistent world with entities, services, tools, state, and executable cross-service invariants, from which diverse tasks and interaction trajectories can subsequently emerge. We construct 4,783 executable environments spanning 14 industries and 50 countries, and use them as training substrates for reinforcement learning. Despite being generated without targeting the evaluation benchmarks, policies trained on these business-oriented environments improve substantially on both enterprise workflows and out-of-domain benchmarks spanning reasoning, coding, scientific computing, and tool use. In our experiments, Qwen3.5-4B improves from 12.3 to 15.7 on EnterpriseOps-GYM and from 45.9 to 56.0 on AIME26 after training on AgentMercury environments. We further show that the construction process itself can be learned: fine-tuning Qwen3.5-35B-A3B on construction traces increases executable-world authoring success from 3.3% to 83.3% on held-out business scenarios. These results show that scenario-grounded environments can provide useful and generalizable learning signals beyond benchmark-specific training, while their construction can itself become a learnable capability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 49 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
44 of 49 references.
References · 44
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
32 more
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2019Leveraging Procedural Generation to Benchmark Reinforcement Learningcited by 483
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 137
- 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Executioncited by 85
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
- 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 53
- 2025MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Usecited by 39
- 2026τ-Knowledge: Evaluating Conversational Agents over Unstructured Knowledgecited by 39
- 2026Single-Rollout Asynchronous Optimization for Agentic Reinforcement Learningcited by 37
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
- 2026EnterpriseOps-Gym: Environments and Evaluations for Stateful Agentic Planning and Tool Use in Enterprise Settingscited by 15
- 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RLcited by 14
- 2026No More, No Less: Task Alignment in Terminal Agentscited by 2
- 2026E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarioscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Training Needs Trustworthy Worlds: Verified Synthetic Web Environments for Agent Learning
- 2026C-World: A Computer Use Agent Environment Creator
- 2026CompoWorld: Compositional Environment Scaling for General Agents
- 2026Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
- 2026Scalable Environments Drive Generalizable Agents
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications
- 2026AutoGym: Blueprint-First Generation of Verifiable Agent Gyms
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Work