mlsanityData to 14 Oct 2026

AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale

arXiv 2608.20634 ↗First posted 21 Aug 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Agents learn to act through interaction with environments, yet the environments used for training are often manually constructed or synthesized around predefined tasks and benchmarks. This task-centric paradigm makes it difficult to scale environments that reflect realistic and evolving workflows where diverse tasks can naturally emerge from the underlying world. We introduce AgentMercury, a scalable framework for synthesizing executable environments from high-level business scenarios. Rather than constructing an environment for a specific task, AgentMercury first instantiates a persistent world with entities, services, tools, state, and executable cross-service invariants, from which diverse tasks and interaction trajectories can subsequently emerge. We construct 4,783 executable environments spanning 14 industries and 50 countries, and use them as training substrates for reinforcement learning. Despite being generated without targeting the evaluation benchmarks, policies trained on these business-oriented environments improve substantially on both enterprise workflows and out-of-domain benchmarks spanning reasoning, coding, scientific computing, and tool use. In our experiments, Qwen3.5-4B improves from 12.3 to 15.7 on EnterpriseOps-GYM and from 45.9 to 56.0 on AIME26 after training on AgentMercury environments. We further show that the construction process itself can be learned: fine-tuning Qwen3.5-35B-A3B on construction traces increases executable-world authoring success from 3.3% to 83.3% on held-out business scenarios. These results show that scenario-grounded environments can provide useful and generalizable learning signals beyond benchmark-specific training, while their construction can itself become a learnable capability.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 49 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

44 of 49 references.

References · 44

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  7. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  9. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  10. 2018World Modelscited by 1,513
  11. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  12. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
32 more
  1. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  2. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  3. 2023Mastering Diverse Domains through World Modelscited by 1,253
  4. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  5. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  6. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  7. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  8. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  9. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  10. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  11. 2019Leveraging Procedural Generation to Benchmark Reinforcement Learningcited by 483
  12. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  13. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
  14. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
  15. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  16. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  17. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
  18. 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 137
  19. 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Executioncited by 85
  20. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
  21. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  22. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
  23. 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 53
  24. 2025MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Usecited by 39
  25. 2026τ-Knowledge: Evaluating Conversational Agents over Unstructured Knowledgecited by 39
  26. 2026Single-Rollout Asynchronous Optimization for Agentic Reinforcement Learningcited by 37
  27. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
  28. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
  29. 2026EnterpriseOps-Gym: Environments and Evaluations for Stateful Agentic Planning and Tool Use in Enterprise Settingscited by 15
  30. 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RLcited by 14
  31. 2026No More, No Less: Task Alignment in Terminal Agentscited by 2
  32. 2026E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarioscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Training Needs Trustworthy Worlds: Verified Synthetic Web Environments for Agent Learning
  2. 2026C-World: A Computer Use Agent Environment Creator
  3. 2026CompoWorld: Compositional Environment Scaling for General Agents
  4. 2026Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
  5. 2026Scalable Environments Drive Generalizable Agents
  6. 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications
  7. 2026AutoGym: Blueprint-First Generation of Verifiable Agent Gyms
  8. 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Work