World of Workflows: A Benchmark for Bringing World Models to Enterprise Systems
On the map: World models → World models for language agents
Abstract (arXiv)
Frontier large language models (LLMs) excel as autonomous agents in many domains, yet they remain untested in complex enterprise systems where hidden workflows create cascading effects across interconnected databases. Existing enterprise benchmarks evaluate surface-level agentic task completion similar to general consumer benchmarks, ignoring true challenges in enterprises, such as limited observability, large database state, and hidden workflows with cascading side effects. We introduce World of Workflows (WoW), a realistic ServiceNow-based environment incorporating 4,000+ business rules and 55 active workflows embedded in the system, alongside WoW-bench, a benchmark of 234 tasks evaluating constrained agentic task completion and enterprise dynamics modeling capabilities. We reveal two major takeaways: (1) Frontier LLMs suffer from dynamics blindness, consistently failing to predict the invisible, cascading side effects of their actions, which leads to silent constraint violations, and (2) reliability in opaque systems requires grounded world modeling, where agents must mentally simulate hidden state transitions to bridge the observability gap when high-fidelity feedback is unavailable. For reliable and useful enterprise agents, WoW motivates a new paradigm to explicitly learn system dynamics. We release our GitHub for setting up and evaluating WoW.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 27 of its 37 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
27 of 37 references.
Closest ancestors · 2
Same direction, newest first
- 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers20 Aug
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov
Other references · 25
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2018World Modelscited by 1,444
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
- 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 209
13 more
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
- 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agentscited by 126
- 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Serverscited by 101
- 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
- 2025Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agentscited by 75
- 2024WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Settingcited by 47
- 2025CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactionscited by 46
- 2020Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselinescited by 37
- 2025MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Usecited by 37
- 2025MCPToolBench++: A Large Scale AI Agent Model Context Protocol MCP Tool Use Benchmarkcited by 30
- 2025Software Development Life Cycle Perspective: A Survey of Benchmarks for Code Large Language Models and Agentscited by 11
- 2025SCUBA: Salesforce Computer Use Benchmarkcited by 7
- 2025Mini Amusement Parks (MAPs): A Testbed for Modelling Business Decisionscited by 1
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspacescited by 31
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestrationcited by 11
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Terminal Agents Suffice for Enterprise Automationcited by 5
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 3
- 2026DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agentscited by 2
- 2026Do Enterprise Systems Need Learned World Models? The Importance of Context to Infer Dynamicscited by 1
- 2026ARYA: A Physics-Constrained Composable & Deterministic World Model Architecturecited by 0
- 2026Continual Enterprise World Model Discovery in Dynamic Systemscited by 0
- 2026Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worldscited by 0
- 2026Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worlds8 Oct 2026
- 2026Continual Enterprise World Model Discovery in Dynamic Systems17 Sep 2026
- 2026DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents19 Aug 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026Do Enterprise Systems Need Learned World Models? The Importance of Context to Infer Dynamics12 May 2026
- 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces6 Apr 2026
- 2026Terminal Agents Suffice for Enterprise Automation31 Mar 2026
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestration24 Mar 2026
- 2026ARYA: A Physics-Constrained Composable & Deterministic World Model Architecture22 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Beyond the All-in-One Agent: Benchmarking Role-Specialized Multi-Agent Collaboration in Enterprise Workflows
- 2026PolyWorkBench: Benchmarking LLM Agents for Cross-Lingual Long-Horizon Workflows
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows
- 2024Benchmarking Agentic Workflow Generation
- 2026CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents
- 2025A Survey on Agent Workflow -- Status and Future
- 2026EntWorld: A Holistic Environment and Benchmark for Verifiable Enterprise GUI Agents
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents