mlsanityData to 7 Oct 2026

World of Workflows: A Benchmark for Bringing World Models to Enterprise Systems

arXiv 2601.22130 ↗First posted 29 Jan 2026cs.AI cs.SEcited by 10

On the map: World models → World models for language agents

Abstract (arXiv)

Frontier large language models (LLMs) excel as autonomous agents in many domains, yet they remain untested in complex enterprise systems where hidden workflows create cascading effects across interconnected databases. Existing enterprise benchmarks evaluate surface-level agentic task completion similar to general consumer benchmarks, ignoring true challenges in enterprises, such as limited observability, large database state, and hidden workflows with cascading side effects. We introduce World of Workflows (WoW), a realistic ServiceNow-based environment incorporating 4,000+ business rules and 55 active workflows embedded in the system, alongside WoW-bench, a benchmark of 234 tasks evaluating constrained agentic task completion and enterprise dynamics modeling capabilities. We reveal two major takeaways: (1) Frontier LLMs suffer from dynamics blindness, consistently failing to predict the invisible, cascading side effects of their actions, which leads to silent constraint violations, and (2) reliability in opaque systems requires grounded world modeling, where agents must mentally simulate hidden state transitions to bridge the observability gap when high-fidelity feedback is unavailable. For reliable and useful enterprise agents, WoW motivates a new paradigm to explicitly learn system dynamics. We release our GitHub for setting up and evaluating WoW.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 27 of its 37 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

27 of 37 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers20 Aug
  2. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov

Other references · 25

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2021Program Synthesis with Large Language Modelscited by 3,509
  3. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  5. 2018World Modelscited by 1,444
  6. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  7. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  8. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  9. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  10. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  11. 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
  12. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 209
13 more
  1. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
  2. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agentscited by 126
  3. 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Serverscited by 101
  4. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
  5. 2025Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agentscited by 75
  6. 2024WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Settingcited by 47
  7. 2025CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactionscited by 46
  8. 2020Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselinescited by 37
  9. 2025MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Usecited by 37
  10. 2025MCPToolBench++: A Large Scale AI Agent Model Context Protocol MCP Tool Use Benchmarkcited by 30
  11. 2025Software Development Life Cycle Perspective: A Survey of Benchmarks for Code Large Language Models and Agentscited by 11
  12. 2025SCUBA: Salesforce Computer Use Benchmarkcited by 7
  13. 2025Mini Amusement Parks (MAPs): A Testbed for Modelling Business Decisionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond the All-in-One Agent: Benchmarking Role-Specialized Multi-Agent Collaboration in Enterprise Workflows
  2. 2026PolyWorkBench: Benchmarking LLM Agents for Cross-Lingual Long-Horizon Workflows
  3. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows
  4. 2024Benchmarking Agentic Workflow Generation
  5. 2026CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents
  6. 2025A Survey on Agent Workflow -- Status and Future
  7. 2026EntWorld: A Holistic Environment and Benchmark for Verifiable Enterprise GUI Agents
  8. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents