Separating Intelligence from Execution: A Workflow Engine for the Model Context Protocol
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Large Language Model (LLM) agents increasingly interact with external systems through tool-calling protocols such as the Model Context Protocol (MCP). In prevailing architectures, the agent must reason about every tool invocation in every session, consuming tokens proportional to the number of actions performed--even when the task has been solved before. We present the MCP Workflow Engine, a novel MCP-native orchestration layer that decouples intelligence (deciding what to do) from execution (carrying it out). An agent reasons once to produce a declarative workflow blueprint--a JSON document specifying a directed sequence of MCP tool calls with parameterized templates, loops, parallel branches, and data piping. Subsequent executions are triggered by a single run_workflow tool call, consuming one invocation's worth of tokens regardless of the blueprint's internal complexity. We formalize the MCP Mediator architectural pattern--an MCP server that simultaneously acts as a client to downstream MCP servers--and implement it in TypeScript against the MCP SDK. We evaluate the engine on a production-scale Kubernetes CMDB synchronization task spanning 67 orchestrated steps across 2 MCP servers, 38 namespaces, 13 worker nodes, and 22 distinct resource types. The engine reduces per-execution token cost by over 99%, completes the full cluster graph--comprising 1,200+ nodes and 2,800+ relationships across 20 relationship types--in under 45 seconds, and achieves deterministic, idempotent execution with zero agent involvement at run time.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 17 of its 35 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
17 of 35 references.
Closest ancestors · 4
Same direction, newest first
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023ART: Automatic multi-step reasoning and tool-use for large language models16 Mar
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 13
- 2023GPT-4 Technical Reportcited by 18,396
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
1 more
- 2023TaskWeaver: A Code-First Agent Frameworkcited by 86
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Tool Orchestration to Code Execution: A Study of MCP Design Choices
- 2026From Tool Connection to Execution Control: Benchmarking Security Invariants in MCP-Style Agent Runtimes
- 2026An Empirical Study of Model Context Protocol Applications
- 2025MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Tools
- 2025ScaleMCP: Dynamic and Auto-Synchronizing Model Context Protocol Tools for LLM Agents
- 2026MCPGen: Benchmarking LLMs on Executable MCPWorkflow Development
- 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Servers
- 2026Enhancing Model Context Protocol (MCP) with Context-Aware Server Collaboration