Beyond Generalist LLMs: Specialist Agentic Systems for Structured Code Workflow Execution
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large Language Models (LLMs) have accelerated the adoption of software development agents, now widely available as Integrated Development Environment (IDE) extensions and standalone applications. While these agents are typically general-purpose, it remains unclear whether specialist agents justify their additional development effort. We investigate this question in the context of business process automation, focusing on the transformation of Business Process Model and Notation (BPMN) diagrams into executable agentic workflows. Since BPMN specifies explicit control-flow semantics, we focus on deterministic workflows in which a fixed process model and inputs uniquely determine the executed path. We introduce a specialist workflow for this task and compare it against generalist agents such as Roo and Cline. Our results show that the specialist solution produces agents that outperform generalist baselines by approximately 9-20 percentage points in tool-use exactness, 2-4x in penalty-adjusted latency, and 3x fewer tool-call errors, while reducing generation token cost by over 95% and eliminating repair iterations. We also find that generalist agents generate code inconsistently in both functionality and quality, limiting their suitability for industrial settings where reliability and maintainability are essential.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 52 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
22 of 52 references.
Closest ancestors · 5
Same direction, newest first
- 2025Flow: Modularized Agentic Workflow Automation14 Jan
- 2024AFlow: Automating Agentic Workflow Generation14 Oct
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr
- 2023ProAgent: From Robotic Process Automation to Agentic Process Automation2 Nov
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
Other references · 17
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2023Augmented Language Models: a Surveycited by 403
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 169
- 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 164
- 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 126
5 more
- 2024Why Does the Effective Context Length of LLMs Fall Short?cited by 63
- 2024FlowMind: Automatic Workflow Generation with LLMscited by 30
- 2024PM-LLM-Benchmark: Evaluating Large Language Models on Process Mining Taskscited by 16
- 2024SmartFlow: Robotic Process Automation using LLMscited by 5
- 2025PromptDebt: A Comprehensive Study of Technical Debt Across LLM Projectscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating Software Process Models for Multi-Agent Class-Level Code Generation
- 2025FlowAgent: Achieving Compliance and Flexibility for Workflow Agents
- 2026Characterizing Large Language Model Agentic Workflows: A Study on N8n Ecosystem
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
- 2025A Survey on Code Generation with LLM-based Agents
- 2026Can Coding Agents Be General Agents?
- 2024Towards Modeling Human-Agentic Collaborative Workflows: A BPMN Extension
- 2026Evaluating LLMs as Agentic Workflow Executors in Real-World Customer Support Skills