mlsanityData to 14 Oct 2026

Generating Workflow DAGs from Natural Language with Non-Reasoning LLMs

arXiv 2608.30250 ↗First posted 31 Aug 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

This paper addresses the problem of translating natural-language routing rules written by business administrators into executable workflow graphs for enterprise contact centers. Each target is a directed acyclic graph (DAG) of conditional actions with parallel branches, hit-first fallback chains, and per-branch Boolean predicates, encoded in the JSON dialect of a commercial routing platform. We show that neuro-symbolic decomposition enables lower-cost, non-reasoning large language models to generate complex workflow DAGs at production-relevant quality without expensive extended-reasoning models. Our central diagnostic is an emission-density bottleneck: on a 635-rule benchmark of manufactured synthetic data, models select the correct graph nodes with high accuracy but increasingly misconfigure attributes and Boolean grouping as the number of interdependent nodes emitted in one pass grows. We therefore move combinatorial graph construction from the model into a deterministic compiler driven by a compact intermediate representation, with a learned registry-selection front end that focuses generation on relevant vocabulary. Across four models, the full system reaches approximately 89% LLM-judge validity, approximately 90% exact-match condition accuracy, and 99-100% valid JSON while using roughly half the per-rule prompt tokens of a monolithic prompt. On GPT-5.3-chat, the method improves judge validity by 24 percentage points and achieves statistical equivalence to a reasoning model's out-of-the-box quality, although an approximately 8-point frontier gap remains. We also present a deployment path and transferable lessons for structured-generation applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 16 of its 16 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

16 of 16 references.

References · 16

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2024A Survey on LLM-as-a-Judgecited by 1,423
  3. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  4. 2023Active Retrieval Augmented Generationcited by 516
  5. 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
  6. 2023Efficient Guided Generation for Large Language Modelscited by 200
  7. 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 197
  8. 2025Flexible and Efficient Grammar-Constrained Decodingcited by 43
  9. 2024Benchmarking Agentic Workflow Generationcited by 37
  10. 2024FlowMind: Automatic Workflow Generation with LLMscited by 30
  11. 2024WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Modelscited by 30
  12. 2025RobustFlow: Towards Robust Agentic Workflow Generationcited by 20
4 more
  1. 2024NeSyCoCo: A Neuro-Symbolic Concept Composer for Compositional Generalizationcited by 13
  2. 2026Compiled AI: Deterministic Code Generation for LLM-Based Workflow Automationcited by 4
  3. 2025On LLM-Assisted Generation of Smart Contracts from Business Processescited by 1
  4. 2026RaTA-Tool: Retrieval-based Tool Selection with Multimodal Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scaling LLM Planning: NL2FLOW for Parametric Problem Generation and Rigorous Evaluation
  2. 2026COVENANT: Natural-Language Workflow Compilation for Aligned Agent Execution
  3. 2026FlowMind: Execute-Summarize for Structured Workflow Generation from LLM Reasoning
  4. 2026Complete Cyclic Subtask Graphs for Tool-Using LLM Agents: Flexibility, Cost, and Bottlenecks in Long-Horizon Workflows
  5. 2026Characterizing Large Language Model Agentic Workflows: A Study on N8n Ecosystem
  6. 2026The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce
  7. 2026Natural-Language Workflows Are Not Software Yet: Artifact-Driven Compilation for Reliable Agent Execution
  8. 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning