mlsanityData to 7 Oct 2026

Blueprint First, Model Second: A Framework for Deterministic LLM Workflow

arXiv 2508.02721 ↗First posted 1 Aug 2025cs.SE cs.AI cs.PLcited by 11

Not on the map. Why?

Abstract (arXiv)

While powerful, the inherent non-determinism of large language model (LLM) agents limits their application in structured operational environments where procedural fidelity and predictable execution are strict requirements. This limitation stems from current architectures that conflate probabilistic, high-level planning with low-level action execution within a single generative process. To address this, we introduce the textscSource Code Agent framework, a new paradigm built on the ``Blueprint First, Model Second'' philosophy that decouples workflow logic from the generative model. An expert-defined operational procedure is first codified into a source code-based Execution Blueprint, which is then executed by a deterministic engine. The LLM is strategically invoked as a specialized tool to handle bounded, complex sub-tasks within the workflow, but never to decide the workflow's path. We evaluate on the TravelPlanner benchmark for constraint-aware travel planning. The textscSource Code Agent achieves a 35.56% final pass rate, a 97.6% improvement over the state-of-the-art ATLAS baseline (18.00%) on the same Claude-Sonnet-4 backbone. Critically, it reduces constraint violations by 96.0% (11 vs 275) while improving execution efficiency by 27.1% (10.2±0.7 steps vs 14.0). Two production incident-diagnosis deployments and additional results on ScienceWorld and ALFWorld confirm that the architecture transfers beyond travel planning to procedurally well-defined, constraint-intensive workflows. Our work enables the verifiable and reliable deployment of autonomous agents in applications governed by strict procedural logic.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

32 of 38 references.

References · 32

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  9. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  12. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
20 more
  1. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  2. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  3. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  4. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  5. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  6. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  7. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
  8. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  9. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
  10. 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 257
  11. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
  12. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
  13. 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 120
  14. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
  15. 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 99
  16. 2024LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigationcited by 92
  17. 2024GraphCoder: Enhancing Repository-Level Code Completion via Code Context Graph-based Retrieval and Language Modelcited by 40
  18. 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
  19. 2024RePair: Automated Program Repair with Process-based Feedbackcited by 16
  20. 2025Code Execution as Grounded Supervision for LLM Reasoningcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 10.

11 papers.