mlsanityData to 14 Oct 2026

What makes prompts a graph: necessary and sufficient conditions for prompt graph engineering

arXiv 2607.27578 ↗First posted 30 Jul 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Prompts stopped being isolated strings some time ago. In real systems, one model call feeds another, retrieval interleaves with generation, routers branch, and aggregators merge parallel results. Practice converged on a single structure to hold this together: the graph. Frameworks such as LangGraph, DSPy, and Prompt Flow expose it openly, and research systems already optimize it automatically. The vocabulary, however, lags behind. Graph names, variously, a reasoning topology inside one sampling strategy, a multi-agent conversation, or an orchestration artifact, while prompt engineering still evokes writing one good string. What is missing is a reference definition treating prompts as nodes of an explicit, executable, improvable graph. We build that definition through conceptual analysis over sources with persistent identifiers, complemented by primary grey literature. We reconstruct the genealogy of the idea, from dataflow graphs and build systems, through prompt chaining and the thought topologies (chain, tree, graph), to graphs compiled and optimized as artifacts. We then propose a constitutive definition of prompt graph engineering, state its four conditions (explicit structure, separation between structure and prompt content, executable semantics, and the graph as a first-class engineering artifact), and operationalize them as an inclusion and exclusion test. We draw the boundary against six neighboring concepts and apply the test to six real systems (LangGraph, DSPy, Prompt Flow, AutoGen, CrewAI, and Claude Code subagents); it includes and excludes consistently. We close with a research agenda organized along four design tension axes. The contribution is an operational definition and a shared vocabulary for a practice that industry already exercises daily without naming precisely.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 61 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

43 of 61 references.

References · 43

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  11. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  12. 2023A Survey of Large Language Modelscited by 2,576
31 more
  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  2. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  5. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  6. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
  7. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  8. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  9. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  10. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  11. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
  12. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  13. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  14. 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
  15. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 268
  16. 2023An LLM Compiler for Parallel Function Callingcited by 179
  17. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
  18. 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
  19. 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 121
  20. 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
  21. 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
  22. 2023Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generationcited by 105
  23. 2024StateFlow: Enhancing LLM Task-Solving through State-Driven Workflowscited by 65
  24. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  25. 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Modelscited by 52
  26. 2024Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMscited by 48
  27. 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agentscited by 35
  28. 2023Flows: Building Blocks of Reasoning and Collaborating AIcited by 25
  29. 2024PDL: A Declarative Prompt Programming Languagecited by 14
  30. 2026What makes a harness a harness: necessary and sufficient conditions for an agent harnesscited by 6
  31. 2026Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step Promptingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.