What makes prompts a graph: necessary and sufficient conditions for prompt graph engineering
Not on the map. Why?
Abstract (arXiv)
Prompts stopped being isolated strings some time ago. In real systems, one model call feeds another, retrieval interleaves with generation, routers branch, and aggregators merge parallel results. Practice converged on a single structure to hold this together: the graph. Frameworks such as LangGraph, DSPy, and Prompt Flow expose it openly, and research systems already optimize it automatically. The vocabulary, however, lags behind. Graph names, variously, a reasoning topology inside one sampling strategy, a multi-agent conversation, or an orchestration artifact, while prompt engineering still evokes writing one good string. What is missing is a reference definition treating prompts as nodes of an explicit, executable, improvable graph. We build that definition through conceptual analysis over sources with persistent identifiers, complemented by primary grey literature. We reconstruct the genealogy of the idea, from dataflow graphs and build systems, through prompt chaining and the thought topologies (chain, tree, graph), to graphs compiled and optimized as artifacts. We then propose a constitutive definition of prompt graph engineering, state its four conditions (explicit structure, separation between structure and prompt content, executable semantics, and the graph as a first-class engineering artifact), and operationalize them as an inclusion and exclusion test. We draw the boundary against six neighboring concepts and apply the test to six real systems (LangGraph, DSPy, Prompt Flow, AutoGen, CrewAI, and Claude Code subagents); it includes and excludes consistently. We close with a research agenda organized along four design tension axes. The contribution is an operational definition and a shared vocabulary for a practice that industry already exercises daily without naming precisely.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 61 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
43 of 61 references.
References · 43
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023A Survey of Large Language Modelscited by 2,576
31 more
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 268
- 2023An LLM Compiler for Parallel Function Callingcited by 179
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
- 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
- 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 121
- 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
- 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
- 2023Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generationcited by 105
- 2024StateFlow: Enhancing LLM Task-Solving through State-Driven Workflowscited by 65
- 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
- 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Modelscited by 52
- 2024Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMscited by 48
- 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agentscited by 35
- 2023Flows: Building Blocks of Reasoning and Collaborating AIcited by 25
- 2024PDL: A Declarative Prompt Programming Languagecited by 14
- 2026What makes a harness a harness: necessary and sufficient conditions for an agent harnesscited by 6
- 2026Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step Promptingcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.