From Prompt to Process: a Process Taxonomy and Comparative Assessment of Frameworks Supporting AI Software Development Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
AI tools for programming are no longer just autocomplete or chat assistants: they organize themselves as development frameworks, with process, roles, artifacts and verification. Recent surveys map agents and LLMs for software engineering, but a study centered on the operational frameworks that turn these capabilities into process is missing. We ran a directed search of primary sources, with a functional inclusion criterion and traction measurement, and selected six frameworks: GitHub Spec Kit, OpenSpec, BMAD Method, Get Shit Done (GSD), Spec Kitty and Reversa. Each attacks AI development through a different path: spec-driven development in full and lightweight variants, agent-driven agile planning, context engineering over the agent, worktree isolation and review, and recovery of operational specifications from legacy systems. Our central contribution is a six-dimension process taxonomy: specification, context, roles, execution, validation and portability, with a scoring rubric that turns it into a replicable instrument. We apply it to the six frameworks and an out-of-sample case, Spec-Flow. Two results stand out. Among frameworks that already adopt some process there is convergence: the isolated prompt loses centrality, and persistent artifacts, work contracts, traceability and human review become mechanisms that reduce ambiguity and coordinate agents. And no framework strongly covers all six dimensions, exposing a structural trade-off between process depth and portability across agents. We also found recurring risks: drift between specification and code, excessive trust in generated artifacts, fragility of community extensions, platform dependence and a lack of benchmarks for the complete process. We close with a research agenda for empirical evaluation, focused on intermediate-quality metrics, context governance, installation security and reproducibility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 19 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
7 of 19 references.
Closest ancestors · 2
Same direction, newest first
- 2026Reversa: A Reverse Documentation Engineering Framework for Converting Legacy Software into Operational Specifications for AI Agents18 May
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr
Other references · 5
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2017Guidelines for including grey literature and conducting multivocal literature reviews in software engineeringcited by 38
- 2026Spec-Driven Development:From Code to Contract in the Age of AI Coding Assistantscited by 14
- 2026Meta-Engineering Harnesses for AI-Native Software Production: A Contract-Driven Adversarial Verification Architecture with Early Deployment Reportcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AI-driven Software Development: A Pragmatic Path to Agentic Development Processes
- 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks
- 2026Rethinking Software Engineering for Agentic AI Systems
- 2026A Lean and Spec-Driven AI-Assisted Software Development Lifecycle for Applied AI Education: The AI-SDLC Approach
- 2025A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Tasks
- 2026How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study
- 2026Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering
- 2025Agentic AI Process Observability: Discovering Behavioral Variability