Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step Prompting
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
In mid-2026 a slogan reorganized how practitioners talk about coding agents: stop prompting your agent, start designing the loop that prompts it. We take this claim seriously and give it a careful treatment. We call the object of the new practice the loop specification: a bounded, reusable artifact, made of a trigger, a goal, a verification step, a stopping rule and a memory, that a human hands to an agent harness (such as Claude Code or Codex) so the agent pursues a goal on its own, in place of step-by-step prompting. We distinguish this external loop specification from two things it is often confused with: an ordinary programming loop, and the internal perceive-act-observe cycle that the harness already provides as plumbing. We position loop engineering as a new layer in the progression from prompt to context to harness to loop, and we argue, against the stronger headlines, that it does not retire prompt engineering; loop and prompt are distinct tools with distinct uses. We offer four contributions: a definition and scope for the discipline; an anatomy and taxonomy of loop specifications organized around trigger, goal type, a five-level verification ladder, architecture, and named terminal states; a descriptive analysis of the Loop Library, a public corpus of fifty real loops that we code by hand; and a set of design principles and anti-patterns grounded in the scientific literature on self-correction, reward hacking and model-as-judge fragility. The corpus shows that practice has matured most where the discipline says it matters: seventy percent of loops verify in the autonomous zone of the ladder and seventy-four percent name their terminal states, while automated triggering and durable memory remain comparatively underdeveloped. We close with the limits the practice must respect, including the verification burden, comprehension debt and the risk of cognitive surrender.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 54 of its 56 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
54 of 56 references.
Closest ancestors · 3
Same direction, newest first
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
- 2023ChatDev: Communicative Agents for Software Development16 Jul
Other references · 51
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
38 more
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2023Cognitive Architectures for Language Agentscited by 422
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
- 2024Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Modelscited by 158
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
- 2024Self-Discover: Large Language Models Self-Compose Reasoning Structurescited by 108
- 2019Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspectivecited by 107
- 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agentcited by 78
- 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
- 2025Demonstrating specification gaming in reasoning modelscited by 48
- 2024Spontaneous Reward Hacking in Iterative Self-Refinementcited by 24
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 25
- 2026What makes prompts a graph: necessary and sufficient conditions for prompt graph engineeringcited by 1
- 2026EvoHarnessBench: Can Your Agents Keep Pace with an Evolving Harness?cited by 1
- 2026OpenLoopEvolve: A Verifiable Self-Evolution Framework for Loop Policies in Long-Horizon Complex Taskscited by 0
- 2026Forward-Deployed Full-Stack Engineering for Autonomous Cloud MLOpscited by 0
- 2026EvoHarnessBench: Can Your Agents Keep Pace with an Evolving Harness?3 Sep 2026
- 2026Forward-Deployed Full-Stack Engineering for Autonomous Cloud MLOps30 Aug 2026
- 2026OpenLoopEvolve: A Verifiable Self-Evolution Framework for Loop Policies in Long-Horizon Complex Tasks10 Aug 2026
- 2026What makes prompts a graph: necessary and sufficient conditions for prompt graph engineering30 Jul 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Loop Engineering: Building Blocks, Adoption, and Impact
- 2026LoopArena: Benchmarking Models as Runtime Controllers for Loop Engineering
- 2026LoopsBench: From Harness Engineering to Loop Engineering in Coding Agent Evaluation
- 2026A Tutorial on Prompt Engineering: From Messy Thoughts to AI Workflows
- 2026Guardrails Beat Guidance: A Large-Scale Study of Rules, Skills, and Persistent Configuration for Coding Agents
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems
- 2026Wink: Recovering from Misbehaviors in Coding Agents
- 2026Skills as Verifiable Artifacts: A Trust Schema and a Biconditional Correctness Criterion for Human-in-the-Loop Agent Runtimes