mlsanityData to 7 Oct 2026

Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step Prompting

arXiv 2607.00038 ↗First posted 28 Jun 2026cs.SEcited by 5

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

In mid-2026 a slogan reorganized how practitioners talk about coding agents: stop prompting your agent, start designing the loop that prompts it. We take this claim seriously and give it a careful treatment. We call the object of the new practice the loop specification: a bounded, reusable artifact, made of a trigger, a goal, a verification step, a stopping rule and a memory, that a human hands to an agent harness (such as Claude Code or Codex) so the agent pursues a goal on its own, in place of step-by-step prompting. We distinguish this external loop specification from two things it is often confused with: an ordinary programming loop, and the internal perceive-act-observe cycle that the harness already provides as plumbing. We position loop engineering as a new layer in the progression from prompt to context to harness to loop, and we argue, against the stronger headlines, that it does not retire prompt engineering; loop and prompt are distinct tools with distinct uses. We offer four contributions: a definition and scope for the discipline; an anatomy and taxonomy of loop specifications organized around trigger, goal type, a five-level verification ladder, architecture, and named terminal states; a descriptive analysis of the Loop Library, a public corpus of fifty real loops that we code by hand; and a set of design principles and anti-patterns grounded in the scientific literature on self-correction, reward hacking and model-as-judge fragility. The corpus shows that practice has matured most where the discipline says it matters: seventy percent of loops verify in the autonomous zone of the ladder and seventy-four percent name their terminal states, while automated triggering and durable memory remain comparatively underdeveloped. We close with the limits the practice must respect, including the verification burden, comprehension debt and the risk of cognitive surrender.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 54 of its 56 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

54 of 56 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
  3. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 51

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  7. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  10. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  11. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  12. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
38 more
  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  2. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  3. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  6. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  7. 2024A Survey on LLM-as-a-Judgecited by 1,384
  8. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  9. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  10. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  11. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  12. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  13. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  14. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  15. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  16. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  17. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  18. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  19. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  20. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  21. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  22. 2023Cognitive Architectures for Language Agentscited by 422
  23. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  24. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  25. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
  26. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  27. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  28. 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
  29. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
  30. 2024Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Modelscited by 158
  31. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  32. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
  33. 2024Self-Discover: Large Language Models Self-Compose Reasoning Structurescited by 108
  34. 2019Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspectivecited by 107
  35. 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agentcited by 78
  36. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  37. 2025Demonstrating specification gaming in reasoning modelscited by 48
  38. 2024Spontaneous Reward Hacking in Iterative Self-Refinementcited by 24

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Loop Engineering: Building Blocks, Adoption, and Impact
  2. 2026LoopArena: Benchmarking Models as Runtime Controllers for Loop Engineering
  3. 2026LoopsBench: From Harness Engineering to Loop Engineering in Coding Agent Evaluation
  4. 2026A Tutorial on Prompt Engineering: From Messy Thoughts to AI Workflows
  5. 2026Guardrails Beat Guidance: A Large-Scale Study of Rules, Skills, and Persistent Configuration for Coding Agents
  6. 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems
  7. 2026Wink: Recovering from Misbehaviors in Coding Agents
  8. 2026Skills as Verifiable Artifacts: A Trust Schema and a Biconditional Correctness Criterion for Human-in-the-Loop Agent Runtimes