mlsanityData to 7 Oct 2026

From Prompt to Harness: Coderlet from Scratch

arXiv 2608.09480 ↗First posted 10 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A model alone does not determine how a programming agent acts. What the model sees, how actions enter the environment, how feedback returns, and how one run affects the next all depend on how the harness is organized. Minimal examples usually show only the basic interaction between a model and tools, while production systems spread these relationships across complex components and dependencies. This paper studies a compact harness design by following a single request through context formation, model decision, environmental action, observation return, and state continuation. Three boundaries---model, execution, and state---connect the model service, tool environment, and persistent state, while the request lifecycle determines the order in which these transitions occur. Together, they show the harness's core role: turning model generations into environmental actions, carrying runtime feedback into later decisions, and allowing state to continue across requests. On top of this runtime structure, a harness can also be gradually refined across runs through continued bootstrapping. The design is realized in the executable artifact https://github.com/lilinxi/Coderlet.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 16 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

16 of 16 references.

References · 16

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
  8. 2026Self-Harness: Harnesses That Improve Themselvescited by 79
  9. 2026Code as Agent Harnesscited by 40
  10. 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 28
  11. 2026Recursive Harness Self-Improvementcited by 22
  12. 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architecturescited by 15
4 more
  1. 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editablecited by 12
  2. 2026The Scaffold Effect in Coding Agents: Harness Choice as a Hidden Variable in Coding-Agent Evaluationcited by 8
  3. 2026What makes a harness a harness: necessary and sufficient conditions for an agent harnesscited by 5
  4. 2026Bootstrapping Coding Agents: The Specification Is the Programcited by 1

Built on by

Not cited yet.