mlsanityData to 14 Oct 2026

LLM-as-Code: Agentic Programming for Agent Harness

arXiv 2606.15874 ↗First posted 14 Jun 2026cs.AI cs.SEcited by 5

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Every major LLM agent framework gives the LLM the role of orchestrator; the model decides what to do next, when to call tools, and when to stop. We argue that token explosion, control-flow hallucination, and unreliable completion are not implementation bugs but architectural consequences of assigning the deterministic work of looping, branching, and sequencing to a probabilistic system. A better prompt or a stronger model cannot guarantee the reliability of the LLM agent. We therefore propose Agentic Programming, in which the program governs all control flow, and the LLM is itself part of it, an adaptive component we call LLM-as-Code and invoke only where a task calls for reasoning or generation. Within each call the model keeps full flexibility, but it cannot alter the program's execution path. With control in the program, the LLM's context is built from the execution history's call tree and forms a directed acyclic graph (DAG). Each call's context length is then determined by its call depth rather than by accumulation over steps. A case study of computer-use agents shows that the design is practical, not just a theoretical stance, substantially improving the stability of long visual operation sequences.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 22 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

9 of 22 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories23 Jun
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug

Other references · 7

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  6. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  7. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution
  2. 2026Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs
  3. 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunities
  4. 2026Harness as a Language: A Minimalist Agent Framework With Maximal Expressivity
  5. 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System
  6. 2026When Agents Do Not Stop: Uncovering Infinite Agentic Loops in LLM Agents
  7. 2024DynaSaur: Large Language Agents Beyond Predefined Actions
  8. 2024Designing Algorithms Empowered by Language Models: An Analytical Framework, Case Studies, and Insights