mlsanityData to 7 Oct 2026

Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures

arXiv 2604.03515 ↗First posted 3 Apr 2026cs.SE cs.AI cs.ETcited by 15

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

LLM-based coding agents can localize bugs, generate patches, and run tests with diminishing human oversight, yet the scaffolding code that surrounds the language model (the control loop, tool definitions, state management, and context strategy) remains poorly understood. Existing surveys classify agents by abstract capabilities (tool use, planning, reflection) that cannot distinguish between architecturally distinct systems, and trajectory studies observe what agents do without examining the scaffold code that determines why. This paper presents a source-code-level architectural taxonomy derived from analysis of 13 open-source coding agent scaffolds at pinned commit hashes. Each agent is characterized across 12 dimensions organized into three layers: control architecture, tool and environment interface, and resource management. The analysis reveals that scaffold architectures resist discrete classification: control strategies range from fixed pipelines to Monte Carlo Tree Search, tool counts range from 0 to 37, and context compaction spans seven distinct strategies. Five loop primitives (ReAct, generate-test-repair, plan-execute, multi-attempt retry, tree search) function as composable building blocks that agents layer in different combinations; 11 of 13 agents compose multiple primitives rather than relying on a single control structure. Dimensions converge where external constraints dominate (tool capability categories, edit formats, execution isolation) and diverge where open design questions remain (context compaction, state management, multi-model routing). All taxonomic claims are grounded in file paths and line numbers, providing a reusable reference for researchers studying agent behavior and practitioners designing new scaffolds.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 61 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

28 of 61 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026Harness Engineering for Agentic AI Coding Tools: An Exploratory Study16 Feb
  2. 2026Rethinking the Value of Agent-Generated Tests for LLM-Based Software Engineering Agents8 Feb
  3. 2026Toward Architecture-Aware Evaluation Metrics for LLM Agents27 Jan
  4. 2025SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models7 Nov
  5. 2025Understanding Code Agent Behaviour: An Empirical Study of Success and Failure Trajectories31 Oct
  6. 2025Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation10 Oct
  7. 2025SWE-Effi: Re-Evaluating Software AI Agent System Effectiveness Under Resource Constraints11 Sep
  8. 2025Prometheus: Towards Long-Horizon Codebase Navigation for Repository-Level Problem Solving26 Jul
  9. 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories23 Jun
  10. 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study10 Jun
  11. 2025DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree Traversal18 Mar
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
3 more
  1. 2024MASAI: Modular Architecture for Software-engineering AI Agents17 Jun
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  3. 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar

Other references · 13

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2017Billion-scale similarity search with GPUscited by 2,477
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  8. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  9. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
  10. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
  11. 2023A Survey on Large Language Models for Software Engineeringcited by 58
  12. 2023A Survey of Learning-based Automated Program Repaircited by 55
1 more
  1. 2018What's in a GitHub Star? Understanding Repository Starring Practices in a Social Coding Platformcited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Resolution Rates: Behavioral Drivers of Coding Agent Success and Failure
  2. 2026The Devil Is in the Interface: Evaluating How Tool Architecture Shapes Coding Agent Behavior
  3. 2026Code as Agent Harness
  4. 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas
  5. 2026When Agents Implement Systems: A Case Study in Defects, Detection, and Evaluation Rigor
  6. 2026openJiuwen: Beyond Static Harnesses for Long-Horizon Coding Agents
  7. 2025Agent READMEs: An Empirical Study of Context Files for Agentic Coding
  8. 2026Self-Evolving Coding Agents