Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
LLM-based coding agents can localize bugs, generate patches, and run tests with diminishing human oversight, yet the scaffolding code that surrounds the language model (the control loop, tool definitions, state management, and context strategy) remains poorly understood. Existing surveys classify agents by abstract capabilities (tool use, planning, reflection) that cannot distinguish between architecturally distinct systems, and trajectory studies observe what agents do without examining the scaffold code that determines why. This paper presents a source-code-level architectural taxonomy derived from analysis of 13 open-source coding agent scaffolds at pinned commit hashes. Each agent is characterized across 12 dimensions organized into three layers: control architecture, tool and environment interface, and resource management. The analysis reveals that scaffold architectures resist discrete classification: control strategies range from fixed pipelines to Monte Carlo Tree Search, tool counts range from 0 to 37, and context compaction spans seven distinct strategies. Five loop primitives (ReAct, generate-test-repair, plan-execute, multi-attempt retry, tree search) function as composable building blocks that agents layer in different combinations; 11 of 13 agents compose multiple primitives rather than relying on a single control structure. Dimensions converge where external constraints dominate (tool capability categories, edit formats, execution isolation) and diverge where open design questions remain (context compaction, state management, multi-model routing). All taxonomic claims are grounded in file paths and line numbers, providing a reusable reference for researchers studying agent behavior and practitioners designing new scaffolds.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 61 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
28 of 61 references.
Closest ancestors · 15
Same direction, newest first
- 2026Harness Engineering for Agentic AI Coding Tools: An Exploratory Study16 Feb
- 2026Rethinking the Value of Agent-Generated Tests for LLM-Based Software Engineering Agents8 Feb
- 2026Toward Architecture-Aware Evaluation Metrics for LLM Agents27 Jan
- 2025SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models7 Nov
- 2025Understanding Code Agent Behaviour: An Empirical Study of Success and Failure Trajectories31 Oct
- 2025Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation10 Oct
- 2025SWE-Effi: Re-Evaluating Software AI Agent System Effectiveness Under Resource Constraints11 Sep
- 2025Prometheus: Towards Long-Horizon Codebase Navigation for Repository-Level Problem Solving26 Jul
- 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories23 Jun
- 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study10 Jun
- 2025DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree Traversal18 Mar
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
3 more
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
- 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
- 2023A Survey on Large Language Models for Software Engineeringcited by 58
- 2023A Survey of Learning-based Automated Program Repaircited by 55
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?cited by 7
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Qualitycited by 3
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?cited by 1
- 2026StarHarness: Evolving Harnesses with Stratified Search for Enterprise Environmentscited by 1
- 2026LoopArena: Benchmarking Models as Runtime Controllers for Loop Engineeringcited by 1
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systemscited by 1
- 2026An Empirical Study of Harness Design for Coding Agentscited by 1
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agentscited by 0
- 2026Rethinking Complexity Metrics for LLM-Integrated Applications: Beyond Source Codecited by 0
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablationcited by 0
- 2026From Prompt to Harness: Coderlet from Scratchcited by 0
- 2026Understanding the Architecture of Coding Agents: An Exploratory Study Using a Research Prototypecited by 0
3 more
- 2026The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnessescited by 0
- 2026The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agentscited by 0
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?cited by 0
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?26 Sep 2026
- 2026An Empirical Study of Harness Design for Coding Agents17 Sep 2026
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?1 Sep 2026
- 2026The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agents28 Aug 2026
- 2026LoopArena: Benchmarking Models as Runtime Controllers for Loop Engineering28 Aug 2026
- 2026StarHarness: Evolving Harnesses with Stratified Search for Enterprise Environments25 Aug 2026
- 2026The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnesses25 Aug 2026
- 2026Understanding the Architecture of Coding Agents: An Exploratory Study Using a Research Prototype11 Aug 2026
- 2026From Prompt to Harness: Coderlet from Scratch10 Aug 2026
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems15 Jul 2026
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablation12 Jul 2026
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?10 Jul 2026
3 more
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality4 Jul 2026
- 2026Rethinking Complexity Metrics for LLM-Integrated Applications: Beyond Source Code2 Jul 2026
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agents8 May 2026
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?cited by 7
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Qualitycited by 3
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?cited by 1
- 2026LoopArena: Benchmarking Models as Runtime Controllers for Loop Engineeringcited by 1
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systemscited by 1
- 2026An Empirical Study of Harness Design for Coding Agentscited by 1
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agentscited by 0
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablationcited by 0
- 2026Understanding the Architecture of Coding Agents: An Exploratory Study Using a Research Prototypecited by 0
- 2026The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnessescited by 0
- 2026The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agentscited by 0
- 2026An Empirical Study of Harness Design for Coding Agents17 Sep 2026
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?1 Sep 2026
- 2026The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agents28 Aug 2026
- 2026LoopArena: Benchmarking Models as Runtime Controllers for Loop Engineering28 Aug 2026
- 2026The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnesses25 Aug 2026
- 2026Understanding the Architecture of Coding Agents: An Exploratory Study Using a Research Prototype11 Aug 2026
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems15 Jul 2026
- 2026When Does Restricting a Coding Agent to executecode Help? A Regime × Agent-Design Ablation12 Jul 2026
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?10 Jul 2026
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality4 Jul 2026
- 2026PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agents8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Resolution Rates: Behavioral Drivers of Coding Agent Success and Failure
- 2026The Devil Is in the Interface: Evaluating How Tool Architecture Shapes Coding Agent Behavior
- 2026Code as Agent Harness
- 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas
- 2026When Agents Implement Systems: A Case Study in Defects, Detection, and Evaluation Rigor
- 2026openJiuwen: Beyond Static Harnesses for Long-Horizon Coding Agents
- 2025Agent READMEs: An Empirical Study of Context Files for Agentic Coding
- 2026Self-Evolving Coding Agents