Architecture as Capability Equalizer for Coding Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
LLM-based coding agents generate complete software systems from high-level descriptions, yet little is known about how the format of architecture specifications affects the quality of generated code or whether this effect depends on model capability. We present a controlled experiment comparing five informationally equivalent specification formats (informal prose, Mermaid diagrams with constraints and ADRs, OpenAPI, C4/Structurizr DSL, and TypeScript interface contracts with ArchUnit-style rules) across six models from three vendor families (Anthropic Claude, OpenAI GPT, Google Gemini). Across 90 multi-turn agent trials, specification format shows a strong format x model interaction. On the strongest models (Sonnet 4.6, GPT-5), format barely matters (quality spread 0.17-0.92). On weaker models, format produces spreads of 0.83-2.42 points, with code-proximate formats (OpenAPI, TypeScript contracts) recovering most of the capability gap. Mid-tier models can consume more tokens than frontier models for worse output when they enter compilation debugging loops that stronger models avoid. Self-validation rates collapse from 100% (Sonnet) to 0% (Gemini Flash) across the capability spectrum. TypeScript contracts triple API route coverage for the weakest model (33% to 100%). Structured architecture specifications serve as a capability equalizer, with value inversely proportional to model strength and the largest returns for cost-optimized deployments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 28 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
13 of 28 references.
Closest ancestors · 6
Same direction, newest first
- 2026CodeSpec: Dual Executable Specifications for Agentic Long-Horizon Feature Development29 Jul
- 2026Beyond Correctness: Enhancing Architectural Reasoning in Code LLMs via Scalable Labeling with Agentic Judgment12 Jun
- 2026Constraint Decay: The Fragility of LLM Agents in Backend Code Generation7 May
- 2026Architecture Without Architects: How AI Coding Agents Shape Software Architecture5 Apr
- 2025Evaluating Software Process Models for Multi-Agent Class-Level Code Generation12 Nov
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 7
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Self-planning Code Generation with Large Language Modelscited by 121
- 2025BaxBench: Can LLMs Generate Correct and Secure Backends?cited by 38
- 2024ConCodeEval: Evaluating Large Language Models for Code Constraints in Domain-Specific Languagescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026How Generation Architecture Shapes Code Complexity in Multi-Agent LLM Systems: A Paired Study on HumanEval
- 2026The Specification Gap: Coordination Failure Under Partial Knowledge in Code Agents
- 2026When the Specification Emerges: Benchmarking Faithfulness Loss in Long-Horizon Coding Agents
- 2026AI-Generated Smells: An Analysis of Code and Architecture in LLM and Agent-Driven Development
- 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas
- 2026Specification-first convergence with an AI coding agent: a case study of dismantling a core architectural invariant across 189 files in a 717k-line codebase with no test oracle and no human code review
- 2025Artificial or Just Artful? Do LLMs Bend the Rules in Programming? ↗
- 2026AI Writes Code, Humans Pay the Debt. An Empirical Study on the Sustainability and Evolution of Agent-Generated Code