Agents All the Way Down; A Methodology for Building Custom AI Agents from Substrate to Production
Not on the map. Why?
Abstract (arXiv)
Custom AI agents areagents that live inside their own application, talk to their own data and tools, enforce their own security boundaries, and carry their own brand and audit trail. What separates them from the general-purpose tier is fit, not capability: each is built for one job, by the engineer who will maintain it. No published practice sets out how to build one end to end. The pieces are everywhere (function-calling APIs, the Model Context Protocol, code agents to pair with), but the practice that chains them lives in podcasts, blogs, and leaked system prompts. This paper writes that practice down as a methodology, Agents All the Way Down: two preconditions crossed once and kept, then three practices repeated for the agent's life. The preconditions are (P1) Substrate, the LLM as a software component, framed as tools, then system, then messages under prompt-caching; and (P2) Building blocks: function calling, MCP, CLI orchestration, the liteshell pattern, the agent loop, skills, characters, hooks, and scaffolding. The practices are (P3) prototype with a general-purpose agent; (P4) harvest, fold, and ship the result as a CLI, the Turtle pattern; and (P5) agent-tests-agent, in which a general-purpose agent drives it through behavioural scenarios, a complement to classical testing, not a replacement. The working loop is P3 to P4 to P5 and back, and one corollary falls out for free: multi-agent orchestration is just CLI composition. The methodology is framework-free by construction. It was distilled from the AAC, a custom agent for the open-source LAMB platform, built in about ten days by one developer with an AI pair-programmer and in production . We present it as a transferable practice, independent of any language or framework.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
8 of 25 references.
References · 8
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 169
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Context Engineering for AI Agents in Open-Source Software
- 2026Forms of LLM-Integrated Applications from LLM-Chats to Autonomous AI Agent System
- 2026Interpretable Context Methodology: Folder Structure as Agentic Architecture
- 2026LLM Agent Capabilities Should Follow Task Intent and Context Source
- 2026How Do Developers Maintain and Evolve Their Agents' Instructions? An Empirical Study
- 2026The Scaffolding Matters More Than the Interface: A Controlled Comparison of MCP and CLI Tool Use Across Seven Agent Scaffoldings, Five Language Models, and One Software Task
- 2026One Skill Too Many: How Co-Installed Skills Conflict in Coding Agents
- 2026How are AI agents used? Evidence from 177,000 MCP tools