A Formal Hierarchical Architecture for Agentic Orchestration with Stack-Based Execution and Lazy Discovery
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The rapid expansion of capabilities in Large Language Model (LLM) agents has exposed a critical architectural bottleneck: when agents are given access to a flat, monolithic registry of tools, the model must evaluate hundreds or thousands of options simultaneously. This leads to decision-space explosion, context window saturation, and degraded routing accuracy. To address these limitations, this paper presents a hierarchical, skill-based architecture for agentic orchestration. Capabilities are organized as a rooted tree where internal nodes make routing decisions and leaf nodes execute deterministic tasks. The runtime enforces a single-step execution loop governed by a Last-In-First-Out (LIFO) stack, giving the agent a form of memory akin to a Pushdown Automaton, therefore enabling it to track nested execution contexts and resume deterministically from any depth. Capability discovery follows a manifest-driven, lazy-loading protocol: only the immediate children of the active node are loaded, so memory and prompt costs scale with the explored path rather than the global registry. By replacing global memory with localized stack frames, the architecture prevents outputs from one execution branch from leaking into another, establishing the isolation guarantees required for deployment in regulated enterprise environments. We also discuss UPI Help, an AI-powered digital payments support product, as a motivating production deployment context. We provide a mathematical formalization of the orchestration state, detailed algorithmic analysis of the execution loop, and controlled benchmarks comparing flat and hierarchical routing under increasing tool catalogs, multi-step workflow pressure, and visible schema-token exposure per LLM call.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 22 of its 36 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
22 of 36 references.
Closest ancestors · 4
Same direction, newest first
- 2024Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents1 Feb
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 18
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
6 more
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
- 2023An LLM Compiler for Parallel Function Callingcited by 170
- 2023On the Tool Manipulation Capability of Open-source Large Language Modelscited by 122
- 2024AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Callscited by 121
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration
- 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence
- 2026From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution
- 2026Sutradhara: An Intelligent Orchestrator-Engine Co-design for Tool-based Agentic Inference
- 2026Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation
- 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance
- 2026EASy: Towards Efficient LLM-Based Agentic System
- 2026Utility-Guided Agent Orchestration for Efficient LLM Tool Use