An Architecture for Long-Horizon Agents: Levels, Ticks and Cascaded Intelligence
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Reinforcement learning for LLM agents
Abstract (arXiv)
Language-model agents are increasingly asked to carry out work spanning days or weeks, such as an operations remediation or a research programme. Such a task outlives any context window, any process and any interval at which a person can attend. In this paper, we argue that a long-horizon agent must run continually without forgetting before it can learn continually. This ability lies in the harness around the model rather than in the model itself. We derive seven bottlenecks from the long-horizon setting and answer them with a hierarchical architecture of three parts: (i) levels indexed by time scale, each keeping a bounded file summarising the level below; (ii) a clocked tick as the unit of autonomous action; and (iii) cascaded intelligence, where work is escalated to a more capable model only after failing review. We report on a ten-day campaign in which an agent built on this architecture reproduced a published reinforcement-learning result with a human attending once a day, and show (1) the agent kept the thread across every context reset and session boundary of the campaign, (2) operating knowledge written early changed later behaviour with no change to model weights, and (3) where learned components would enter such a system. Overall, our experience suggests continual learning for these agents needs a substrate outliving every context and process, and the checks the harness already runs are where a learner belongs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 19 of its 22 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
19 of 22 references.
Closest ancestors · 2
Same direction, newest first
- 2026Do Proactive Agents Really Need an LLM to Decide When to Wake and What to Anchor?28 May
- 2026The Long-Horizon Task Mirage? Diagnosing Where and Why Agentic Systems Break13 Apr
Other references · 17
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2025Memory in the Age of AI Agentscited by 303
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 175
- 2025Measuring AI Ability to Complete Long Software Taskscited by 156
- 2026Single-Rollout Asynchronous Optimization for Agentic Reinforcement Learningcited by 37
- 2025Cascaded Language Models for Cost-effective Human-AI Decision-Makingcited by 11
- 2026Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failurescited by 10
5 more
- 2026HiMAC: Hierarchical Macro-Micro Learning for Long-Horizon LLM Agentscited by 9
- 2026MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibilitycited by 8
- 2026Governance Decay: How Context Compaction Silently Erases Safety Constraints in Long-Horizon LLM Agentscited by 8
- 2026Is Escalation Worth It? On the Depth of LLM Cascadescited by 4
- 2026Context Compaction Theorycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SKILL.state: Scalable Long-Horizon Agent Skills
- 2026ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Reality
- 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
- 2026Travel Back To Move Forward: Retrospective Exploration and Evolving for Long Horizon Agents
- 2026World Potential Model: Pretrained World Knowledge as Progress Potentials
- 2026Toward Ultra-Long-Horizon Agentic Science: Cognitive Accumulation for Machine Learning Engineering