A hierarchical memory architecture overcomes context limits in long-horizon multi-agent computational modeling
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large language models (LLMs) demonstrate remarkable reasoning capabilities, yet their stateless architecture fundamentally limits deployment in long-horizon research workflows requiring multi-session continuity and quantitative rigor. Here we present Ensemble QSP, a multi-agent framework featuring a three-layer hierarchical memory architecture that bounds injected context (median 301 tokens, max 4,050) by capping state categories and evicting completed work. This enables continuous autonomous operation without context degradation. The system orchestrates five specialist worker agents under domain-expert principal investigators (PIs), enforcing physical constraints through physics-based checklists and structured domain knowledge. Comprehensive benchmarking demonstrates autonomous pharmacokinetic-pharmacodynamic (PKPD) model selection, improved parameter recovery relative to single-agent baselines, and robust interpretation of linguistically diverse prompts. Replication with open-weight models (DeepSeek-V4-Flash/Pro, Llama 3.1 70B) confirmed these architectural conclusions across PKPD modeling, literature synthesis, and PBPK model implementation, proving the framework is independent of proprietary LLMs. Feature-level ablations show that memory, retrieval, and PI oversight address distinct scientific failure modes, though underlying LLM capability remains consequential for stringent physical-consistency checks. The architecture is structurally agnostic to computational biology; adding a new scientific domain requires only a new PI-agent configuration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 7 of its 33 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
7 of 33 references.
References · 7
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 168
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025State and Memory is All You Need for Robust and Reliable AI Agents
- 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
- 2026ClinicalAgents: Multi-Agent Orchestration for Clinical Decision Making with Dual-Memory
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference
- 2026Three Roles, One Model: Role Orchestration at Inference Time to Close the Performance Gap Between Small and Large Agents
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model
- 2025Towards Efficient Agents: A Co-Design of Inference Architecture and System
- 2026Can Small Agents Collaborate to Beat a Single Large Language Model?