Episodic-Semantic Memory Architecture for Long-Horizon Scientific Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
As Large Language Models (LLMs) evolve into persistent scientific collaborators, context window saturation has emerged as a critical bottleneck. Scientific workflows involving iterative data analysis and hypothesis refinement rapidly saturate even extended contexts with dense technical content, while monolithic approaches suffer from quadratic cost scaling and cognitive degradation. We evaluate a Dual Process Memory Architecture that decouples immediate episodic needs (constant 10-message window) from long-term consolidated knowledge (growing at approximately 3 tokens/message). Unlike prior social agent memory systems, our domain-specific consolidation addresses contradictory parameter evolution, multi-hop reasoning across experimental phases, and precise technical fact retention. Through large-scale evaluation spanning 15,000 messages with cross-model validation across six LLMs from three families (OpenAI, Anthropic, Google), totaling 1,440 queries, we establish three key findings. First, while full-context models fail at 10,000 messages due to context overflow, our system maintains 70-85% accuracy with 1-2 second latency using 62% fewer tokens (45,434 vs 120,000+ limit). Second, cross-model validation reveals architecture-level trade-offs independent of specific LLMs: Dual Process excels at numeric/temporal queries (65-90% accuracy) while RAG excels at historical retrieval (60-85%), suggesting complementary deployment strategies. Third, we identify a "Sim-to-Real" gap where synthetic tests maintain constant memory but realistic workflows exhibit linear growth (about 3 tokens/message), with consolidation quality emerging as the primary scalability bottleneck. The architecture successfully manages profiles with 14,000+ scientific facts (125k tokens), demonstrating that domain-specific memory consolidation enables sustained operation beyond full-context limits.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 28 of its 37 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
28 of 37 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
16 more
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2014Neural Turing Machinescited by 644
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 457
- 2023Cognitive Architectures for Language Agentscited by 429
- 2023Augmented Language Models: a Surveycited by 403
- 2014Memory Networkscited by 363
- 2023Adapting Language Models to Compress Contextscited by 356
- 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 314
- 2023Landmark Attention: Random-Access Infinite Context Length for Transformerscited by 213
- 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agent Zero Memory: Provenance-Aware Long-Term Memory for LLM Agents
- 2026E-mem: Multi-agent based Episodic Context Reconstruction for LLM Agent Memory
- 2025Position: Episodic Memory is the Missing Piece for Long-Term LLM Agents
- 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
- 2026AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
- 2026Continuum Memory Architectures for Long-Horizon LLM Agents
- 2026MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning
- 2026GAM: Hierarchical Graph-based Agentic Memory for LLM Agents