mlsanityData to 14 Oct 2026

Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History

arXiv 2606.09900 ↗First posted 5 Jun 2026cs.CL cs.AI cs.IRcited by 3

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Long-term memory is the missing layer for LLM agents: across sessions they forget, and the common workaround -- replaying the whole history into the prompt -- is expensive, slow, and, as distractors accumulate, less accurate. Most memory systems win on cost or latency but still lose to the full-context baseline on accuracy, and benchmark numbers are reported on inconsistent, non-reproducible harnesses, so one system appears at wildly different scores across sources. We present Engram, an open-source, dual-process memory engine on a bi-temporal data model. A fast write path appends lossless episodes with no LLM on the critical path; an asynchronous path extracts atomic (subject, predicate, object) facts, builds a bi-temporal knowledge graph, and resolves contradictions without an LLM call per fact -- invalidating, never deleting, so every fact keeps provenance and a supersession chain. A hybrid read path fuses dense, lexical, graph, and recency/salience signals, applies a point-in-time ("as-of") filter, and assembles a compact, provenance-tagged context. On the full 500-question LongMemEval_S, graded by the official category-specific judge, Engram's lean configuration -- answering from a ~9.6k-token retrieved slice, never the full history -- scores 83.6% vs. 73.2% for full-context (+10.4 points, McNemar p < 10^-6) at ~8x fewer tokens (9.6k vs. 79k), with 0/500 errored. The gain needs a hybrid read path: facts alone lose recall, while facts plus retrieved chunks recover detail. We also contribute a neutral, in-repo evaluation harness with the official judge baked in and the full-context baseline in every table, publish the raw per-question logs, and document the measurement-integrity pitfalls (truncation, home-grown judges, full-history leaks) that silently distort memory benchmarks. Every number ships with a command to reproduce it.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 16 of its 22 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

16 of 22 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026GAM: Hierarchical Graph-based Agentic Memory for LLM Agents14 Apr
  2. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers8 Mar
  3. 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents7 Jan
  4. 2025Memory OS of AI Agent30 May
  5. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  6. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
  7. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 9

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  6. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  7. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
  8. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
  9. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating Memory Structure in LLM Agents
  2. 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception
  3. 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agents
  4. 2026ElasticMem: Latent Memory as a Learnable Resource for LLM Agents
  5. 2026Agent Zero Memory: Provenance-Aware Long-Term Memory for LLM Agents
  6. 2026Akashic: A Low-Overhead LLM Inference Service with MemAttention
  7. 2026RaMem: Contextual Reinstatement for Long-term Agentic Memory
  8. 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents