mlsanityData to 7 Oct 2026

LANTERN: Layered Archival and Temporal Episodic Retrieval Network for Long-Context LLM Conversations

arXiv 2606.05182 ↗First posted 18 Apr 2026cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models discard critical details when conversation history is compacted to fit within finite context windows. We present LANTERN (Layered Archival aNd Temporal Episodic Retrieval Network), a lightweight memory layer that proactively archives every conversation turn and restores relevant details after compaction via hybrid retrieval -- requiring zero LLM calls and adding fewer than 25ms of latency per turn. On 94 real multi-turn conversations (1,894 ground-truth facts, human-validated at kappa=0.81), LANTERN-Rerank recovers 78.3% of verifiable facts lost to compaction, significantly outperforming a faithful reimplementation of MemGPT's LLM-driven extraction and multi-query search pipeline (72.4%; Wilcoxon p<0.0001, 95% CI [+3.1, +8.6] pp, d=0.43) at a fraction of the inference cost. Even without the reranker, base LANTERN matches or exceeds this LLM-driven baseline (p=0.005) using zero LLM calls. When four production LLMs answer fact-bearing questions using LANTERN-restored context, accuracy improves by 8.4 percentage points on average (Wilcoxon p<0.05 for each model individually), demonstrating that the recovered context is useful across diverse model architectures. We release the full evaluation framework -- paired significance tests, failure analysis, fact-type stratification, and compaction robustness analysis -- to support reproducibility and future work.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 25 references that are in the map. First posted on arXiv 18 Apr 2026.

Builds on

20 of 25 references.

References · 20

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  6. 2020Longformer: The Long-Document Transformercited by 3,362
  7. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  8. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  9. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  10. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  11. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 848
  12. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
8 more
  1. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  2. 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 448
  3. 2023Cognitive Architectures for Language Agentscited by 422
  4. 2024Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentioncited by 194
  5. 2024InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memorycited by 192
  6. 2024Larimar: Large Language Models with Episodic Memory Controlcited by 53
  7. 2024MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memorycited by 35
  8. 2025Context Is What You Need: The Maximum Effective Context Window for Real World Limits of LLMscited by 11

Built on by

Not cited yet.