mlsanityData to 14 Oct 2026

Compute Globally, Materialize Locally: The Memory Contract of Sparse Event-KV

arXiv 2607.23693 ↗First posted 26 Jul 2026cs.AIcited by 2

On the map: Efficient LLM inference and serving → Efficient reasoning and agent inference

Abstract (arXiv)

Long-horizon agents increasingly reuse their KV cache as memory: a serving system keeps a subset of cached entries and drops the rest. Eviction and episodic-memory schemes therefore rest on a premise rarely tested directly, that a retained event is still informative once the observations that produced it are gone. We test it by omitting one earlier observation from what is served, across otherwise identical agent histories. Among items sensitive to that observation, the answer overwhelmingly follows the omitted value, though no served span says which value is correct. We call this semantic materialization: a downstream event's cached rows act as an independently servable view of computation whose inputs are gone. It can also be written on purpose. A deliberately phrased, answer-free event raises donor-aligned recovery from 6% to 51% on Qwen3-8B without ever naming the value, whereas passively harvesting natural mentions from long-term dialog yields no detected advantage. What such a row carries is specific and bounded. Compact state survives, larger payloads decay toward chance, and whether a construction writes at all turns on phrasing rather than on meaning alone, so two phrasings the model comprehends equally well can diverge sharply. The result is a memory contract for sparse event-KV serving: what to write, where it lands, and what survives once the source is gone. For anyone who evicts the corollary is that dropping a source event and observing no accuracy loss does not show the source was unnecessary.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Efficient reasoning and agent inference, one of 12 directions in Efficient LLM inference and serving. Builds on 34 of its 38 references that are in the map. First posted on arXiv 26 Jul 2026.

Builds on

34 of 38 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026[AAFLOW+] Stateful Operator Abstraction with Zero-Copy Distributed KV Cache Orchestration for Multi-Agent Workflows13 Jul
  2. 2026MemDecay: Region-Aware KV Cache Eviction for Efficient LLM Agent Inference12 Jul
  3. 2026KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling10 Jul
  4. 2026Leyline: KV Cache Directives for Agentic Inference31 May
  5. 2026MEMENTO: Teaching LLMs to Manage Their Own Context10 Apr

Other references · 29

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  7. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  8. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  9. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
  10. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  11. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  12. 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
17 more
  1. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
  2. 2024CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusioncited by 223
  3. 2022Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Modelscited by 112
  4. 2025KVLink: Accelerating Large Language Models via Efficient KV Cache Reusecited by 66
  5. 2024Human-inspired Episodic Memory for Infinite Context LLMscited by 62
  6. 2024EPIC: Efficient Position-Independent Caching for Serving Large Language Modelscited by 47
  7. 2025Language Models use Lookbacks to Track Beliefscited by 39
  8. 2025REALTALK: A 21-Day Real-World Dataset for Long-Term Conversationcited by 35
  9. 2024Correctness is not Faithfulness in RAG Attributionscited by 18
  10. 2026APEX-MEM: Agentic Semi-Structured Memory with Temporal Reasoning for Long-Term Conversational AIcited by 17
  11. 2025EpiCache: Episodic KV Cache Management for Long-Term Conversation on Resource-Constrained Environmentscited by 7
  12. 2026HYPIC: Accelerating Hybrid-Attention LLM Serving with Position-Independent Cachingcited by 7
  13. 2026KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasingcited by 6
  14. 2026Models Take Notes at Prefill: KV Cache Can Be Editable and Composablecited by 6
  15. 2026KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planningcited by 5
  16. 2026C2KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inferencecited by 4
  17. 2026InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Contextcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents
  2. 2026Persistent Memory in Multi-Agent LLM Inference: What It Costs, What It Buys, and When You Can Tell
  3. 2026Toward a Theory of Hierarchical Memory for Language Agents
  4. 2026Caching for the Future: Scrub Jay Episodic Memory Principles for Agent Memory Systems
  5. 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
  6. 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
  7. 2026ROAM: Robust Organization of Atomic Memories for Agents through Semantic Relations
  8. 2026What Eviction Destroys: A Restore-Counterfactual Audit of Forgetting in Agent Memory