Facts as First Class Objects: Knowledge Objects for Persistent LLM Memory
Not on the map. Why?
Abstract (arXiv)
Large language models increasingly serve as persistent knowledge workers, with in-context memory - facts stored in the prompt - as the default strategy. We benchmark in-context memory against Knowledge Objects (KOs), discrete hash-addressed tuples with O(1) retrieval. Within the context window, Claude Sonnet 4.5 achieves 100% exact-match accuracy from 10 to 7,000 facts (97.5% of its 200K window). However, production deployment reveals three failure modes: capacity limits (prompts overflow at 8,000 facts), compaction loss (summarization destroys 60% of facts), and goal drift (cascading compaction erodes 54% of project constraints while the model continues with full confidence). KOs achieve 100% accuracy across all conditions at 252x lower cost. On multi-hop reasoning, KOs reach 78.9% versus 31.6% for in-context. Cross-model replication across four frontier models confirms compaction loss is architectural, not model-specific. We additionally show that embedding retrieval fails on adversarial facts (20% precision at 1) and that neural memory (Titans) stores facts but fails to retrieve them on demand. We introduce density-adaptive retrieval as a switching mechanism and release the benchmark suite.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
19 of 27 references.
References · 19
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2019Compressive Transformers for Long-Range Sequence Modellingcited by 726
- 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 457
7 more
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
- 2024Titans: Learning to Memorize at Test Timecited by 328
- 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 272
- 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
- 2022Memorizing Transformerscited by 226
- 2024Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentioncited by 200
- 2021Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?cited by 60
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories
- 2026REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs
- 2026Beyond the Context Window: A Cost-Performance Analysis of Fact-Based Memory vs. Long-Context LLMs for Persistent Agents
- 2025Through a Compressed Lens: Investigating The Impact of Quantization on Factual Knowledge Recall
- 2026MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
- 2024Disentangling Memory and Reasoning Ability in Large Language Models
- 2024Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons