mlsanityData to 14 Oct 2026

Ingest-Time Fact Compilation for Cost-Efficient and Reliable Question Answering over Revised Corpora

arXiv 2609.29661 ↗First posted 29 Aug 2026cs.AI cs.DB cs.IRcited by 0

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Most agentic question answering (QA) systems do an important part of their semantic work at the worst possible time: every time someone asks a question. When a corpus contains revisions, drafts, revocations, deletions, and sources with different levels of authority, the model must reconstruct the governed current state on every read - then throw that work away and repeat it on the next query. This is a bit like a database that rebuilds a materialized view every time someone reads from it. We present ingest-time fact compilation, an architecture that performs this work when corpus data is ingested or changed. Raw passages are rephrased into self-contained facts; rules governing revisions, deletions, effective dates, and source trust are resolved once; and the resulting state is stored as typed records carrying source and revision provenance. At query time, an inexpensive model reads the compiled record instead of reconstructing it from noisy candidates. In a controlled synthetic experiment across five seeds, the same low-cost model produced the correct value, source, and revision in only one of 30 trials under query-time reconstruction, but in all 30 trials from the compiled substrate, at 12.89 times lower mean read cost per question. On simpler revision questions both architectures were exact, but the compiled path used 21.6 times fewer tokens. A separate test found that fact rephrasing roughly halved verbose Federal Reserve dialogue while preserving high source entailment, but left concise Wikipedia prose essentially unchanged. These results support a narrow but practical claim: resolving a corpus state once can make subsequent QA cheaper and more reliable for inexpensive models. We release the open source, MIT-licensed implementation and experimental artifacts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 9 of its 17 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

9 of 17 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Cost Scales with Change, Not Corpus Size: Incrementally Maintaining an Evolving Semantic Substrate17 Aug

Other references · 8

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2017Billion-scale similarity search with GPUscited by 2,497
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  5. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  6. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  7. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  8. 2023Dense X Retrieval: What Retrieval Granularity Should We Use?cited by 88

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation
  2. 2026What Should an Agent Forget? Separating What Is Stored from What Is Used
  3. 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings
  4. 2026CounterRefine: Answer-Conditioned Counterevidence Retrieval for Inference-Time Knowledge Repair in Factual Question Answering
  5. 2026Inferential Question Answering
  6. 2026How often do Answers Change? Estimating Recency Requirements in Question Answering
  7. 2025Question Answering under Temporal Conflict: Evaluating and Organizing Evolving Knowledge with LLMs
  8. 2026TRACE: State-Aware Query Processing over Temporal Evidence Graphs for Conversational Data