mlsanityData to 14 Oct 2026

A Storage-Retrieval Gap in Parametric Knowledge Graph Memory

arXiv 2608.25489 ↗First posted 26 Aug 2026cs.LG cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Graph retrieval-augmented generation places retrieved subgraphs into the model's context window at query time, paying a recurring token cost and exposing source data on every call. We study an alternative: compiling a knowledge graph offline into a bank of LoRA adapters, one per entity, that serve as a parametric knowledge layer queried by injecting weights rather than text, at zero query-time context cost. On the MetaQA dataset, we find that subgraph-trained adapters encode context-free factual knowledge that generalizes to unseen questions: on single-valued relations the adapter gains +0.243 exact-match score over a base model that is nearly blind closed-book (0.007), and only the correct adapter recovers this knowledge (an oracle gap of +0.283 over the base model). However, the stored knowledge is not recoverable by similarity: given a query with no subgraph, embedding-based and weight-space geometry retrieval both perform at chance, because a semantically neighbouring entity's adapter does not contain the answer - knowledge is stored locally and does not transfer. Weight geometry correlates with subgraph semantics (ρ = +0.329) but not with functional retrievability. We quantify the byte and context-token costs against graph retrieval-augmented generation and discuss deployment implications. Our results establish that parametric knowledge graph memory is feasible for storing knowledge, and identify selecting and composing the right adapters by a mechanism other than semantic similarity as the central open problem - motivating a learned, query-conditioned composition mechanism.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 8 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

6 of 8 references.

References · 6

  1. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  2. 2022Editing Models with Task Arithmeticcited by 1,120
  3. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  4. 2025Parametric Retrieval Augmented Generationcited by 38
  5. 2025Dynamic Parametric Retrieval Augmented Generation for Test-time Knowledge Enhancementcited by 25
  6. 2025Parametric Retrieval-Augmented Generation using Latent Routing of LoRA Adapterscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation
  2. 2025The Structure-Content Trade-off in Knowledge Graph Retrieval
  3. 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases
  4. 2026BubbleRAG: Evidence-Driven Retrieval-Augmented Generation for Black-Box Knowledge Graphs
  5. 2026SeedER: Seed-Expand-Retrieve for Efficient Knowledge Graph Retrieval
  6. 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAG
  7. 2026Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)
  8. 2025Prior Knowledge Makes It Possible: From Sublinear Graph Algorithms to LLM Test-Time Methods