A Storage-Retrieval Gap in Parametric Knowledge Graph Memory
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Graph retrieval-augmented generation places retrieved subgraphs into the model's context window at query time, paying a recurring token cost and exposing source data on every call. We study an alternative: compiling a knowledge graph offline into a bank of LoRA adapters, one per entity, that serve as a parametric knowledge layer queried by injecting weights rather than text, at zero query-time context cost. On the MetaQA dataset, we find that subgraph-trained adapters encode context-free factual knowledge that generalizes to unseen questions: on single-valued relations the adapter gains +0.243 exact-match score over a base model that is nearly blind closed-book (0.007), and only the correct adapter recovers this knowledge (an oracle gap of +0.283 over the base model). However, the stored knowledge is not recoverable by similarity: given a query with no subgraph, embedding-based and weight-space geometry retrieval both perform at chance, because a semantically neighbouring entity's adapter does not contain the answer - knowledge is stored locally and does not transfer. Weight geometry correlates with subgraph semantics (ρ = +0.329) but not with functional retrievability. We quantify the byte and context-token costs against graph retrieval-augmented generation and discuss deployment implications. Our results establish that parametric knowledge graph memory is feasible for storing knowledge, and identify selecting and composing the right adapters by a mechanism other than semantic similarity as the central open problem - motivating a learned, query-conditioned composition mechanism.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 8 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
6 of 8 references.
References · 6
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
- 2025Parametric Retrieval Augmented Generationcited by 38
- 2025Dynamic Parametric Retrieval Augmented Generation for Test-time Knowledge Enhancementcited by 25
- 2025Parametric Retrieval-Augmented Generation using Latent Routing of LoRA Adapterscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation
- 2025The Structure-Content Trade-off in Knowledge Graph Retrieval
- 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases
- 2026BubbleRAG: Evidence-Driven Retrieval-Augmented Generation for Black-Box Knowledge Graphs
- 2026SeedER: Seed-Expand-Retrieve for Efficient Knowledge Graph Retrieval
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAG
- 2026Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)
- 2025Prior Knowledge Makes It Possible: From Sublinear Graph Algorithms to LLM Test-Time Methods