From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Although Large Language Models (LLMs) encode rich factual knowledge in their parameters, reliably recalling and verifying such knowledge remains a key bottleneck in factual question answering. Existing end-to-end methods entangle knowledge elicitation with reasoning, making it difficult to determine whether correct answers arise from parametric knowledge or the input context. To address this challenge, we propose VAKE (Verifiable Activation of Parametric KnowledgE), a two-stage reinforcement-learning framework that externalizes latent parametric knowledge through explicit Priming and transfers the acquired elicitation capability to implicit Reasoning. Given a query and an insufficient retrieved subgraph, the Priming policy explicitly inserts bridging triples as verifiable evidence, with supervision provided by rewards derived from answers generated by a separate frozen model over the augmented subgraph. Building on the policy learned during Priming, the Reasoning stage trains the model to answer from the original input, testing whether the capability acquired through explicit knowledge elicitation transfers to implicit reasoning. Experiments across seven benchmarks and models from 3B to 14B show that VAKE consistently outperforms standard baselines, including when transferring directly from HotpotQA to OOD datasets. LLM-based evaluation further shows that over 80% of the inserted triples provide factual bridging knowledge not derivable from the retrieved context, while more than half elicit knowledge inaccessible through direct prompting. These results suggest that VAKE activates latent parametric knowledge rather than copying the input context or memorizing dataset-specific associations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 47 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
18 of 47 references.
Closest ancestors · 4
Same direction, newest first
- 2026Thinking to Recall: How Reasoning Unlocks Parametric Knowledge in LLMs10 Mar
- 2026Improving Parametric Knowledge Access in Reasoning Language Models25 Feb
- 2025Qwen3 Technical Report14 May
- 2024How Reliable are LLMs as Knowledge Bases? Re-thinking Facutality and Consistency18 Jul
Other references · 14
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2025TruthRL: Incentivizing Truthful LLMs via Reinforcement Learningcited by 27
- 2025Learning to Reason for Factualitycited by 24
- 2026Sparse but Critical: A Token-Level Analysis of Distributional Shifts in RLVR Fine-Tuning of LLMscited by 20
- 2025Knowledge-Instruct: Effective Continual Pre-training from Limited Data using Instructionscited by 12
- 2026Empty Shelves or Lost Keys? Recall Is the Bottleneck for Parametric Factualitycited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
- 2025Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Survey
- 2026Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models
- 2024GIVE: Structured Reasoning of Large Language Models with Knowledge Graph Inspired Veracity Extrapolation
- 2026INTACT: Inducing Latent Reasoning on a Frozen Backbone
- 2025SynthWorlds: Controlled Parallel Worlds for Disentangling Reasoning and Knowledge in Language Models
- 2025Finding the Minimal Parameter Budget for Implicit Reasoning: A Data Complexity Driven Scaling Law for Language Models