Thinking to Recall: How Reasoning Unlocks Parametric Knowledge in LLMs
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
While reasoning in LLMs plays a natural role in math, code generation, and multi-hop factual questions, its effect on simple, single-hop factual questions remains unclear. Such questions do not require step-by-step logical decomposition, making the utility of reasoning highly counterintuitive. Nevertheless, we find that enabling reasoning substantially expands the capability boundary of the model's parametric knowledge recall, unlocking correct answers that are otherwise effectively unreachable. Why does reasoning aid parametric knowledge recall when there are no complex reasoning steps to be done? To answer this, we design a series of hypothesis-driven controlled experiments, and identify two key driving mechanisms: (1) a computational buffer effect, where the model uses the generated reasoning tokens to perform latent computation independent of their semantic content; and (2) factual priming, where generating topically related facts acts as a semantic bridge that facilitates correct answer retrieval. Importantly, this latter generative self-retrieval mechanism carries inherent risks: we demonstrate that hallucinating intermediate facts during reasoning increases the likelihood of hallucinations in the final answer. Finally, we show that our insights can be harnessed to directly improve model accuracy by prioritizing reasoning trajectories that contain hallucination-free factual statements.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 32 of its 39 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
32 of 39 references.
Closest ancestors · 4
Same direction, newest first
- 2026Improving Parametric Knowledge Access in Reasoning Language Models25 Feb
- 2025Qwen3 Technical Report14 May
- 2022Measuring and Narrowing the Compositionality Gap in Language Models7 Oct
- 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct
Other references · 28
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Let's Verify Step by Stepcited by 3,598
- 2025s1: Simple test-time scalingcited by 1,311
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2025Reasoning Models Don't Always Say What They Thinkcited by 388
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
16 more
- 2024Measuring short-form factuality in large language modelscited by 345
- 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 254
- 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 186
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
- 2024The Impact of Reasoning Step Length on Large Language Modelscited by 152
- 2021Simple Entity-Centric Questions Challenge Dense Retrieverscited by 140
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 118
- 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoningcited by 82
- 2025Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpeningcited by 78
- 2025SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledgecited by 44
- 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokenscited by 41
- 2025What Characterizes Effective Reasoning? Revisiting Length, Review, and Structure of CoTcited by 24
- 2025How Well Can Reasoning Models Identify and Recover from Unhelpful Thoughts?cited by 11
- 2026Empty Shelves or Lost Keys? Recall Is the Bottleneck for Parametric Factualitycited by 10
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Why Fine-Tuning Encourages Hallucinations and How to Fix Itcited by 6
- 2026Beyond Reasoning: Reinforcement Learning Unlocks Parametric Knowledge in LLMscited by 3
- 2026Reasoning Compression with Mixed-Policy Distillationcited by 2
- 2026DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agentscited by 2
- 2026Geometric Factual Recall in Transformerscited by 1
- 2026Fine-Tuning Dynamics of In-Context Factual Recall in Transformerscited by 1
- 2026PhantomBench: Benchmarking the Non-existential Threat of Language Modelscited by 1
- 2026Improving Latent Generalization Using Test-time Computecited by 0
- 2026LMs as Task-Specific Knowledge Bases: An Interpretability Analysiscited by 0
- 2026From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoningcited by 0
- 2026Reinforcement Learning on Benign Facts Amplifies Leakage of Memorized Private Datacited by 0
- 2026Calibration, Not Answer Selection: Distilling Internal Confidence in Reasoning Modelscited by 0
- 2026Late Attention Layers Alone Can Copy Entity Tokens, but Not Without Attending to Their Context28 Sep 2026
- 2026Calibration, Not Answer Selection: Distilling Internal Confidence in Reasoning Models27 Sep 2026
- 2026Reinforcement Learning on Benign Facts Amplifies Leakage of Memorized Private Data22 Aug 2026
- 2026From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning19 Aug 2026
- 2026DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents19 Aug 2026
- 2026LMs as Task-Specific Knowledge Bases: An Interpretability Analysis25 Jun 2026
- 2026PhantomBench: Benchmarking the Non-existential Threat of Language Models9 Jun 2026
- 2026Fine-Tuning Dynamics of In-Context Factual Recall in Transformers26 May 2026
- 2026Geometric Factual Recall in Transformers12 May 2026
- 2026Reasoning Compression with Mixed-Policy Distillation9 May 2026
- 2026Beyond Reasoning: Reinforcement Learning Unlocks Parametric Knowledge in LLMs8 May 2026
- 2026Why Fine-Tuning Encourages Hallucinations and How to Fix It16 Apr 2026
1 more
- 2026Improving Latent Generalization Using Test-time Compute1 Apr 2026
- 2026Beyond Reasoning: Reinforcement Learning Unlocks Parametric Knowledge in LLMscited by 3
- 2026Reasoning Compression with Mixed-Policy Distillationcited by 2
- 2026Improving Latent Generalization Using Test-time Computecited by 0
- 2026From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoningcited by 0
- 2026Calibration, Not Answer Selection: Distilling Internal Confidence in Reasoning Modelscited by 0
- 2026Calibration, Not Answer Selection: Distilling Internal Confidence in Reasoning Models27 Sep 2026
- 2026From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning19 Aug 2026
- 2026Reasoning Compression with Mixed-Policy Distillation9 May 2026
- 2026Beyond Reasoning: Reinforcement Learning Unlocks Parametric Knowledge in LLMs8 May 2026
- 2026Improving Latent Generalization Using Test-time Compute1 Apr 2026
- 2026Why Fine-Tuning Encourages Hallucinations and How to Fix Itcited by 6
- 2026Geometric Factual Recall in Transformerscited by 1
- 2026Fine-Tuning Dynamics of In-Context Factual Recall in Transformerscited by 1
- 2026PhantomBench: Benchmarking the Non-existential Threat of Language Modelscited by 1
- 2026LMs as Task-Specific Knowledge Bases: An Interpretability Analysiscited by 0
- 2026Reinforcement Learning on Benign Facts Amplifies Leakage of Memorized Private Datacited by 0
- 2026Late Attention Layers Alone Can Copy Entity Tokens, but Not Without Attending to Their Contextcited by 0
- 2026Late Attention Layers Alone Can Copy Entity Tokens, but Not Without Attending to Their Context28 Sep 2026
- 2026Reinforcement Learning on Benign Facts Amplifies Leakage of Memorized Private Data22 Aug 2026
- 2026LMs as Task-Specific Knowledge Bases: An Interpretability Analysis25 Jun 2026
- 2026PhantomBench: Benchmarking the Non-existential Threat of Language Models9 Jun 2026
- 2026Fine-Tuning Dynamics of In-Context Factual Recall in Transformers26 May 2026
- 2026Geometric Factual Recall in Transformers12 May 2026
- 2026Why Fine-Tuning Encourages Hallucinations and How to Fix It16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons
- 2026MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
- 2025Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs
- 2026Adaptive Retrieval helps Reasoning in LLMs -- but mostly if it's not used
- 2025Reinforcement Learning Improves Traversal of Parametric Knowledge in LLMs
- 2026Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy
- 2025The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
- 2026Context Shapes LLMs Retrieval-Augmented Fact-Checking Effectiveness