mlsanityData to 7 Oct 2026

Thinking to Recall: How Reasoning Unlocks Parametric Knowledge in LLMs

arXiv 2603.09906 ↗First posted 10 Mar 2026cs.CLcited by 13

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

While reasoning in LLMs plays a natural role in math, code generation, and multi-hop factual questions, its effect on simple, single-hop factual questions remains unclear. Such questions do not require step-by-step logical decomposition, making the utility of reasoning highly counterintuitive. Nevertheless, we find that enabling reasoning substantially expands the capability boundary of the model's parametric knowledge recall, unlocking correct answers that are otherwise effectively unreachable. Why does reasoning aid parametric knowledge recall when there are no complex reasoning steps to be done? To answer this, we design a series of hypothesis-driven controlled experiments, and identify two key driving mechanisms: (1) a computational buffer effect, where the model uses the generated reasoning tokens to perform latent computation independent of their semantic content; and (2) factual priming, where generating topically related facts acts as a semantic bridge that facilitates correct answer retrieval. Importantly, this latter generative self-retrieval mechanism carries inherent risks: we demonstrate that hallucinating intermediate facts during reasoning increases the likelihood of hallucinations in the final answer. Finally, we show that our insights can be harnessed to directly improve model accuracy by prioritizing reasoning trajectories that contain hallucination-free factual statements.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 32 of its 39 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

32 of 39 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Improving Parametric Knowledge Access in Reasoning Language Models25 Feb
  2. 2025Qwen3 Technical Report14 May
  3. 2022Measuring and Narrowing the Compositionality Gap in Language Models7 Oct
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct

Other references · 28

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023Let's Verify Step by Stepcited by 3,598
  6. 2025s1: Simple test-time scalingcited by 1,311
  7. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  8. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  9. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  10. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
  11. 2025Reasoning Models Don't Always Say What They Thinkcited by 388
  12. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
16 more
  1. 2024Measuring short-form factuality in large language modelscited by 345
  2. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
  3. 2023Think before you speak: Training Language Models With Pause Tokenscited by 254
  4. 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 186
  5. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  6. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
  7. 2024The Impact of Reasoning Step Length on Large Language Modelscited by 152
  8. 2021Simple Entity-Centric Questions Challenge Dense Retrieverscited by 140
  9. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 118
  10. 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoningcited by 82
  11. 2025Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpeningcited by 78
  12. 2025SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledgecited by 44
  13. 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokenscited by 41
  14. 2025What Characterizes Effective Reasoning? Revisiting Length, Review, and Structure of CoTcited by 24
  15. 2025How Well Can Reasoning Models Identify and Recover from Unhelpful Thoughts?cited by 11
  16. 2026Empty Shelves or Lost Keys? Recall Is the Bottleneck for Parametric Factualitycited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons
  2. 2026MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
  3. 2025Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs
  4. 2026Adaptive Retrieval helps Reasoning in LLMs -- but mostly if it's not used
  5. 2025Reinforcement Learning Improves Traversal of Parametric Knowledge in LLMs
  6. 2026Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy
  7. 2025The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
  8. 2026Context Shapes LLMs Retrieval-Augmented Fact-Checking Effectiveness