mlsanityData to 7 Oct 2026

Thinking with Reasoning Skills: Fewer Tokens, More Accuracy

arXiv 2604.21764 ↗First posted 23 Apr 2026cs.AIcited by 4

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Reasoning LLMs often spend substantial tokens on long intermediate reasoning traces (e.g., chain-of-thought) when solving new problems. We propose to summarize and store reusable reasoning skills distilled from extensive deliberation and trial-and-error exploration, and to retrieve these skills at inference time to guide future reasoning. Unlike the prevailing reasoning from scratch paradigm, our approach first recalls relevant skills for each query, helping the model avoid redundant detours and focus on effective solution paths. We evaluate our method on coding and mathematical reasoning tasks, and find that it significantly reduces reasoning tokens while improving overall performance. The resulting lower per-request cost indicates strong practical and economic potential for real-world deployment.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 13 of its 23 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

13 of 23 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
  2. 2024Token-Budget-Aware LLM Reasoning24 Dec
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May

Other references · 10

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  8. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
  9. 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Modelscited by 91
  10. 2022Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learningcited by 36

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Models Can Be Effective Without Thinking
  2. 2026ReFlect: An Effective Harness System for Complex Long-Horizon LLM Reasoning
  3. 2026The Reasoning Tax: Token Economics of LLM Reasoning Across Task Types and Deployment Contexts
  4. 2026Beyond Accuracy: Decomposing the Reasoning Efficiency of LLMs
  5. 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
  6. 2025Retrieval-of-Thought: Efficient Reasoning via Reusing Thoughts
  7. 2026Reason Wide, Not Deep: Amortizing the Reasoning Premium into Distilled Skills
  8. 2025Rethinking Thinking Tokens: LLMs as Improvement Operators