mlsanityData to 14 Oct 2026

Reason Wide, Not Deep: Amortizing the Reasoning Premium into Distilled Skills

arXiv 2608.07885 ↗First posted 8 Aug 2026cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Reasoning modes of language models outperform their non-reasoning counterparts on multi-step agentic tasks, but pay a 3-6x premium in output tokens on every episode -- much of it spent re-deriving procedures that are shared across episodes of the same domain. We show this recurring cost can be amortized: a coding agent analyses a small corpus of existing trajectories from a training split and compiles a compact natural-language skill that is injected into the non-reasoning model's system prompt. Across four agentic benchmarks (ALFWorld, tau2-bench telecom and retail, and SpreadsheetBench-Verified), skills recover 55%-100%+ of the reasoning gap for GPT-5.4-mini on held-out tasks -- exceeding the reasoning mode outright on two of four -- while emitting 2.7-6x fewer output tokens and zero reasoning tokens. Notably, reasoning traces are not a prerequisite: skills distilled from non-reasoning trajectories alone remain competitive with skills distilled from paired reasoning/non-reasoning corpora, with domain-dependent differences between the two sources. We interpret these results through a search lens: test-time reasoning is deep search inside a single episode, re-paid at every deployment, while corpus distillation is wide search across episodes, paid once. The two recover overlapping procedural knowledge, and width over cheap trajectories is often the better buy -- with the residual gap on some domains (telecom, SpreadsheetBench) delineating where genuinely per-instance deep search remains necessary.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 17 of its 26 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

17 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025s1: Simple test-time scaling31 Jan
  2. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  3. 2024Token-Budget-Aware LLM Reasoning24 Dec
  4. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug

Other references · 13

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  5. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  6. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  7. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  8. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  9. 2025LIMO: Less is More for Reasoningcited by 498
  10. 2024Agent Workflow Memorycited by 383
  11. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  12. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
1 more
  1. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Skill Use or Skill Theater? Evaluating the Reasoning Backroom in Skill-Augmented Language Agents
  2. 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
  3. 2025Reasoning Pattern Matters: Learning to Reason without Human Rationales
  4. 2026Thinking with Reasoning Skills: Fewer Tokens, More Accuracy
  5. 2025General Intelligence Requires Reward-based Pretraining
  6. 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
  7. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills
  8. 2026The Reasoning Tax: Token Economics of LLM Reasoning Across Task Types and Deployment Contexts