mlsanityData to 14 Oct 2026

Post-Reasoning: Improving the Performance of Non-Thinking Models at No Cost

arXiv 2605.06165 ↗First posted 7 May 2026cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

As the widespread adoption of Large Language Models (LLMs) accelerates, token consumption from intermediate reasoning traces increasingly contributes to inference latency and operational cost. Recent studies suggest that many real-world tasks require little to no explicit reasoning, with additional reasoning sometimes even degrading performance. In this work, we propose Post-Reasoning, a simple yet effective approach that improves instruction-tuned models by conditioning them to justify their answers after generating the final response. By design, it enables the final answer to be obtained without additional latency or token cost, while still improving performance through simple instruction augmentation. We evaluate Post-Reasoning across 117 model--benchmark settings spanning 13 open and proprietary models, 4 model families, and 9 diverse reasoning and knowledge-intensive benchmarks, including AMC, HMMT, GSM8K, GPQA, MMLU-Pro, and BIG-Bench Hard. Post-Reasoning improves performance in over 88.19% of evaluated settings, achieving a mean relative improvements of 17.37%. Furthermore, we propose supervised post-reason tuning, which further improves performance in over 91.11% of evaluated settings, and exceeds the prompt-based post-reasoning baseline by an average of 8.01%, demonstrating that post-reasoning can be effectively internalized through training. Ultimately, Post-Reasoning establishes a new performance ceiling for direct-answer capabilities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 35 of its 49 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

35 of 49 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025OptimalThinkingBench: Evaluating Over and Underthinking in LLMs18 Aug
  2. 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
  3. 2025ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancy21 May
  4. 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning21 May
  5. 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
  6. 2025ThinkSwitcher: When to Think Hard, When to Think Fast20 May
  7. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
  8. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  9. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  10. 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
  11. 2025Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization29 Jan
  12. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
3 more
  1. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  2. 2024Token-Budget-Aware LLM Reasoning24 Dec
  3. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug

Other references · 20

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  8. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  9. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  10. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  11. 2025Gemma 3 Technical Reportcited by 1,824
  12. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
8 more
  1. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  2. 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 230
  3. 2024Orca-Math: Unlocking the potential of SLMs in Grade School Mathcited by 151
  4. 2026Ministral 3cited by 114
  5. 2025Ada-R1: Hybrid-CoT via Bi-Level Adaptive Reasoning Optimizationcited by 33
  6. 2024Easy2Hard-Bench: Standardized Difficulty Labels for Profiling LLM Performance and Generalizationcited by 24
  7. 2025Do LLMs Overthink Basic Math Reasoning? Benchmarking the Accuracy-Efficiency Tradeoff in Language Modelscited by 5
  8. 2026Think When Needed: Model-Aware Reasoning Routing for LLM-based Rankingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression
  2. 2025Thinking About Thinking: Evaluating Reasoning in Post-Trained Language Models
  3. 2026Beyond Correctness: Compute-Responsive Data Selection for Reasoning Model Post-Training
  4. 2025Efficient Inference for Large Reasoning Models: A Survey
  5. 2024Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding
  6. 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
  7. 2026TRACES: Tagging Reasoning Steps for Adaptive Cost-Efficient Early-Stopping
  8. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models