mlsanityData to 14 Oct 2026

Reasoning Models Can Be Effective Without Thinking

arXiv 2504.09858 ↗First posted 14 Apr 2025cs.AI cs.CLcited by 187

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Recent LLMs have significantly improved reasoning capabilities, primarily by including an explicit, lengthy Thinking process as part of generation. In this paper, we question whether this explicit thinking is necessary. Using the state-of-the-art DeepSeek-R1-Distill-Qwen, we find that bypassing the thinking process via simple prompting, denoted as NoThinking, can be surprisingly effective. When controlling for the number of tokens, NoThinking outperforms Thinking across a diverse set of seven challenging reasoning datasets--including mathematical problem solving, formal theorem proving, and coding--especially in low-budget settings, e.g., 51.3 vs. 28.9 on ACM 23 with 700 tokens. Notably, the performance of NoThinking becomes more competitive with pass@k as k increases. Building on this observation, we demonstrate that a parallel scaling approach that uses NoThinking to generate N outputs independently and aggregates them is highly effective. For aggregation, we use task-specific verifiers when available, or we apply simple best-of-N strategies such as confidence-based selection. Our method outperforms a range of baselines with similar latency using Thinking, and is comparable to Thinking with significantly longer latency (up to 9x). Together, our research encourages a reconsideration of the necessity of lengthy thinking processes, while also establishing a competitive reference for achieving strong reasoning performance in low-budget settings or at low latency using parallel scaling.

Key facts. Cited by 187 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 48 of its 55 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

48 of 55 references.

Closest ancestors · 23

Same direction, newest first

  1. 2025Effectively Controlling Reasoning Models through Thinking Intervention31 Mar
  2. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  3. 2025InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models9 Mar
  4. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  5. 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
  6. 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding3 Mar
  7. 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
  8. 2025Self-Training Elicits Concise Reasoning in Large Language Models27 Feb
  9. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
  10. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformers24 Feb
  11. 2025Dynamic Parallel Tree Search for Efficient LLM Reasoning22 Feb
  12. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
11 more
  1. 2025FastMCTS: A Simple Sampling Strategy for Data Synthesis17 Feb
  2. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  3. 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoning5 Feb
  4. 2025s1: Simple test-time scaling31 Jan
  5. 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoning31 Jan
  6. 2025Efficient Reasoning with Hidden Thinking31 Jan
  7. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
  8. 2024Efficiently Scaling LLM Reasoning with Certaindex30 Dec
  9. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
  10. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
  11. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug

Other references · 25

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  4. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  5. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  6. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  7. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  8. 2025LIMO: Less is More for Reasoningcited by 498
  9. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
  10. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  11. 2025Training Language Models to Reason Efficientlycited by 247
  12. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
13 more
  1. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 183
  2. 2024Free Process Rewards without Process Labelscited by 165
  3. 2024Distilling System 2 into System 1cited by 159
  4. 2025LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!cited by 132
  5. 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 123
  6. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  7. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 116
  8. 2024Fast Best-of-N Decoding via Speculative Rejectioncited by 112
  9. 2024Learning to Route LLMs with Confidence Tokenscited by 67
  10. 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 63
  11. 2024Can Language Models Learn to Skip Steps?cited by 59
  12. 2025Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Modelscited by 51
  13. 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 112; 2026: 75.

187 papers.

Sort:

By area:

  1. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
  2. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
  3. 2025Dynamic Early Exit in Reasoning Modelscited by 219
  4. 2025Learning to Reason without External Rewardscited by 210
  5. 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
  6. 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMscited by 117
  7. 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
  8. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
  9. 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiencycited by 66
  10. 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RLcited by 62
  11. 2025R-KV: Redundancy-aware KV Cache Compression for Reasoning Modelscited by 54
  12. 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
38 more
  1. 2025Optimizing Length Compression in Large Reasoning Modelscited by 38
  2. 2025Making Slow Thinking Faster: Compressing LLM Chain-of-Thought via Step Entropycited by 38
  3. 2025ThinkSwitcher: When to Think Hard, When to Think Fastcited by 37
  4. 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 35
  5. 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecyclecited by 35
  6. 2025DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learningcited by 35
  7. 2025Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lenscited by 34
  8. 2025Steering LLM Thinking with Budget Guidancecited by 33
  9. 2025NaturalThoughts: Selecting and Distilling Reasoning Traces for General Reasoning Taskscited by 32
  10. 2025ReflAct: World-Grounded Decision Making in LLM Agents via Goal-State Reflectioncited by 31
  11. 2025R1-Compress: Long Chain-of-Thought Compression via Chunk Compression and Searchcited by 30
  12. 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Timecited by 29
  13. 2025FlashThink: An Early Exit Method For Efficient Reasoningcited by 28
  14. 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoningcited by 28
  15. 2025Leaky Thoughts: Large Reasoning Models Are Not Private Thinkerscited by 28
  16. 2025Optimizing Anytime Reasoning via Budget Relative Policy Optimizationcited by 27
  17. 2025Let LRMs Break Free from Overthinking via Self-Braking Tuningcited by 27
  18. 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoningcited by 26
  19. 2025Shorten After You're Right: Lazy Length Penalties for Reasoning RLcited by 25
  20. 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Modelscited by 23
  21. 2025Thought calibration: Efficient and confident test-time scalingcited by 21
  22. 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twicecited by 21
  23. 2025Not All Tokens Are What You Need In Thinkingcited by 20
  24. 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 20
  25. 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?cited by 19
  26. 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Modelscited by 18
  27. 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
  28. 2025MMATH: A Multilingual Benchmark for Mathematical Reasoningcited by 17
  29. 2025OThink-R1: Intrinsic Fast/Slow Thinking Mode Switching for Over-Reasoning Mitigationcited by 17
  30. 2025Causal Sufficiency and Necessity Improves Chain-of-Thought Reasoningcited by 17
  31. 2025Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Trainingcited by 16
  32. 2025How do Transformers Learn Implicit Reasoning?cited by 16
  33. 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoningcited by 16
  34. 2025Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Themcited by 15
  35. 2025Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtcited by 15
  36. 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skillscited by 14
  37. 2025Do Thinking Tokens Help or Trap? Towards More Efficient Large Reasoning Modelcited by 14
  38. 2026NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neuronscited by 14

50 most cited of 187 All 187 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025OptimalThinkingBench: Evaluating Over and Underthinking in LLMs
  2. 2025Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation
  3. 2026Thinking with Reasoning Skills: Fewer Tokens, More Accuracy
  4. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning
  5. 2025The Challenge of Teaching Reasoning to LLMs Without RL or Distillation
  6. 2026Fork-Think with Confidence
  7. 2025FINEREASON: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solving
  8. 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge