Reasoning Models Can Be Effective Without Thinking
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Recent LLMs have significantly improved reasoning capabilities, primarily by including an explicit, lengthy Thinking process as part of generation. In this paper, we question whether this explicit thinking is necessary. Using the state-of-the-art DeepSeek-R1-Distill-Qwen, we find that bypassing the thinking process via simple prompting, denoted as NoThinking, can be surprisingly effective. When controlling for the number of tokens, NoThinking outperforms Thinking across a diverse set of seven challenging reasoning datasets--including mathematical problem solving, formal theorem proving, and coding--especially in low-budget settings, e.g., 51.3 vs. 28.9 on ACM 23 with 700 tokens. Notably, the performance of NoThinking becomes more competitive with pass@k as k increases. Building on this observation, we demonstrate that a parallel scaling approach that uses NoThinking to generate N outputs independently and aggregates them is highly effective. For aggregation, we use task-specific verifiers when available, or we apply simple best-of-N strategies such as confidence-based selection. Our method outperforms a range of baselines with similar latency using Thinking, and is comparable to Thinking with significantly longer latency (up to 9x). Together, our research encourages a reconsideration of the necessity of lengthy thinking processes, while also establishing a competitive reference for achieving strong reasoning performance in low-budget settings or at low latency using parallel scaling.
Key facts. Cited by 187 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 48 of its 55 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
48 of 55 references.
Closest ancestors · 23
Same direction, newest first
- 2025Effectively Controlling Reasoning Models through Thinking Intervention31 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models9 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding3 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025Self-Training Elicits Concise Reasoning in Large Language Models27 Feb
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
- 2025Reasoning with Latent Thoughts: On the Power of Looped Transformers24 Feb
- 2025Dynamic Parallel Tree Search for Efficient LLM Reasoning22 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
11 more
- 2025FastMCTS: A Simple Sampling Strategy for Data Synthesis17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoning5 Feb
- 2025s1: Simple test-time scaling31 Jan
- 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoning31 Jan
- 2025Efficient Reasoning with Hidden Thinking31 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Efficiently Scaling LLM Reasoning with Certaindex30 Dec
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 25
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025LIMO: Less is More for Reasoningcited by 498
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2025Training Language Models to Reason Efficientlycited by 247
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
13 more
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 183
- 2024Free Process Rewards without Process Labelscited by 165
- 2024Distilling System 2 into System 1cited by 159
- 2025LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!cited by 132
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 123
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 116
- 2024Fast Best-of-N Decoding via Speculative Rejectioncited by 112
- 2024Learning to Route LLMs with Confidence Tokenscited by 67
- 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 63
- 2024Can Language Models Learn to Skip Steps?cited by 59
- 2025Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Modelscited by 51
- 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29
Built on by
Citing papers per year: 2025: 112; 2026: 75.
187 papers.
Sort:
By area:
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2025Dynamic Early Exit in Reasoning Modelscited by 219
- 2025Learning to Reason without External Rewardscited by 210
- 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMscited by 117
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiencycited by 66
- 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RLcited by 62
- 2025R-KV: Redundancy-aware KV Cache Compression for Reasoning Modelscited by 54
- 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
38 more
- 2025Optimizing Length Compression in Large Reasoning Modelscited by 38
- 2025Making Slow Thinking Faster: Compressing LLM Chain-of-Thought via Step Entropycited by 38
- 2025ThinkSwitcher: When to Think Hard, When to Think Fastcited by 37
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 35
- 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecyclecited by 35
- 2025DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learningcited by 35
- 2025Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lenscited by 34
- 2025Steering LLM Thinking with Budget Guidancecited by 33
- 2025NaturalThoughts: Selecting and Distilling Reasoning Traces for General Reasoning Taskscited by 32
- 2025ReflAct: World-Grounded Decision Making in LLM Agents via Goal-State Reflectioncited by 31
- 2025R1-Compress: Long Chain-of-Thought Compression via Chunk Compression and Searchcited by 30
- 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Timecited by 29
- 2025FlashThink: An Early Exit Method For Efficient Reasoningcited by 28
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoningcited by 28
- 2025Leaky Thoughts: Large Reasoning Models Are Not Private Thinkerscited by 28
- 2025Optimizing Anytime Reasoning via Budget Relative Policy Optimizationcited by 27
- 2025Let LRMs Break Free from Overthinking via Self-Braking Tuningcited by 27
- 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoningcited by 26
- 2025Shorten After You're Right: Lazy Length Penalties for Reasoning RLcited by 25
- 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Modelscited by 23
- 2025Thought calibration: Efficient and confident test-time scalingcited by 21
- 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twicecited by 21
- 2025Not All Tokens Are What You Need In Thinkingcited by 20
- 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 20
- 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?cited by 19
- 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Modelscited by 18
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2025MMATH: A Multilingual Benchmark for Mathematical Reasoningcited by 17
- 2025OThink-R1: Intrinsic Fast/Slow Thinking Mode Switching for Over-Reasoning Mitigationcited by 17
- 2025Causal Sufficiency and Necessity Improves Chain-of-Thought Reasoningcited by 17
- 2025Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Trainingcited by 16
- 2025How do Transformers Learn Implicit Reasoning?cited by 16
- 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoningcited by 16
- 2025Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Themcited by 15
- 2025Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtcited by 15
- 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skillscited by 14
- 2025Do Thinking Tokens Help or Trap? Towards More Efficient Large Reasoning Modelcited by 14
- 2026NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neuronscited by 14
50 most cited of 187 All 187 (JSON)
- 2026DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning13 Oct 2026
- 2026The Thinking Leakage in Reinforcement Learning for LLMs9 Oct 2026
- 2026What Does a Harness Repair? A Preregistered Study of Visibility, Baseline Adequacy and Evaluation Defects4 Oct 2026
- 2026HyperThink: Text-to-Parameter Hypernetworks for Efficient Reasoning2 Oct 2026
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents1 Oct 2026
- 2026Budget Boundary Effects in Test-Time Mathematical Reasoning30 Sep 2026
- 2026MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller29 Sep 2026
- 2026On the Token Value Inequality in Efficient Reasoning27 Sep 2026
- 2026Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models22 Sep 2026
- 2026Revisiting Complete Reasoning Traces for Post-Training7 Sep 2026
- 2026Detecting Hidden Chain-of-Thought in Large Language Models with Linguistic, Behavioral, and Mechanistic Indicators30 Aug 2026
- 2026AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning28 Aug 2026
38 more
- 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing28 Aug 2026
- 2026Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning14 Aug 2026
- 2026Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models13 Aug 2026
- 2026Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs13 Aug 2026
- 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoning10 Aug 2026
- 2026Thinking vs. NoThinking: Towards Interpreting Reasoning Mechanisms of Large Language Models via Sparse Autoencoders8 Aug 2026
- 2026Thinking Hard, Not Smart: Reasoning Models Fail to Ration Test-Time Compute Across Questions8 Aug 2026
- 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization22 Jul 2026
- 2026Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models15 Jul 2026
- 2026When Reasoning Hurts Legal Drafting: The Verbalization Bottleneck in Patent Claim Generation11 Jul 2026
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks30 Jun 2026
- 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models22 Jun 2026
- 2026Stop When Further Reasoning Won't Help: Attention-State Adaptive Generation in Reasoning Models13 Jun 2026
- 2026SLMJury: Can Small Language Models Judge as Well as Large Ones?5 Jun 2026
- 2026Think Fast: Estimating No-CoT Task-Completion Time Horizons of Frontier AI Models5 Jun 2026
- 2026DyCon: Dynamic Reasoning Control via Evolving Difficulty Modeling5 Jun 2026
- 2026Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning2 Jun 2026
- 2026ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning2 Jun 2026
- 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models1 Jun 2026
- 2026LISA: Linear-Indexed Sparse Attention for Efficient Long-Context Reasoning29 May 2026
- 2026AdaptR1: Reinforcement Learning Based Adaptive Interleaved Thinking in Multi-hop Question Answering29 May 2026
- 2026ThinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoning26 May 2026
- 2026Taming the Thinker: Conditional Entropy Shaping for Adaptive LLM Reasoning19 May 2026
- 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models17 May 2026
- 2026Uncovering the Representation Geometry of Minimal Cores in Overcomplete Reasoning Traces14 May 2026
- 2026The Coupling Tax: How Shared Token Budgets Undermine Visible Chain-of-Thought Under Fixed Output Limits8 May 2026
- 2026Seeing Isn't Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents19 Apr 2026
- 2026Step-GRPO: Internalizing Dynamic Early Exit for Efficient Reasoning18 Apr 2026
- 2026Where does output diversity collapse in post-training?17 Apr 2026
- 2026From P(y|x) to P(y): Investigating Reinforcement Learning in Pre-train Space15 Apr 2026
- 2026When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning8 Apr 2026
- 2026Graph-Based Chain-of-Thought Pruning for Reducing Redundant Reflections in Reasoning LLMs7 Apr 2026
- 2026ETR: Entropy Trend Reward for Efficient Chain-of-Thought Reasoning7 Apr 2026
- 2026Early Stopping for Large Reasoning Models via Confidence Dynamics6 Apr 2026
- 2026NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons3 Apr 2026
- 2026Reasoning Traces Shape Outputs but Models Won't Say So21 Mar 2026
- 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RL18 Mar 2026
- 2026InfoDensity: Rewarding Information-Dense Traces for Efficient Reasoning18 Mar 2026
50 newest of 187 All 187 (JSON)
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2025Dynamic Early Exit in Reasoning Modelscited by 219
- 2025Learning to Reason without External Rewardscited by 210
- 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMscited by 117
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiencycited by 66
- 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RLcited by 62
- 2025R-KV: Redundancy-aware KV Cache Compression for Reasoning Modelscited by 54
- 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
12 most cited of 170 All 170 (JSON)
- 2026DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning13 Oct 2026
- 2026The Thinking Leakage in Reinforcement Learning for LLMs9 Oct 2026
- 2026HyperThink: Text-to-Parameter Hypernetworks for Efficient Reasoning2 Oct 2026
- 2026Budget Boundary Effects in Test-Time Mathematical Reasoning30 Sep 2026
- 2026MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller29 Sep 2026
- 2026On the Token Value Inequality in Efficient Reasoning27 Sep 2026
- 2026Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models22 Sep 2026
- 2026Revisiting Complete Reasoning Traces for Post-Training7 Sep 2026
- 2026Detecting Hidden Chain-of-Thought in Large Language Models with Linguistic, Behavioral, and Mechanistic Indicators30 Aug 2026
- 2026AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning28 Aug 2026
- 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing28 Aug 2026
- 2026Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models13 Aug 2026
12 newest of 170 All 170 (JSON)
- 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecyclecited by 35
- 2025A Survey of Large Language Models for Text-Guided Molecular Discovery: from Molecule Generation to Optimizationcited by 13
- 2026Where does output diversity collapse in post-training?cited by 11
- 2025Bridging the Knowledge-Prediction Gap in LLMs on Multiple-Choice Questionscited by 6
- 2025IMPACT: Inflectional Morphology Probes Across Complex Typologiescited by 4
- 2026SLMJury: Can Small Language Models Judge as Well as Large Ones?cited by 3
- 2025GTAlign: Game-Theoretic Alignment of LLM Assistants for Social Welfarecited by 2
- 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentationcited by 2
- 2025Schema-R1: A reasoning training approach for schema linking in Text-to-SQL Taskcited by 1
- 2026Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoningcited by 0
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agentscited by 0
- 2026What Does a Harness Repair? A Preregistered Study of Visibility, Baseline Adequacy and Evaluation Defectscited by 0
- 2026What Does a Harness Repair? A Preregistered Study of Visibility, Baseline Adequacy and Evaluation Defects4 Oct 2026
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents1 Oct 2026
- 2026Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning14 Aug 2026
- 2026SLMJury: Can Small Language Models Judge as Well as Large Ones?5 Jun 2026
- 2026Where does output diversity collapse in post-training?17 Apr 2026
- 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentation4 Nov 2025
- 2025GTAlign: Game-Theoretic Alignment of LLM Assistants for Social Welfare10 Oct 2025
- 2025Bridging the Knowledge-Prediction Gap in LLMs on Multiple-Choice Questions28 Sep 2025
- 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecycle20 Sep 2025
- 2025IMPACT: Inflectional Morphology Probes Across Complex Typologies30 Jun 2025
- 2025Schema-R1: A reasoning training approach for schema linking in Text-to-SQL Task13 Jun 2025
- 2025A Survey of Large Language Models for Text-Guided Molecular Discovery: from Molecule Generation to Optimization22 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025OptimalThinkingBench: Evaluating Over and Underthinking in LLMs
- 2025Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation
- 2026Thinking with Reasoning Skills: Fewer Tokens, More Accuracy
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning
- 2025The Challenge of Teaching Reasoning to LLMs Without RL or Distillation
- 2026Fork-Think with Confidence
- 2025FINEREASON: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solving
- 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge