From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view overlooks a fundamental challenge: current LLMs apply uniform reasoning strategies regardless of task complexity, generating long traces for trivial problems while failing to extend reasoning for difficult tasks. This survey reframes reasoning through the lens of {adaptivity}: the capability to allocate reasoning effort based on input characteristics such as difficulty and uncertainty. We make three contributions. First, we formalize deductive, inductive, and abductive reasoning within the LLM context, connecting these classical cognitive paradigms with their algorithmic realizations. Second, we formalize adaptive reasoning as a control-augmented policy optimization problem balancing task performance with computational cost, distinguishing learned policies from inference-time control mechanisms. Third, we propose a systematic taxonomy organizing existing methods into training-based approaches that internalize adaptivity through reinforcement learning, supervised fine-tuning, and learned controllers, and training-free approaches that achieve adaptivity through prompt conditioning, feedback-driven halting, and modular composition. This framework clarifies how different mechanisms realize adaptive reasoning in practice and enables systematic comparison across diverse strategies. We conclude by identifying open challenges in self-evaluation, meta-reasoning, and human-aligned reasoning control.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 66 of its 86 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
66 of 86 references.
Closest ancestors · 42
Same direction, newest first
- 2025EAGer: Entropy-Aware GEneRation for Adaptive Inference-Time Scaling13 Oct
- 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoning9 Oct
- 2025Sample Smart, Not Hard: Correctness-First Decoding for Better Reasoning in LLMs7 Oct
- 2025Uncertainty Under the Curve: A Sequence-Level Entropy Area Metric for Reasoning LLM28 Aug
- 2025BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens24 Aug
- 2025Deep Think with Confidence21 Aug
- 2025SABER: Switchable and Balanced Training for Efficient LLM Reasoning8 Aug
- 2025Hierarchical Budget Policy Optimization for Adaptive Reasoning21 Jul
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs2 Jul
- 2025ConciseHint: Boosting Efficient Reasoning via Continuous Concise Hints during Generation23 Jun
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
30 more
- 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time30 May
- 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models28 May
- 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection26 May
- 2025Value-Guided Search for Efficient Chain-of-Thought Reasoning23 May
- 2025AdaReasoner: Adaptive Reasoning Enables More Flexible Thinking in Large Language Models22 May
- 2025Plan and Budget: Effective and Efficient Test-Time Scaling on Reasoning Large Language Models22 May
- 2025Learn to Reason Efficiently with Adaptive Length-based Reward Shaping21 May
- 2025ThinkSwitcher: When to Think Hard, When to Think Fast20 May
- 2025Activation-Guided Consensus Merging for Large Language Models20 May
- 2025Optimizing Anytime Reasoning via Budget Relative Policy Optimization19 May
- 2025SoftCoT++: Test-Time Scaling with Soft Chain-of-Thought Reasoning16 May
- 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning16 May
- 2025Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models6 May
- 2025Accelerating Large Language Model Reasoning via Speculative Search3 May
- 2025Efficient Reasoning for LLMs through Speculative Chain-of-Thought27 Apr
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Unlocking Efficient Long-to-Short LLM Reasoning with Model Merging26 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding3 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models27 Feb
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
- 2025Dynamic Parallel Tree Search for Efficient LLM Reasoning22 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Bag of Tricks for Inference-time Computation of LLM Reasoning11 Feb
- 2025Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization29 Jan
- 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost29 Jul
- 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMs19 May
Other references · 24
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2019Abductive Commonsense Reasoningcited by 301
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2025Training Language Models to Reason Efficientlycited by 247
- 2024Distilling System 2 into System 1cited by 159
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2025Reasoning with Sampling: Your Base Model is Smarter Than You Thinkcited by 89
- 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
12 more
- 2024AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Modelscited by 44
- 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 40
- 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attentioncited by 39
- 2025Thinking Machines: A Survey of LLM based Reasoning Strategiescited by 25
- 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 20
- 2025Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Fastercited by 16
- 2025Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipecited by 9
- 2025LSPO: Length-aware Dynamic Sampling for Policy Optimization in LLM Reasoningcited by 9
- 2025Can Large Language Models Learn Formal Logic? A Data-Driven Training and Evaluation Frameworkcited by 5
- 2025Do Language Models Follow Occam's Razor? An Evaluation of Parsimony in Inductive and Abductive Reasoningcited by 4
- 2025Slow-Fast Policy Optimization: Reposition-Before-Update for LLM Reasoningcited by 4
- 2025Mixture of Reasonings: Teach Large Language Models to Reason with Adaptive Strategiescited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimizationcited by 26
- 2026Ares: Adaptive Reasoning Effort Selection for Efficient LLM Agentscited by 8
- 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoningcited by 6
- 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMscited by 5
- 2025Towards Efficient Agents: A Co-Design of Inference Architecture and Systemcited by 4
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Predictioncited by 3
- 2026When Should an AI Workflow Release? Always-Valid Inference for Black-Box Generate-Verify Systemscited by 3
- 2026When Should a Robot Think? Resource-Aware Reasoning via Reinforcement Learning for Embodied Robotic Decision-Makingcited by 2
- 2026SuCo: Sufficiency-guided Continuous Adaptive Reasoningcited by 1
- 2026Fork-Think with Confidencecited by 1
- 2026Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Modelscited by 0
- 2026Sampling via Decision-Flow: Training-Free Extraction of Improved Latent Reasoning Paths in Large Language Modelscited by 0
- 2026Sampling via Decision-Flow: Training-Free Extraction of Improved Latent Reasoning Paths in Large Language Models11 Sep 2026
- 2026Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Models2 Aug 2026
- 2026Fork-Think with Confidence30 Jun 2026
- 2026SuCo: Sufficiency-guided Continuous Adaptive Reasoning16 Jun 2026
- 2026When Should an AI Workflow Release? Always-Valid Inference for Black-Box Generate-Verify Systems13 May 2026
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction15 Apr 2026
- 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs9 Apr 2026
- 2026When Should a Robot Think? Resource-Aware Reasoning via Reinforcement Learning for Embodied Robotic Decision-Making17 Mar 2026
- 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning13 Mar 2026
- 2026Ares: Adaptive Reasoning Effort Selection for Efficient LLM Agents9 Mar 2026
- 2025Towards Efficient Agents: A Co-Design of Inference Architecture and System20 Dec 2025
- 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimization24 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026The Art of Efficient Reasoning: Data, Reward, and Optimization
- 2026Correct, Concise and Complete: Multi-stage Training For Adaptive Reasoning
- 2023Adaptive-Solver Framework for Dynamic Strategy Selection in Large Language Model Reasoning
- 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
- 2025AdapThink: Adaptive Thinking Preferences for Reasoning Language Model
- 2025Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement
- 2025Thinking Fast and Right: Balancing Accuracy and Reasoning Length with Adaptive Rewards
- 2026Policy of Thoughts: Scaling Test-Time Training for LLM Reasoning via Online Policy Evolution