mlsanityData to 14 Oct 2026

From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models

arXiv 2511.10788 ↗First posted 13 Nov 2025cs.AI cs.CLcited by 12

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view overlooks a fundamental challenge: current LLMs apply uniform reasoning strategies regardless of task complexity, generating long traces for trivial problems while failing to extend reasoning for difficult tasks. This survey reframes reasoning through the lens of {adaptivity}: the capability to allocate reasoning effort based on input characteristics such as difficulty and uncertainty. We make three contributions. First, we formalize deductive, inductive, and abductive reasoning within the LLM context, connecting these classical cognitive paradigms with their algorithmic realizations. Second, we formalize adaptive reasoning as a control-augmented policy optimization problem balancing task performance with computational cost, distinguishing learned policies from inference-time control mechanisms. Third, we propose a systematic taxonomy organizing existing methods into training-based approaches that internalize adaptivity through reinforcement learning, supervised fine-tuning, and learned controllers, and training-free approaches that achieve adaptivity through prompt conditioning, feedback-driven halting, and modular composition. This framework clarifies how different mechanisms realize adaptive reasoning in practice and enables systematic comparison across diverse strategies. We conclude by identifying open challenges in self-evaluation, meta-reasoning, and human-aligned reasoning control.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 66 of its 86 references that are in the map. First posted on arXiv 13 Nov 2025.

Builds on

66 of 86 references.

Closest ancestors · 42

Same direction, newest first

  1. 2025EAGer: Entropy-Aware GEneRation for Adaptive Inference-Time Scaling13 Oct
  2. 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoning9 Oct
  3. 2025Sample Smart, Not Hard: Correctness-First Decoding for Better Reasoning in LLMs7 Oct
  4. 2025Uncertainty Under the Curve: A Sequence-Level Entropy Area Metric for Reasoning LLM28 Aug
  5. 2025BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens24 Aug
  6. 2025Deep Think with Confidence21 Aug
  7. 2025SABER: Switchable and Balanced Training for Efficient LLM Reasoning8 Aug
  8. 2025Hierarchical Budget Policy Optimization for Adaptive Reasoning21 Jul
  9. 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul
  10. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs2 Jul
  11. 2025ConciseHint: Boosting Efficient Reasoning via Continuous Concise Hints during Generation23 Jun
  12. 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
30 more
  1. 2025AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time30 May
  2. 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models28 May
  3. 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection26 May
  4. 2025Value-Guided Search for Efficient Chain-of-Thought Reasoning23 May
  5. 2025AdaReasoner: Adaptive Reasoning Enables More Flexible Thinking in Large Language Models22 May
  6. 2025Plan and Budget: Effective and Efficient Test-Time Scaling on Reasoning Large Language Models22 May
  7. 2025Learn to Reason Efficiently with Adaptive Length-based Reward Shaping21 May
  8. 2025ThinkSwitcher: When to Think Hard, When to Think Fast20 May
  9. 2025Activation-Guided Consensus Merging for Large Language Models20 May
  10. 2025Optimizing Anytime Reasoning via Budget Relative Policy Optimization19 May
  11. 2025SoftCoT++: Test-Time Scaling with Soft Chain-of-Thought Reasoning16 May
  12. 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning16 May
  13. 2025Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models6 May
  14. 2025Accelerating Large Language Model Reasoning via Speculative Search3 May
  15. 2025Efficient Reasoning for LLMs through Speculative Chain-of-Thought27 Apr
  16. 2025Dynamic Early Exit in Reasoning Models22 Apr
  17. 2025Unlocking Efficient Long-to-Short LLM Reasoning with Model Merging26 Mar
  18. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  19. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  20. 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding3 Mar
  21. 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
  22. 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models27 Feb
  23. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
  24. 2025Dynamic Parallel Tree Search for Efficient LLM Reasoning22 Feb
  25. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
  26. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  27. 2025Bag of Tricks for Inference-time Computation of LLM Reasoning11 Feb
  28. 2025Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization29 Jan
  29. 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost29 Jul
  30. 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMs19 May

Other references · 24

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2024OpenAI o1 System Cardcited by 1,244
  3. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  4. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  5. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  6. 2019Abductive Commonsense Reasoningcited by 301
  7. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  8. 2025Training Language Models to Reason Efficientlycited by 247
  9. 2024Distilling System 2 into System 1cited by 159
  10. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  11. 2025Reasoning with Sampling: Your Base Model is Smarter Than You Thinkcited by 89
  12. 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
12 more
  1. 2024AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Modelscited by 44
  2. 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 40
  3. 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attentioncited by 39
  4. 2025Thinking Machines: A Survey of LLM based Reasoning Strategiescited by 25
  5. 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 20
  6. 2025Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Fastercited by 16
  7. 2025Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipecited by 9
  8. 2025LSPO: Length-aware Dynamic Sampling for Policy Optimization in LLM Reasoningcited by 9
  9. 2025Can Large Language Models Learn Formal Logic? A Data-Driven Training and Evaluation Frameworkcited by 5
  10. 2025Do Language Models Follow Occam's Razor? An Evaluation of Parsimony in Inductive and Abductive Reasoningcited by 4
  11. 2025Slow-Fast Policy Optimization: Reposition-Before-Update for LLM Reasoningcited by 4
  12. 2025Mixture of Reasonings: Teach Large Language Models to Reason with Adaptive Strategiescited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 10.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Art of Efficient Reasoning: Data, Reward, and Optimization
  2. 2026Correct, Concise and Complete: Multi-stage Training For Adaptive Reasoning
  3. 2023Adaptive-Solver Framework for Dynamic Strategy Selection in Large Language Model Reasoning
  4. 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
  5. 2025AdapThink: Adaptive Thinking Preferences for Reasoning Language Model
  6. 2025Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement
  7. 2025Thinking Fast and Right: Balancing Accuracy and Reasoning Length with Adaptive Rewards
  8. 2026Policy of Thoughts: Scaling Test-Time Training for LLM Reasoning via Online Policy Evolution