Think in Blocks: Adaptive Reasoning from Direct Response to Deep Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Language Models (LLMs) with chains-of-thought have demonstrated strong performance on an increasing range of tasks, particularly those involving complex logical reasoning. However, excessively long chains can lead to overthinking, causing computational waste and slower responses. This raises a question: can LLMs dynamically adjust the length of their reasoning processes based on task complexity? To address this, we propose the Think in Blocks framework, which enables adaptive reasoning-from zero to deep reasoning-by partitioning the reasoning process into a tunable number of blocks. Our main contributions are: (1) Establishing an explicit block-structured paradigm in which the model first predicts an integer reasoning budget-the number of blocks-and then partitions its reasoning accordingly; (2) Training an adaptive model through a three-stage pipeline-Supervised Fine-Tuning, reward-guided Direct Preference Optimization, and Reinforcement Learning-that adjusts its reasoning depth to problem difficulty; (3) Exploiting the explicit block count to dynamically control reasoning depth at inference time, allowing flexible adjustment of chain-of-thought length during deployment.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 23 of its 29 references that are in the map. First posted on arXiv 21 Aug 2025.
Builds on
23 of 29 references.
Closest ancestors · 11
Same direction, newest first
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity7 Jun
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Thinkless: LLM Learns When to Think19 May
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
- 2025Efficient Reasoning Models: A Survey15 Apr
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
Other references · 12
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 280
- 2024Learning to Route LLMs with Confidence Tokenscited by 67
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Adaptive Deep Reasoning: Triggering Deep Thinking When Needed
- 2026The Art of Efficient Reasoning: Data, Reward, and Optimization
- 2025Rethinking Reasoning Quality in Large Language Models through Enhanced Chain-of-Thought via RL
- 2026Adaptive Test-Time Compute Allocation for Block Diffusion Language Models in Complex Reasoning
- 2025Not All Thoughts are Generated Equal: Efficient LLM Reasoning via Multi-Turn Reinforcement Learning
- 2026Correct, Concise and Complete: Multi-stage Training For Adaptive Reasoning
- 2026LEAD: Length-Efficient Adaptive and Dynamic Reasoning for Large Language Models
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models