DART: Difficulty-Adaptive Reasoning Truncation for Efficient Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Adaptive reasoning is essential for aligning the computational effort of large language models (LLMs) with the intrinsic difficulty of problems. Current chain-of-thought methods boost reasoning ability but indiscriminately generate long explanations, leading to evident inefficiency. However, existing reinforcement learning approaches to adaptive thinking remain unstable and heavily reward-dependent. Here we propose DART, a supervised Difficulty-Adaptive Reasoning Truncation framework that adjusts thinking length according to problem difficulty. By distilling concise reasoning patterns from stronger models, interpolating them into a continuum of reasoning styles, and curating optimal training data that balances correctness and compactness, DART learns when to ``stop thinking''. Across multiple mathematical benchmarks, experimental results demonstrate its remarkable efficiency while preserving or improving accuracy, achieving a significant 81.2% reasoning truncation (DeepSeek-R1-Distill-Qwen-7B on GSM8K dataset) with 5.33× computational acceleration. DART provides a stable and general paradigm for efficient reasoning, advancing the development of adaptive intelligence in LLMs.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 22 of its 33 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
22 of 33 references.
Closest ancestors · 10
Same direction, newest first
- 2025Fast on the Easy, Deep on the Hard: Efficient Reasoning via Powered Length Penalty12 Jun
- 2025AutoL2S: Auto Long-Short Reasoning for Efficient Large Language Models28 May
- 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning21 May
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?9 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
Other references · 12
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2 Technical Reportcited by 2,120
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2025Training Language Models to Reason Efficientlycited by 247
- 2024Distilling System 2 into System 1cited by 159
- 2020LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoningcited by 69
- 2025Z1: Efficient Test-time Scaling with Codecited by 35
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025OckBench: Measuring the Efficiency of LLM Reasoningcited by 11
- 2026Ares: Adaptive Reasoning Effort Selection for Efficient LLM Agentscited by 8
- 2026On-Policy Supervised Fine-Tuning for Efficient Reasoningcited by 4
- 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RLcited by 2
- 2026ExpThink: Experience-Guided Reinforcement Learning for Adaptive Chain-of-Thought Compressioncited by 2
- 2026ExpThink: Experience-Guided Reinforcement Learning for Adaptive Chain-of-Thought Compression8 May 2026
- 2026TRiMS: Real-Time Tracking of Minimal Sufficient Length for Efficient Reasoning via RL18 Mar 2026
- 2026Ares: Adaptive Reasoning Effort Selection for Efficient LLM Agents9 Mar 2026
- 2026On-Policy Supervised Fine-Tuning for Efficient Reasoning13 Feb 2026
- 2025OckBench: Measuring the Efficiency of LLM Reasoning7 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Templates: Dynamic Adaptation of Reasoning Demonstrations via Feasibility-Aware Exploration
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2026Correct, Concise and Complete: Multi-stage Training For Adaptive Reasoning
- 2025Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compression
- 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inference
- 2025ARES: Multimodal Adaptive Reasoning via Difficulty-Aware Token-Level Entropy Shaping
- 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
- 2026Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Models