ADaPT: Token-Level Decoupling for Efficient Large Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large reasoning models rely on long chain-of-thought to achieve strong performance, but applying such reasoning uniformly incurs high computational cost. Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability. We identify the root cause as sequence-level coupling between efficiency incentives and correctness optimization, which implicitly penalizes long but correct reasoning trajectories. To address this issue, we propose Adaptive Dual-Process Thinking (ADaPT), a token-level dual-process framework that explicitly decouples efficiency and correctness signals during training. ADaPT introduces a mode-selection token to control fast and slow reasoning, applying efficiency-related rewards exclusively to this token to avoid penalizing correct long reasoning while encouraging efficiency when appropriate. Moreover, ADaPT enables precise and continuous control over the efficiency-performance trade-off at inference time: by adjusting the generation probability of the mode-selection token, a single trained model can smoothly move along the efficiency-performance Pareto frontier. Extensive experiments demonstrate that ADaPT significantly reduces inference cost while maintaining strong reasoning performance across multiple benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 36 of its 44 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
36 of 44 references.
Closest ancestors · 17
Same direction, newest first
- 2025Your Models Have Thought Enough: Training Large Reasoning Models to Stop Overthinking27 Sep
- 2025ThinkDial: An Open Recipe for Controlling Reasoning Effort in Large Language Models26 Aug
- 2025Cognitive Decision Routing in Large Language Models: When to Think Fast, When to Think Slow17 Aug
- 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention16 Jun
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Thinkless: LLM Learns When to Think19 May
- 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Models18 Apr
- 2025Unlocking Efficient Long-to-Short LLM Reasoning with Model Merging26 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
- 2025s1: Simple test-time scaling31 Jan
5 more
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation3 Oct
- 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoning19 Jan
Other references · 19
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
7 more
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2025Training Language Models to Reason Efficientlycited by 247
- 2025ARM: Adaptive Reasoning Modelcited by 39
- 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
- 2024Automatic Curriculum Expert Iteration for Reliable LLM Reasoningcited by 16
- 2025DynamicMind: A Tri-Mode Thinking System for Large Language Modelscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2025PATS: Process-Level Adaptive Thinking Mode Switching
- 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning
- 2025Optimizing Length Compression in Large Reasoning Models
- 2025Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
- 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
- 2025From Long to Short: LLMs Excel at Trimming Own Reasoning Chains
- 2025Gold-Switch: Training-Free Superposition of Slow- and Fast- Thinking LLMs