CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) have achieved remarkable success on complex tasks by leveraging long chain-of-thought (CoT) trajectories, yet they frequently exhibit overthinking on simple queries, resulting in significant token overhead and reduced inference efficiency. However, existing compression methods predominantly apply uniform length reduction or rely on coarse-grained difficulty estimation, often leading to performance degradation on difficult problems. To address this limitation, we propose Confidence-Adaptive Thinking (CAT), a framework that incorporates the model's intrinsic self-certainty signals as confidence into the preference optimization process, which autonomously modulates reasoning lengths based on problem difficulty. Experimental results show that CAT consistently outperforms state-of-the-art baselines on reasoning accuracy across multiple benchmarks on different base models. Our work enables LRMs to effectively compress confident responses while deliberating on uncertain ones, offering a potentially robust solution for balancing accuracy and latency in practical industrial scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 18 of its 42 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
18 of 42 references.
Closest ancestors · 10
Same direction, newest first
- 2025Deep Think with Confidence21 Aug
- 2025Efficient Inference for Large Reasoning Models: A Survey29 Mar
- 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond27 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspective18 Dec
- 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost29 Jul
Other references · 8
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024OpenAI o1 System Cardcited by 1,220
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
- 2025Optimizing Length Compression in Large Reasoning Models
- 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities
- 2026Improving reasoning at inference time via uncertainty minimisation
- 2025Certainty-Guided Reasoning in Large Language Models: A Dynamic Thinking Budget Approach
- 2026Confidence-Aware Alignment Makes Reasoning LLMs More Reliable
- 2026Stable Adaptive Thinking via Advantage Shaping and Length-Aware Gradient Regulation
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning