KAT-V1: Kwai-AutoThink Technical Report
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
We present Kwaipilot-AutoThink (KAT), an open-source 40B large language model developed to address the overthinking problem in reasoning-intensive tasks, where an automatic thinking training paradigm is proposed to dynamically switch between reasoning and non-reasoning modes based on task complexity. Specifically, first, we construct the dual-regime dataset based on a novel tagging pipeline and a multi-agent synthesis strategy, and then we apply Multi-Token Prediction (MTP)-enhanced knowledge distillation, enabling efficient and fine-grained reasoning transfer with minimal pretraining cost. Besides, we implement a cold-start initialization strategy that introduces mode-selection priors using majority-vote signals and intent-aware prompting. Finally, we propose Step-SRPO, a reinforcement learning algorithm that incorporates intermediate supervision into the GRPO framework, offering structured guidance over both reasoning-mode selection and response accuracy. Extensive experiments across multiple benchmarks demonstrate that KAT consistently matches or even outperforms current state-of-the-art models, including DeepSeek-R1-0528 and Qwen3-235B-A22B, across a wide range of reasoning-intensive tasks while reducing token usage. Notably, KAT outperforms all open-source models and even surpasses o3-mini on the leakage-controlled LiveCodeBench Pro. Beyond academic evaluation, KAT has been successfully deployed in Kwaipilot (i.e., Kuaishou's internal coding assistant), where it improves real-world development workflows with high accuracy, efficiency, and controllable reasoning behaviors. Moreover, we are actively training a 200B Mixture-of-Experts (MoE) model with 40B active parameters, and early results already show significant gains, further demonstrating the scalability of the AutoThink paradigm.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 47 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
27 of 47 references.
Closest ancestors · 8
Same direction, newest first
- 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Thinkless: LLM Learns When to Think19 May
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
- 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
- 2025Concise Reasoning via Reinforcement Learning7 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
Other references · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023Qwen Technical Reportcited by 3,344
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2024DeepSeek-V3 Technical Reportcited by 811
7 more
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
- 2025A Comprehensive Survey on Long Context Language Modelingcited by 117
- 2025SRPO: A Cross-Domain Implementation of Large-Scale Reinforcement Learning on LLMcited by 68
- 2024M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluationcited by 21
- 2024MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Modelscited by 17
- 2024R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Modelscited by 9
Built on by
Citing papers per year: 2025: 8; 2026: 4.
12 papers.
- 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoningcited by 22
- 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twicecited by 21
- 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
- 2025Omni-AutoThink: Adaptive Multimodal Reasoning via Reinforcement Learningcited by 5
- 2025HiPO: Hybrid Policy Optimization for Dynamic Reasoning in LLMscited by 4
- 2025Fast, Slow, and Tool-augmented Thinking for LLMs: A Reviewcited by 2
- 2025The Valley of Code Reasoning: Scaling Knowledge Distillation of Large Language Modelscited by 2
- 2025SCALE: Selective Resource Allocation for Overcoming Performance Bottlenecks in Mathematical Test-time Scalingcited by 1
- 2026Thinking-Based Non-Thinking: Solving the Reward Hacking Problem in Training Hybrid Reasoning Models via Reinforcement Learningcited by 1
- 2026SoftmaxGRPO: Learning to Reason using Softmax Advantage Group Estimationcited by 1
- 2026Video-FLAIR: Not Whether to Reason, But Howcited by 0
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026SoftmaxGRPO: Learning to Reason using Softmax Advantage Group Estimation10 Aug 2026
- 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice8 Jan 2026
- 2026Thinking-Based Non-Thinking: Solving the Reward Hacking Problem in Training Hybrid Reasoning Models via Reinforcement Learning8 Jan 2026
- 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoning30 Dec 2025
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning15 Dec 2025
- 2025Omni-AutoThink: Adaptive Multimodal Reasoning via Reinforcement Learning3 Dec 2025
- 2025SCALE: Selective Resource Allocation for Overcoming Performance Bottlenecks in Mathematical Test-time Scaling29 Nov 2025
- 2025The Valley of Code Reasoning: Scaling Knowledge Distillation of Large Language Models7 Oct 2025
- 2025HiPO: Hybrid Policy Optimization for Dynamic Reasoning in LLMs28 Sep 2025
- 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learning28 Aug 2025
- 2025Fast, Slow, and Tool-augmented Thinking for LLMs: A Review17 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models
- 2025Let LRMs Break Free from Overthinking via Self-Braking Tuning
- 2025Making Qwen3 Think in Korean with Reinforcement Learning
- 2025K2-Think: A Parameter-Efficient Reasoning System
- 2025ThinkDial: An Open Recipe for Controlling Reasoning Effort in Large Language Models
- 2026Native Reasoning Models: Training Language Models to Reason on Unverifiable Data
- 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback
- 2025Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Models