mlsanityData to 14 Oct 2026

KAT-V1: Kwai-AutoThink Technical Report

arXiv 2507.08297 ↗First posted 11 Jul 2025cs.CLcited by 12

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

We present Kwaipilot-AutoThink (KAT), an open-source 40B large language model developed to address the overthinking problem in reasoning-intensive tasks, where an automatic thinking training paradigm is proposed to dynamically switch between reasoning and non-reasoning modes based on task complexity. Specifically, first, we construct the dual-regime dataset based on a novel tagging pipeline and a multi-agent synthesis strategy, and then we apply Multi-Token Prediction (MTP)-enhanced knowledge distillation, enabling efficient and fine-grained reasoning transfer with minimal pretraining cost. Besides, we implement a cold-start initialization strategy that introduces mode-selection priors using majority-vote signals and intent-aware prompting. Finally, we propose Step-SRPO, a reinforcement learning algorithm that incorporates intermediate supervision into the GRPO framework, offering structured guidance over both reasoning-mode selection and response accuracy. Extensive experiments across multiple benchmarks demonstrate that KAT consistently matches or even outperforms current state-of-the-art models, including DeepSeek-R1-0528 and Qwen3-235B-A22B, across a wide range of reasoning-intensive tasks while reducing token usage. Notably, KAT outperforms all open-source models and even surpasses o3-mini on the leakage-controlled LiveCodeBench Pro. Beyond academic evaluation, KAT has been successfully deployed in Kwaipilot (i.e., Kuaishou's internal coding assistant), where it improves real-world development workflows with high accuracy, efficiency, and controllable reasoning behaviors. Moreover, we are actively training a 200B Mixture-of-Experts (MoE) model with 40B active parameters, and early results already show significant gains, further demonstrating the scalability of the AutoThink paradigm.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 47 references that are in the map. First posted on arXiv 11 Jul 2025.

Builds on

27 of 47 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
  2. 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
  3. 2025Thinkless: LLM Learns When to Think19 May
  4. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
  5. 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
  6. 2025Concise Reasoning via Reinforcement Learning7 Apr
  7. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  8. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec

Other references · 19

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2021Program Synthesis with Large Language Modelscited by 3,637
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  11. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
  12. 2024DeepSeek-V3 Technical Reportcited by 811
7 more
  1. 2024Yi: Open Foundation Models by 01.AIcited by 719
  2. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  3. 2025A Comprehensive Survey on Long Context Language Modelingcited by 117
  4. 2025SRPO: A Cross-Domain Implementation of Large-Scale Reinforcement Learning on LLMcited by 68
  5. 2024M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluationcited by 21
  6. 2024MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Modelscited by 17
  7. 2024R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Modelscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 4.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models
  2. 2025Let LRMs Break Free from Overthinking via Self-Braking Tuning
  3. 2025Making Qwen3 Think in Korean with Reinforcement Learning
  4. 2025K2-Think: A Parameter-Efficient Reasoning System
  5. 2025ThinkDial: An Open Recipe for Controlling Reasoning Effort in Large Language Models
  6. 2026Native Reasoning Models: Training Language Models to Reason on Unverifiable Data
  7. 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback
  8. 2025Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Models