K2-V2: A 360-Open, Reasoning-Enhanced LLM
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
We introduce K2-V2, a 360-open LLM built from scratch as a superior base for reasoning adaptation, in addition to functions such as conversation and knowledge retrieval from general LLMs. It stands as the strongest fully open model, rivals open-weight leaders in its size class, outperforms Qwen2.5-72B and approaches the performance of Qwen3-235B. We actively infuse domain knowledge, reasoning, long-context, and tool use throughout the training process. This explicitly prepares the model for complex reasoning tasks. We demonstrate this potential using simple supervised fine-tuning, establishing a strong baseline that indicates significant headroom for advanced alignment. By releasing the full training history and data composition, we maximize the effectiveness of continuous training, a key open source production scenario. We release the model weights and signature LLM360 artifacts, such as complete training data, to empower the community with a capable, reasoning-centric foundation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 119 of its 220 references that are in the map. First posted on arXiv 5 Dec 2025.
Builds on
119 of 220 references.
Closest ancestors · 7
Same direction, newest first
- 2025ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoning17 Oct
- 2025OpenThoughts: Data Recipes for Reasoning Models4 Jun
- 2025Qwen3 Technical Report14 May
- 2024On Memorization of Large Language Models in Logical Reasoning30 Oct
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools18 Jun
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermism5 Jan
- 2023LLaMA: Open and Efficient Foundation Language Models27 Feb
Other references · 112
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Qwen Technical Reportcited by 3,273
- 2023Mistral 7Bcited by 3,065
38 more
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2024Qwen2 Technical Reportcited by 2,076
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2024Mixtral of Expertscited by 1,785
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2025Gemma 3 Technical Reportcited by 1,686
- 2025s1: Simple test-time scalingcited by 1,311
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2024OpenAI o1 System Cardcited by 1,220
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2023StarCoder: may the source be with you!cited by 790
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
- 2024Yi: Open Foundation Models by 01.AIcited by 706
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2023Baichuan 2: Open Large-scale Language Modelscited by 664
- 2024OLMo: Accelerating the Science of Language Modelscited by 599
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2023Textbooks Are All You Needcited by 561
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
50 most cited of 112 All 112 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025DeepDistill: Enhancing LLM Reasoning Capabilities via Large-Scale Difficulty-Graded Data Training
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration
- 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
- 2025Reason-Align-Respond: Aligning LLM Reasoning with Knowledge Graphs for KGQA
- 2025MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open Training Recipes
- 2026Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning
- 2025OneEval: Benchmarking LLM Knowledge-intensive Reasoning over Diverse Knowledge Bases
- 2024Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Utilization