Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundation
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
We introduce Ling 2.0, a series reasoning-oriented language foundation built upon the principle that every activation boosts reasoning capability. Designed to scale from tens of billions to one trillion parameters under a unified Mixture-of-Experts (MoE) paradigm, Ling 2.0 emphasizes high sparsity, cross-scale consistency, and efficiency guided by empirical scaling laws. The series includes three non-thinking (instruct) models - Ling-mini-2.0, Ling-flash-2.0, and Ling-1T - ranging from 16B to 1T total parameters and achieving up to 7-fold active-compute efficiency compared with dense counterparts. Ling 2.0 integrates coordinated innovations across model architecture, pre-training, post-training, and infrastructure: a high-sparsity MoE with MTP for efficient reasoning, reasoning-oriented data and mid-training CoT activation, reinforcement-based fine-tuning (DFT, Evo-CoT), and full-scale FP8 training with fine-grained heterogeneous pipelines. At the trillion scale, Ling-1T establishes a new Pareto frontier of reasoning accuracy versus computational efficiency, demonstrating that sparse activation, when properly aligned with reasoning objectives, enables scalable and efficient intelligence. Collectively, Ling 2.0 provides a coherent, open, and efficient foundation for advancing future reasoning and thinking models, including the Ring series built upon the same base.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. First posted on arXiv 25 Oct 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 11; 2026: 21.
32 papers.
Sort:
By area:
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
- 2026UI-Venus-1.5 Technical Reportcited by 39
- 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 33
- 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystemcited by 28
- 2026Scalable Training of Mixture-of-Experts Models with Megatron Corecited by 16
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2025HBridge: H-Shape Bridging of Heterogeneous Experts for Unified Multimodal Understanding and Generationcited by 11
- 2026Rethinking Language Model Scaling under Transferable Hypersphere Optimizationcited by 11
- 2026TEAM: Temporal-Spatial Consistency Guided Expert Activation for MoE Diffusion Language Model Accelerationcited by 8
- 2026MergeMix: Optimizing Mid-Training Data Mixtures via Learnable Model Mergingcited by 7
- 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Modelscited by 6
- 2026Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scalecited by 6
20 more
- 2025TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummiescited by 5
- 2025SSPO: Subsentence-level Policy Optimizationcited by 4
- 2026Deconstructing Pre-training: Knowledge Attribution Analysis in MoE and Dense Modelscited by 4
- 2026PowLU: An Activation Function for Stable Pre-Training of LLMscited by 4
- 2025Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Modelscited by 3
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligencecited by 3
- 2026SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Modelscited by 3
- 2026Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decodingcited by 3
- 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Modelscited by 2
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMscited by 1
- 2026AR-MAP: Are Autoregressive Large Language Models Implicit Teachers for Diffusion Large Language Models?cited by 1
- 2026On Representation Redundancy in Large-Scale Instruction Tuning Data Selectioncited by 1
- 2026SuperValid: Capability-Aligned OOD Validation for Generalizable Downstream Scalingcited by 1
- 2026UI-Venus-2 Technical Reportcited by 1
- 2025AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expertcited by 0
- 2025OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMscited by 0
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offscited by 0
- 2026Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatorycited by 0
- 2026Hyperparameter Scaling Laws Across MoE Sparsitycited by 0
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agentscited by 0
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026Hyperparameter Scaling Laws Across MoE Sparsity8 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale13 Jun 2026
- 2026SuperValid: Capability-Aligned OOD Validation for Generalizable Downstream Scaling27 May 2026
- 2026PowLU: An Activation Function for Stable Pre-Training of LLMs25 May 2026
- 2026Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatory20 May 2026
- 2026Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decoding1 May 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning14 Apr 2026
- 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Models12 Apr 2026
- 2026Rethinking Language Model Scaling under Transferable Hypersphere Optimization30 Mar 2026
20 more
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offs15 Mar 2026
- 2026Scalable Training of Mixture-of-Experts Models with Megatron Core8 Mar 2026
- 2026On Representation Redundancy in Large-Scale Instruction Tuning Data Selection14 Feb 2026
- 2026UI-Venus-1.5 Technical Report9 Feb 2026
- 2026TEAM: Temporal-Spatial Consistency Guided Expert Activation for MoE Diffusion Language Model Acceleration9 Feb 2026
- 2026SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Models7 Feb 2026
- 2026AR-MAP: Are Autoregressive Large Language Models Implicit Teachers for Diffusion Large Language Models?2 Feb 2026
- 2026MergeMix: Optimizing Mid-Training Data Mixtures via Learnable Model Merging25 Jan 2026
- 2026Deconstructing Pre-training: Knowledge Attribution Analysis in MoE and Dense Models13 Jan 2026
- 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem31 Dec 2025
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligence26 Dec 2025
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMs26 Dec 2025
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec 2025
- 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models6 Dec 2025
- 2025Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Models28 Nov 2025
- 2025TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummies28 Nov 2025
- 2025HBridge: H-Shape Bridging of Heterogeneous Experts for Unified Multimodal Understanding and Generation25 Nov 2025
- 2025OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMs24 Nov 2025
- 2025AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expert23 Nov 2025
- 2025SSPO: Subsentence-level Policy Optimization6 Nov 2025
- 2026Scalable Training of Mixture-of-Experts Models with Megatron Corecited by 16
- 2026Deconstructing Pre-training: Knowledge Attribution Analysis in MoE and Dense Modelscited by 4
- 2026SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Modelscited by 3
- 2026Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decodingcited by 3
- 2026Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatorycited by 0
- 2026Hyperparameter Scaling Laws Across MoE Sparsitycited by 0
- 2026Hyperparameter Scaling Laws Across MoE Sparsity8 Sep 2026
- 2026Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatory20 May 2026
- 2026Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decoding1 May 2026
- 2026Scalable Training of Mixture-of-Experts Models with Megatron Core8 Mar 2026
- 2026SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Models7 Feb 2026
- 2026Deconstructing Pre-training: Knowledge Attribution Analysis in MoE and Dense Models13 Jan 2026
- 2026UI-Venus-1.5 Technical Reportcited by 39
- 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 33
- 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystemcited by 28
- 2026UI-Venus-2 Technical Reportcited by 1
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agentscited by 0
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning14 Apr 2026
- 2026UI-Venus-1.5 Technical Report9 Feb 2026
- 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem31 Dec 2025
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2025HBridge: H-Shape Bridging of Heterogeneous Experts for Unified Multimodal Understanding and Generationcited by 11
- 2026TEAM: Temporal-Spatial Consistency Guided Expert Activation for MoE Diffusion Language Model Accelerationcited by 8
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026TEAM: Temporal-Spatial Consistency Guided Expert Activation for MoE Diffusion Language Model Acceleration9 Feb 2026
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec 2025
- 2025HBridge: H-Shape Bridging of Heterogeneous Experts for Unified Multimodal Understanding and Generation25 Nov 2025
- 2026MergeMix: Optimizing Mid-Training Data Mixtures via Learnable Model Mergingcited by 7
- 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Modelscited by 6
- 2025TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummiescited by 5
- 2026PowLU: An Activation Function for Stable Pre-Training of LLMscited by 4
- 2025Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Modelscited by 3
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligencecited by 3
- 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Modelscited by 2
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMscited by 1
- 2026AR-MAP: Are Autoregressive Large Language Models Implicit Teachers for Diffusion Large Language Models?cited by 1
- 2026On Representation Redundancy in Large-Scale Instruction Tuning Data Selectioncited by 1
- 2026SuperValid: Capability-Aligned OOD Validation for Generalizable Downstream Scalingcited by 1
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offscited by 0
- 2026SuperValid: Capability-Aligned OOD Validation for Generalizable Downstream Scaling27 May 2026
- 2026PowLU: An Activation Function for Stable Pre-Training of LLMs25 May 2026
- 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Models12 Apr 2026
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offs15 Mar 2026
- 2026On Representation Redundancy in Large-Scale Instruction Tuning Data Selection14 Feb 2026
- 2026AR-MAP: Are Autoregressive Large Language Models Implicit Teachers for Diffusion Large Language Models?2 Feb 2026
- 2026MergeMix: Optimizing Mid-Training Data Mixtures via Learnable Model Merging25 Jan 2026
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligence26 Dec 2025
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMs26 Dec 2025
- 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models6 Dec 2025
- 2025Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Models28 Nov 2025
- 2025TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummies28 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open Training Recipes
- 2025Think, Prune, Train, Improve: Scaling Reasoning without Scaling Models
- 2024LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning
- 2025DeepDistill: Enhancing LLM Reasoning Capabilities via Large-Scale Difficulty-Graded Data Training
- 2024MAmmoTH2: Scaling Instructions from the Web
- 2025Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement
- 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
- 2026Domyn-Small: A European 10B Reasoning Language Model