mlsanityData to 7 Oct 2026

Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundation

arXiv 2510.22115 ↗First posted 25 Oct 2025cs.CL cs.AI cs.LGcited by 32

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

We introduce Ling 2.0, a series reasoning-oriented language foundation built upon the principle that every activation boosts reasoning capability. Designed to scale from tens of billions to one trillion parameters under a unified Mixture-of-Experts (MoE) paradigm, Ling 2.0 emphasizes high sparsity, cross-scale consistency, and efficiency guided by empirical scaling laws. The series includes three non-thinking (instruct) models - Ling-mini-2.0, Ling-flash-2.0, and Ling-1T - ranging from 16B to 1T total parameters and achieving up to 7-fold active-compute efficiency compared with dense counterparts. Ling 2.0 integrates coordinated innovations across model architecture, pre-training, post-training, and infrastructure: a high-sparsity MoE with MTP for efficient reasoning, reasoning-oriented data and mid-training CoT activation, reinforcement-based fine-tuning (DFT, Evo-CoT), and full-scale FP8 training with fine-grained heterogeneous pipelines. At the trillion scale, Ling-1T establishes a new Pareto frontier of reasoning accuracy versus computational efficiency, demonstrating that sparse activation, when properly aligned with reasoning objectives, enables scalable and efficient intelligence. Collectively, Ling 2.0 provides a coherent, open, and efficient foundation for advancing future reasoning and thinking models, including the Ring series built upon the same base.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. First posted on arXiv 25 Oct 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 11; 2026: 21.

32 papers.

Sort:

By area:

  1. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
  2. 2026UI-Venus-1.5 Technical Reportcited by 39
  3. 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 33
  4. 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystemcited by 28
  5. 2026Scalable Training of Mixture-of-Experts Models with Megatron Corecited by 16
  6. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
  7. 2025HBridge: H-Shape Bridging of Heterogeneous Experts for Unified Multimodal Understanding and Generationcited by 11
  8. 2026Rethinking Language Model Scaling under Transferable Hypersphere Optimizationcited by 11
  9. 2026TEAM: Temporal-Spatial Consistency Guided Expert Activation for MoE Diffusion Language Model Accelerationcited by 8
  10. 2026MergeMix: Optimizing Mid-Training Data Mixtures via Learnable Model Mergingcited by 7
  11. 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Modelscited by 6
  12. 2026Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scalecited by 6
20 more
  1. 2025TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummiescited by 5
  2. 2025SSPO: Subsentence-level Policy Optimizationcited by 4
  3. 2026Deconstructing Pre-training: Knowledge Attribution Analysis in MoE and Dense Modelscited by 4
  4. 2026PowLU: An Activation Function for Stable Pre-Training of LLMscited by 4
  5. 2025Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Modelscited by 3
  6. 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligencecited by 3
  7. 2026SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Modelscited by 3
  8. 2026Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decodingcited by 3
  9. 2026Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Modelscited by 2
  10. 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMscited by 1
  11. 2026AR-MAP: Are Autoregressive Large Language Models Implicit Teachers for Diffusion Large Language Models?cited by 1
  12. 2026On Representation Redundancy in Large-Scale Instruction Tuning Data Selectioncited by 1
  13. 2026SuperValid: Capability-Aligned OOD Validation for Generalizable Downstream Scalingcited by 1
  14. 2026UI-Venus-2 Technical Reportcited by 1
  15. 2025AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expertcited by 0
  16. 2025OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMscited by 0
  17. 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offscited by 0
  18. 2026Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatorycited by 0
  19. 2026Hyperparameter Scaling Laws Across MoE Sparsitycited by 0
  20. 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open Training Recipes
  2. 2025Think, Prune, Train, Improve: Scaling Reasoning without Scaling Models
  3. 2024LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning
  4. 2025DeepDistill: Enhancing LLM Reasoning Capabilities via Large-Scale Difficulty-Graded Data Training
  5. 2024MAmmoTH2: Scaling Instructions from the Web
  6. 2025Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement
  7. 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
  8. 2026Domyn-Small: A European 10B Reasoning Language Model