mlsanityData to 14 Oct 2026

K-EXAONE 2.0 Technical Report

arXiv 2608.04505 ↗First posted 5 Aug 2026cs.CLcited by 0

On the map: Mixture-of-experts → MoE large language models

Abstract (arXiv)

This technical report presents K-EXAONE 2.0, an open-weight multilingual foundation model developed by LG AI Research as a step in our effort toward global frontier-scale foundation models. Rather than training from scratch, we upcycle K-EXAONE and expand its architecture, yielding a Mixture-of-Experts (MoE) model with 750B total parameters and approximately 37B activated per token---more than three times the capacity of its predecessor. K-EXAONE 2.0 supports context lengths of up to 256K tokens and expands multilingual coverage from six to ten languages. Its training pipeline combines continual pre-training, difficulty-focused mid-training, and post-training to strengthen reasoning, agentic coding, multilingual capability, and safety grounded in Korean sociocultural contexts. Across nine evaluation categories selected to reflect the conditions of practical use, K-EXAONE 2.0 improves over K-EXAONE and remains competitive with open-weight models, showing its largest gains in agentic coding and long-context understanding and its clearest strengths in long-context retrieval and safety. Released under the Apache 2.0 license, K-EXAONE 2.0 enables the wider AI ecosystem to evaluate, deploy, adapt, and build upon it, while marking the beginning---rather than the endpoint---of our challenge toward the global frontier.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE large language models, one of 12 directions in Mixture-of-experts. Builds on 35 of its 45 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

35 of 45 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence26 Apr
  2. 2022Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints9 Dec

Other references · 33

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  4. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  9. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  10. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  11. 2025Generalizing Verifiable Instruction Followingcited by 194
  12. 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
21 more
  1. 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 150
  2. 2025FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Languagecited by 143
  3. 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 137
  4. 2026DFlash: Block Diffusion for Flash Speculative Decodingcited by 135
  5. 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
  6. 2025Towards Robust Mathematical Reasoningcited by 73
  7. 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 69
  8. 2024CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreancited by 66
  9. 2024Scaling FP8 training to trillion-token LLMscited by 65
  10. 2025PolyMath: Evaluating Mathematical Reasoning in Multilingual Contextscited by 56
  11. 2022Staged Training for Transformer Language Modelscited by 49
  12. 2025Reasoning to Learn from Latent Thoughtscited by 45
  13. 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generationcited by 45
  14. 2024Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Trainingcited by 43
  15. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
  16. 2026Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameterscited by 36
  17. 2025EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modescited by 32
  18. 2025Open Data Synthesis For Deep Researchcited by 16
  19. 2025Learning Facts at Scale with Active Readingcited by 13
  20. 2026Breaking Entropy Bounds: Accelerating RL Training via MTP with Rejection Samplingcited by 9
  21. 2025From KMMLU-Redux to KMMLU-Pro: A Professional Korean Benchmark Suite for LLM Evaluationcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026K-EXAONE Technical Report
  2. 2026EXAONE 4.5 Technical Report
  3. 2026A.X K1 Technical Report
  4. 2025KORMo: Korean Open Reasoning Model for Everyone
  5. 2024HyperCLOVA X Technical Report
  6. 2026A.X K2 Technical Report
  7. 2025LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models
  8. 2025EXAONE Deep: Reasoning Enhanced Language Models