mlsanityData to 14 Oct 2026

XekRung Technical Report

arXiv 2605.00072 ↗First posted 30 Apr 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present XekRung, a frontier large language model for cybersecurity, designed to provide comprehensive security capabilities. To achieve this, we develop diverse data synthesis pipelines tailored to the cybersecurity domain, enabling the scalable construction of high-quality training data and providing a strong foundation for cybersecurity knowledge and understanding. Building on this foundation, we establish a complete training pipeline spanning continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL) to further extend the model's capabilities. We further introduce a multi-dimensional evaluation system to guide the iterative improvement of both domain-specific and general-purpose abilities. Extensive experiments demonstrate that XekRung achieves state-of-the-art performance on cybersecurity-specific benchmarks among models of the same scale, while maintaining strong performance on general benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 81 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

59 of 81 references.

References · 59

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2024Qwen2.5 Technical Reportcited by 4,942
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  9. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  10. 2023Qwen Technical Reportcited by 3,344
  11. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  12. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
38 more
  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  3. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  4. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
  5. 2024Qwen2 Technical Reportcited by 2,120
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  7. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  8. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  9. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  10. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  11. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  12. 2015Prioritized Experience Replaycited by 1,099
  13. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  14. 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 992
  15. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  16. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
  17. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  18. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
  19. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  20. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  21. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  22. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
  23. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 364
  24. 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 278
  25. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 263
  26. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 192
  27. 2024HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughlycited by 125
  28. 2020OCNLI: Original Chinese Natural Language Inferencecited by 86
  29. 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 71
  30. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
  31. 2024CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligencecited by 62
  32. 2020Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problemscited by 60
  33. 2024CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity Knowledgecited by 55
  34. 2024Does your data spark joy? Performance gains from domain upsampling at the end of trainingcited by 52
  35. 2025Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Reportcited by 31
  36. 2025Primus: A Pioneering Collection of Open-Source Datasets for Cybersecurity LLM Trainingcited by 23
  37. 2025ABKD: Pursuing a Proper Allocation of the Probability Mass in Knowledge Distillation via α-β-Divergencecited by 23
  38. 2025Cyber-Zero: Training Cybersecurity Agents without Runtimecited by 22

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Less Data, More Security: Advancing Cybersecurity LLMs Specialization via Resource-Efficient Domain-Adaptive Continuous Pre-training with Minimal Tokens
  2. 2026MiST: Mid-Training LLMs for Cybersecurity
  3. 2023Out of the Cage: How Stochastic Parrots Win in Cyber Security Environments
  4. 2024Crimson: Empowering Strategic Reasoning in Cybersecurity through Large Language Models
  5. 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledge
  6. 2026Cyber Defense Benchmark: Agentic Threat Hunting Evaluation for LLMs in SecOps
  7. 2025Toward Cybersecurity-Expert Small Language Models
  8. 2025Large Language Model Integration with Reinforcement Learning to Augment Decision-Making in Autonomous Cyber Operations