mlsanityData to 7 Oct 2026

State-of-the-art Small Language Coder Model: Mify-Coder

arXiv 2512.23747 ↗First posted 26 Dec 2025cs.SE cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present Mify-Coder, a 2.5B-parameter code model trained on 4.2T tokens using a compute-optimal strategy built on the Mify-2.5B foundation model. Mify-Coder achieves comparable accuracy and safety while significantly outperforming much larger baseline models on standard coding and function-calling benchmarks, demonstrating that compact models can match frontier-grade models in code generation and agent-driven workflows. Our training pipeline combines high-quality curated sources with synthetic data generated through agentically designed prompts, refined iteratively using enterprise-grade evaluation datasets. LLM-based quality filtering further enhances data density, enabling frugal yet effective training. Through disciplined exploration of CPT-SFT objectives, data mixtures, and sampling dynamics, we deliver frontier-grade code intelligence within a single continuous training trajectory. Empirical evidence shows that principled data and compute discipline allow smaller models to achieve competitive accuracy, efficiency, and safety compliance. Quantized variants of Mify-Coder enable deployment on standard desktop environments without requiring specialized hardware.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 26 Dec 2025.

Builds on

19 of 23 references.

References · 19

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  6. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  7. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  8. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  9. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  10. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
  11. 2022A Systematic Evaluation of Large Language Models of Codecited by 360
  12. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
7 more
  1. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
  2. 2022Efficient Training of Language Models to Fill in the Middlecited by 248
  3. 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 178
  4. 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 69
  5. 2025OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMscited by 57
  6. 2024Arctic-SnowCoder: Demystifying High-Quality Data in Code Pretrainingcited by 5
  7. 2025Don't Reach for the Stars: Rethinking Topology for Resilient Federated Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Seed-Coder: Let the Code Model Curate Data for Itself
  2. 2025Learning to Solve and Verify: A Self-Play Framework for Code and Test Generation
  3. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence
  4. 2025Every Sample Matters: Leveraging Mixture-of-Experts and High-Quality Data for Efficient and Accurate Code LLM
  5. 2024CodeACT: Code Adaptive Compute-efficient Tuning Framework for Code LLMs
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
  7. 2025Data-efficient LLM Fine-tuning for Code Generation
  8. 2024Mercury: A Code Efficiency Benchmark for Code Large Language Models