State-of-the-art Small Language Coder Model: Mify-Coder
Not on the map. Why?
Abstract (arXiv)
We present Mify-Coder, a 2.5B-parameter code model trained on 4.2T tokens using a compute-optimal strategy built on the Mify-2.5B foundation model. Mify-Coder achieves comparable accuracy and safety while significantly outperforming much larger baseline models on standard coding and function-calling benchmarks, demonstrating that compact models can match frontier-grade models in code generation and agent-driven workflows. Our training pipeline combines high-quality curated sources with synthetic data generated through agentically designed prompts, refined iteratively using enterprise-grade evaluation datasets. LLM-based quality filtering further enhances data density, enabling frugal yet effective training. Through disciplined exploration of CPT-SFT objectives, data mixtures, and sampling dynamics, we deliver frontier-grade code intelligence within a single continuous training trajectory. Empirical evidence shows that principled data and compute discipline allow smaller models to achieve competitive accuracy, efficiency, and safety compliance. Quantized variants of Mify-Coder enable deployment on standard desktop environments without requiring specialized hardware.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 26 Dec 2025.
Builds on
19 of 23 references.
References · 19
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2024GPT-4o System Cardcited by 4,467
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
- 2022A Systematic Evaluation of Large Language Models of Codecited by 360
- 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
7 more
- 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
- 2022Efficient Training of Language Models to Fill in the Middlecited by 248
- 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 178
- 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 69
- 2025OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMscited by 57
- 2024Arctic-SnowCoder: Demystifying High-Quality Data in Code Pretrainingcited by 5
- 2025Don't Reach for the Stars: Rethinking Topology for Resilient Federated Learningcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Seed-Coder: Let the Code Model Curate Data for Itself
- 2025Learning to Solve and Verify: A Self-Play Framework for Code and Test Generation
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence
- 2025Every Sample Matters: Leveraging Mixture-of-Experts and High-Quality Data for Efficient and Accurate Code LLM
- 2024CodeACT: Code Adaptive Compute-efficient Tuning Framework for Code LLMs
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- 2025Data-efficient LLM Fine-tuning for Code Generation
- 2024Mercury: A Code Efficiency Benchmark for Code Large Language Models