mlsanityData to 7 Oct 2026

Scaling Data Difficulty: Improving Coding Models via Reinforcement Learning on Fresh and Challenging Problems

arXiv 2603.07779 ↗First posted 8 Mar 2026cs.CL cs.GL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Training next-generation code generation models requires high-quality datasets, yet existing datasets face difficulty imbalance, format inconsistency, and data quality problems. We address these challenges through systematic data processing and difficulty scaling. We introduce a four-stage Data Processing Framework encompassing collection, processing, filtering, and verification, incorporating Automatic Difficulty Filtering via an LLM-based predict-calibrate-select framework that leverages multi-dimensional difficulty metrics across five weighted dimensions to retain challenging problems while removing simplistic ones. The resulting MicroCoder dataset comprises tens of thousands of curated real competitive programming problems from diverse platforms, emphasizing recency and difficulty. Evaluations on strictly unseen LiveCodeBench demonstrate that MicroCoder achieves 3x larger performance gains within 300 training steps compared to widely-used baseline datasets of comparable size, with consistent advantages under both GRPO and its variant training algorithms. The MicroCoder dataset delivers obvious improvements on medium and hard problems across different model sizes, achieving up to 17.2% relative gains in overall performance where model capabilities are most stretched. These results validate that difficulty-aware data curation improves model performance on challenging tasks, providing multiple insights for dataset creation in code generation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

12 of 27 references.

References · 12

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2021Program Synthesis with Large Language Modelscited by 3,509
  3. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  5. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  6. 2021Measuring Coding Challenge Competence With APPScited by 879
  7. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  8. 2023TACO: Topics in Algorithmic COde generation datasetcited by 150
  9. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 115
  10. 2025ACECODER: Acing Coder RL via Automated Test-Case Synthesiscited by 89
  11. 2025General Scales Unlock AI Evaluation with Explanatory and Predictive Powercited by 30
  12. 2025PT-MoE: An Efficient Finetuning Framework for Integrating Mixture-of-Experts into Prompt Tuningcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025QueST: Incentivizing LLMs to Generate Difficult Problems
  2. 2026Breaking Training Bottlenecks: Effective and Stable Reinforcement Learning for Coding Models
  3. 2026A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula
  4. 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models
  5. 2024StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
  6. 2025AdaptiveLLM: A Framework for Selecting Optimal Cost-Efficient LLM for Code-Generation Based on CoT Length
  7. 2025Seed-Coder: Let the Code Model Curate Data for Itself
  8. 2025OpenCodeReasoning: Advancing Data Distillation for Competitive Coding