TAROT: Test-driven and Capability-adaptive Curriculum Reinforcement Fine-tuning for Code Generation with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are changing the coding paradigm, known as vibe coding, yet synthesizing algorithmically sophisticated and robust code still remains a critical challenge. Incentivizing the deep reasoning capabilities of LLMs is essential to overcoming this hurdle. Reinforcement Fine-Tuning (RFT) has emerged as a promising strategy to address this need. However, most existing approaches overlook the heterogeneous difficulty and granularity inherent in test cases, leading to an imbalanced distribution of reward signals and consequently biased gradient updates during training. To address this, we propose Test-driven and cApability-adaptive cuRriculum reinfOrcement fine-Tuning (TAROT). TAROT systematically constructs, for each problem, a four-tier test suite (basic, intermediate, complex, edge), providing a controlled difficulty landscape for curriculum design and evaluation. Crucially, TAROT decouples curriculum progression from raw reward scores, enabling capability-conditioned evaluation and principled selection from a portfolio of curriculum policies rather than incidental test-case difficulty composition. This design fosters stable optimization and more efficient competency acquisition. Extensive experimental results reveal that the optimal curriculum for RFT in code generation is closely tied to a model's inherent capability, with less capable models achieving greater gains with an easy-to-hard progression, whereas more competent models excel under a hard-first curriculum. TAROT provides a reproducible method that adaptively tailors curriculum design to a model's capability, thereby consistently improving the functional correctness and robustness of the generated code. All code and data are released to foster reproducibility and advance community research at https://github.com/deep-diver/TAROT.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
21 of 37 references.
References · 21
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2024A Survey on Large Language Models for Code Generationcited by 658
9 more
- 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 300
- 2025Self-Evolving Curriculum for LLM Reasoningcited by 112
- 2024Evaluating Language Models for Efficient Code Generationcited by 73
- 2024Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learningcited by 65
- 2024Curriculum Learning for Small Code Language Modelscited by 22
- 2025Learning Like Humans: Advancing LLM Reasoning Capabilities via Adaptive Difficulty Curriculum Learning and Expert-Guided Self-Reformulationcited by 20
- 2024LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMscited by 8
- 2025OSVBench: Benchmarking LLMs on Specification Generation Tasks for Operating System Verificationcited by 8
- 2025Should Code Models Learn Pedagogically? A Preliminary Evaluation of Curriculum Learning for Real-World Software Engineering Taskscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
- 2025AdaCuRL: Adaptive Curriculum Reinforcement Learning with Invalid Sample Mitigation and Historical Revisiting
- 2025QueST: Incentivizing LLMs to Generate Difficult Problems
- 2026A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula
- 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models
- 2026TACLer: Tailored Curriculum Reinforcement Learning for Efficient Reasoning
- 2026Internalizing Curriculum Judgment for LLM Reinforcement Fine-Tuning
- 2025Progressive Mastery: Customized Curriculum Learning with Guided Prompting for Mathematical Reasoning