Rethinking Easy-to-Hard: Limits of Curriculum Learning in Post-Training for Deductive Reasoning
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Curriculum learning (CL), motivated by the intuition that learning in increasing order of difficulty should ease generalization, is commonly adopted both in pre-training and post-training of large language models (LLMs). The intuition of CL is particularly compelling for compositional reasoning, where complex problems are built from elementary inference rules; however, the actual impact of CL on such tasks remains largely underexplored. We present a systematic empirical study of CL for post-training of LLMs, using synthetic arithmetic and logical benchmarks where difficulty is characterized by reasoning complexity rather than surface-level proxies. Surprisingly, across multiple model families and curriculum schedules, we find no robust advantage in difficulty-based sequencing over standard random sampling in either accuracy or response length. These findings persist across both supervised fine-tuning (SFT) and reinforcement learning (RL) methods. Our study suggests that, in the context of deductive reasoning, the specific ordering of training examples plays a negligible role in achieving compositional generalization, challenging the practical utility of curriculum-based post-training.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 68 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
33 of 68 references.
References · 33
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Let's Verify Step by Stepcited by 3,789
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
21 more
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 570
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
- 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 295
- 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learningcited by 262
- 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 209
- 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 160
- 2024On Memorization of Large Language Models in Logical Reasoningcited by 117
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMscited by 117
- 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learningcited by 93
- 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contaminationcited by 82
- 2025e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMscited by 59
- 2018An Empirical Exploration of Curriculum Learning for Neural Machine Translationcited by 58
- 2016Visualizing and Understanding Curriculum Learning for Long Short-Term Memory Networkscited by 44
- 2025Beyond Random Sampling: Efficient Language Model Pretraining via Curriculum Learningcited by 26
- 2025JustLogic: A Comprehensive Benchmark for Evaluating Deductive Reasoning in Large Language Modelscited by 22
- 2025Frontier LLMs Still Struggle with Simple Reasoning Taskscited by 21
- 2024Data Contamination Report from the 2024 CONDA Shared Taskcited by 20
- 2025Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation Budgetscited by 17
- 2024MathGAP: Out-of-Distribution Evaluation on Problems with Arbitrarily Complex Proofscited by 12
- 2025Revisiting Generalization Across Difficulty Levels: It's Not So Easycited by 5
- 2025Are Language Models Efficient Reasoners? A Perspective from Logic Programmingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoning
- 2026Learning to Reason with Curriculum II: Compositional Generalization
- 2025Progressive Mastery: Customized Curriculum Learning with Guided Prompting for Mathematical Reasoning
- 2024Laying the Foundation First? Investigating the Generalization from Atomic Skills to Complex Reasoning Tasks
- 2025Provable Benefit of Curriculum in Transformer Tree-Reasoning Post-Training
- 2026Curriculum Learning-Guided Progressive Distillation in Large Language Models
- 2025Can an Easy-to-Hard Curriculum Make Reasoning Emerge in Small Language Models? Evidence from a Four-Stage Curriculum on GPT-2
- 2026Compositional Reasoning in Language Models under Reinforcement Learning Post-Training