mlsanityData to 14 Oct 2026

Rethinking Easy-to-Hard: Limits of Curriculum Learning in Post-Training for Deductive Reasoning

arXiv 2603.27226 ↗First posted 28 Mar 2026cs.CLcited by 0

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Curriculum learning (CL), motivated by the intuition that learning in increasing order of difficulty should ease generalization, is commonly adopted both in pre-training and post-training of large language models (LLMs). The intuition of CL is particularly compelling for compositional reasoning, where complex problems are built from elementary inference rules; however, the actual impact of CL on such tasks remains largely underexplored. We present a systematic empirical study of CL for post-training of LLMs, using synthetic arithmetic and logical benchmarks where difficulty is characterized by reasoning complexity rather than surface-level proxies. Surprisingly, across multiple model families and curriculum schedules, we find no robust advantage in difficulty-based sequencing over standard random sampling in either accuracy or response length. These findings persist across both supervised fine-tuning (SFT) and reinforcement learning (RL) methods. Our study suggests that, in the context of deductive reasoning, the specific ordering of training examples plays a negligible role in achieving compositional generalization, challenging the practical utility of curriculum-based post-training.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 68 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

33 of 68 references.

References · 33

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  7. 2025Qwen3 Technical Reportcited by 8,820
  8. 2023Let's Verify Step by Stepcited by 3,789
  9. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  10. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  11. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  12. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
21 more
  1. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 570
  2. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
  3. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 295
  4. 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learningcited by 262
  5. 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 209
  6. 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 160
  7. 2024On Memorization of Large Language Models in Logical Reasoningcited by 117
  8. 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMscited by 117
  9. 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learningcited by 93
  10. 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contaminationcited by 82
  11. 2025e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMscited by 59
  12. 2018An Empirical Exploration of Curriculum Learning for Neural Machine Translationcited by 58
  13. 2016Visualizing and Understanding Curriculum Learning for Long Short-Term Memory Networkscited by 44
  14. 2025Beyond Random Sampling: Efficient Language Model Pretraining via Curriculum Learningcited by 26
  15. 2025JustLogic: A Comprehensive Benchmark for Evaluating Deductive Reasoning in Large Language Modelscited by 22
  16. 2025Frontier LLMs Still Struggle with Simple Reasoning Taskscited by 21
  17. 2024Data Contamination Report from the 2024 CONDA Shared Taskcited by 20
  18. 2025Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation Budgetscited by 17
  19. 2024MathGAP: Out-of-Distribution Evaluation on Problems with Arbitrarily Complex Proofscited by 12
  20. 2025Revisiting Generalization Across Difficulty Levels: It's Not So Easycited by 5
  21. 2025Are Language Models Efficient Reasoners? A Perspective from Logic Programmingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoning
  2. 2026Learning to Reason with Curriculum II: Compositional Generalization
  3. 2025Progressive Mastery: Customized Curriculum Learning with Guided Prompting for Mathematical Reasoning
  4. 2024Laying the Foundation First? Investigating the Generalization from Atomic Skills to Complex Reasoning Tasks
  5. 2025Provable Benefit of Curriculum in Transformer Tree-Reasoning Post-Training
  6. 2026Curriculum Learning-Guided Progressive Distillation in Large Language Models
  7. 2025Can an Easy-to-Hard Curriculum Make Reasoning Emerge in Small Language Models? Evidence from a Four-Stage Curriculum on GPT-2
  8. 2026Compositional Reasoning in Language Models under Reinforcement Learning Post-Training