RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a prevailing paradigm for enhancing reasoning in Multimodal Large Language Models (MLLMs). However, relying solely on outcome supervision risks reward hacking, where models learn spurious reasoning patterns to satisfy final answer checks. While recent rubric-based approaches offer fine-grained supervision signals, they suffer from high computational costs of instance-level generation and inefficient training dynamics caused by treating all rubrics as equally learnable. In this paper, we propose Stratified Rubric-based Curriculum Learning (RuCL), a novel framework that reformulates curriculum learning by shifting the focus from data selection to reward design. RuCL generates generalized rubrics for broad applicability and stratifies them based on the model's competence. By dynamically adjusting rubric weights during training, RuCL guides the model from mastering foundational perception to tackling advanced logical reasoning. Extensive experiments on various visual reasoning benchmarks show that RuCL yields a remarkable +7.83% average improvement over the Qwen2.5-VL-7B model, achieving a state-of-the-art accuracy of 60.06%.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 62 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
45 of 62 references.
Closest ancestors · 10
Same direction, newest first
- 2025Implicit Actor Critic Coupling via a Supervised Learning Framework for RLVR2 Sep
- 2025Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoning23 Aug
- 2025Curriculum Reinforcement Learning from Easy to Hard Tasks Improves LLM Reasoning7 Jun
- 2025Self-Evolving Curriculum for LLM Reasoning20 May
- 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learning7 Apr
- 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoning3 Apr
- 2025FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient Training R1-like Reasoning Models21 Mar
- 2025S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning18 Feb
- 2025Process Reinforcement through Implicit Rewards3 Feb
- 2017Proximal Policy Optimization Algorithms20 Jul
Other references · 35
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
- 2025Kimi-VL Technical Reportcited by 381
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
23 more
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 315
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 294
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 240
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 238
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
- 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvementcited by 144
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cyclescited by 122
- 2025Checklists Are Better Than Reward Models For Aligning Language Modelscited by 115
- 2025Reinforcement Learning with Rubric Anchorscited by 108
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationcited by 86
- 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thoughtcited by 69
- 2025SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learningcited by 53
- 2025Kwai Keye-VL Technical Reportcited by 47
- 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Rewardcited by 45
- 2025VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoningcited by 26
- 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learningcited by 24
- 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinkingcited by 14
- 2025Mixed-R1: Unified Reward Perspective For Reasoning Capability in Multimodal Large Language Modelscited by 13
- 2025AutoRubric: Rubric-Based Generative Rewards for Faithful Multimodal Reasoningcited by 11
- 2025Rubrik's Cube: Testing a New Rubric for Evaluating Explanations on the CUBE datasetcited by 8
- 2025Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountabilitycited by 5
- 2025EVADE-Bench: Multimodal Benchmark for Evaluating and Enhancing Evasive Content Detectioncited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challengescited by 30
- 2026Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVRcited by 9
- 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscapecited by 4
- 2026CriPO: Enhancing Rubric-based RL via Self-Distillationcited by 4
- 2026Reinforcement Learning with Evolving Rubrics as Rewards for Audio Reasoningcited by 1
- 2026Reinforcement Learning with Evolving Rubrics as Rewards for Audio Reasoning3 Aug 2026
- 2026CriPO: Enhancing Rubric-based RL via Self-Distillation20 Jul 2026
- 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscape7 Jun 2026
- 2026Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR19 May 2026
- 2026Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges15 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Reward and Guidance through Rubrics: Promoting Exploration to Improve Multi-Domain Reasoning
- 2026Offline-Online Curriculum RL for Multimodal Reasoning
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning
- 2026Unlocking the Unsolvable: Teacher-Guided Curriculum for Data-Efficient RLVR
- 2026Step-wise Rubric Rewards for LLM Reasoning
- 2026Curriculum Reinforcement Learning Can Incentivize Reasoning Capacity in LLMs Beyond the Base Model
- 2026VI-CuRL: Stabilizing Verifier-Independent RL Reasoning via Confidence-Guided Variance Reduction
- 2025Direct Reasoning Optimization: Token-Level Reasoning Reflectivity Meets Rubric Gates for Unverifiable Tasks