VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reinforcement learning has proven its effectiveness in enhancing the reasoning capabilities of large language models. Recent research efforts have progressively extended this paradigm to multimodal reasoning tasks. Due to the inherent complexity and diversity of multimodal tasks, especially in semantic content and problem formulations, existing models often exhibit unstable performance across various domains and difficulty levels. To address these limitations, we propose VL-Cogito, an advanced multimodal reasoning model trained via a novel multi-stage Progressive Curriculum Reinforcement Learning (PCuRL) framework. PCuRL systematically guides the model through tasks of gradually increasing difficulty, substantially improving its reasoning abilities across diverse multimodal contexts. The framework introduces two key innovations: (1) an online difficulty soft weighting mechanism, dynamically adjusting training difficulty across successive RL training stages; and (2) a dynamic length reward mechanism, which encourages the model to adaptively regulate its reasoning path length according to task complexity, thus balancing reasoning efficiency with correctness. Experimental evaluations demonstrate that VL-Cogito consistently matches or surpasses existing reasoning-oriented models across mainstream multimodal benchmarks spanning mathematics, science, logic, and general understanding, validating the effectiveness of our approach.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 53 of its 84 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
53 of 84 references.
Closest ancestors · 28
Same direction, newest first
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
- 2025EasyARC: Evaluating Vision Language Models on True Visual Reasoning13 Jun
- 2025R1-ShareVL: Incentivizing Reasoning Capability of Multimodal Large Language Models via Share-GRPO22 May
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
- 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
- 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)4 Apr
16 more
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025Praxis-VLM: Vision-Grounded Decision Making via Text-Driven Reinforcement Learning21 Mar
- 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning20 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models30 Aug
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2022CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical Reasoning10 Aug
Other references · 25
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2025Process Reinforcement through Implicit Rewardscited by 504
13 more
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Seed1.5-VL Technical Reportcited by 373
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2025Online Difficulty Filtering for Reasoning Oriented Reinforcement Learningcited by 104
- 2025What Makes a Reward Model a Good Teacher? An Optimization Perspectivecited by 73
- 2024Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learningcited by 47
- 2025Kwai Keye-VL Technical Reportcited by 47
- 2025DUMP: Automated Distribution-Level Curriculum Learning for RL-based LLM Post-trainingcited by 46
- 2025MM-IQ: Benchmarking Human-Like Abstraction and Reasoning in Multimodal Modelscited by 29
- 2025Learning to Reason at the Frontier of Learnabilitycited by 23
- 2025MathFlow: Enhancing the Perceptual Flow of MLLMs for Visual Mathematical Problemscited by 10
Built on by
Citing papers per year: 2025: 11; 2026: 15.
26 papers.
Sort:
By area:
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMscited by 50
- 2025BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clippingcited by 47
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resourcescited by 39
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 23
- 2025Scaling Language-Centric Omnimodal Representation Learningcited by 22
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2025VADE: Variance-Aware Dynamic Sampling via Online Sample-Level Difficulty Estimation for Multimodal RLcited by 11
- 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attributioncited by 10
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thoughtcited by 9
- 2025GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoningcited by 8
14 more
- 2026LaViDa-R1: Advancing Reasoning for Unified Multimodal Diffusion Language Modelscited by 7
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
- 2026RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoningcited by 5
- 2026Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculumcited by 2
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Modelscited by 2
- 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Modelscited by 2
- 2025More Than the Final Answer: Improving Visual Extraction and Logical Consistency in Vision-Language Modelscited by 1
- 2026Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinkingcited by 0
- 2026Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generationcited by 0
- 2026MedLoc-R1: Performance-Aware Curriculum Reward Scheduling for GRPO-Based Medical Visual Groundingcited by 0
- 2026Offline-Online Curriculum RL for Multimodal Reasoningcited by 0
- 2026AffectOmni: RL-Verifiable People-Centric Grounded Affective Reasoning for Social and Art-Related Scenescited by 0
- 2026Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic Papercited by 0
- 2026UniCAR-RL: Seeing Better before Thinking Deeper in Visual Mathematicscited by 0
- 2026UniCAR-RL: Seeing Better before Thinking Deeper in Visual Mathematics12 Sep 2026
- 2026Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic Paper27 Aug 2026
- 2026AffectOmni: RL-Verifiable People-Centric Grounded Affective Reasoning for Social and Art-Related Scenes24 Aug 2026
- 2026Offline-Online Curriculum RL for Multimodal Reasoning26 Jul 2026
- 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models22 Apr 2026
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models11 Apr 2026
- 2026MedLoc-R1: Performance-Aware Curriculum Reward Scheduling for GRPO-Based Medical Visual Grounding30 Mar 2026
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought24 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum5 Mar 2026
- 2026Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generation4 Mar 2026
- 2026RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning25 Feb 2026
14 more
- 2026Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking24 Feb 2026
- 2026LaViDa-R1: Advancing Reasoning for Unified Multimodal Diffusion Language Models15 Feb 2026
- 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attribution27 Jan 2026
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec 2025
- 2025More Than the Final Answer: Improving Visual Extraction and Logical Consistency in Vision-Language Models13 Dec 2025
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing images27 Nov 2025
- 2025VADE: Variance-Aware Dynamic Sampling via Online Sample-Level Difficulty Estimation for Multimodal RL24 Nov 2025
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov 2025
- 2025BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clipping21 Oct 2025
- 2025Scaling Language-Centric Omnimodal Representation Learning13 Oct 2025
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep 2025
- 2025GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning22 Sep 2025
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Model31 Aug 2025
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMscited by 50
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resourcescited by 39
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2025VADE: Variance-Aware Dynamic Sampling via Online Sample-Level Difficulty Estimation for Multimodal RLcited by 11
- 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attributioncited by 10
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thoughtcited by 9
- 2025GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoningcited by 8
- 2026LaViDa-R1: Advancing Reasoning for Unified Multimodal Diffusion Language Modelscited by 7
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
- 2026RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoningcited by 5
- 2026Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculumcited by 2
12 most cited of 21 All 21 (JSON)
- 2026UniCAR-RL: Seeing Better before Thinking Deeper in Visual Mathematics12 Sep 2026
- 2026Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic Paper27 Aug 2026
- 2026AffectOmni: RL-Verifiable People-Centric Grounded Affective Reasoning for Social and Art-Related Scenes24 Aug 2026
- 2026Offline-Online Curriculum RL for Multimodal Reasoning26 Jul 2026
- 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models22 Apr 2026
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models11 Apr 2026
- 2026MedLoc-R1: Performance-Aware Curriculum Reward Scheduling for GRPO-Based Medical Visual Grounding30 Mar 2026
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought24 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum5 Mar 2026
- 2026RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning25 Feb 2026
- 2026Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking24 Feb 2026
12 newest of 21 All 21 (JSON)
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 23
- 2025Scaling Language-Centric Omnimodal Representation Learningcited by 22
- 2025Scaling Language-Centric Omnimodal Representation Learning13 Oct 2025
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Model31 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
- 2025Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models
- 2025Play to Generalize: Learning to Reason Through Game Play
- 2025Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning
- 2025SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learning
- 2026TACLer: Tailored Curriculum Reinforcement Learning for Efficient Reasoning