Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Standing in 2025, at a critical juncture in the pursuit of Artificial General Intelligence (AGI), reinforcement fine-tuning (RFT) has demonstrated significant potential in enhancing the reasoning capability of large language models (LLMs) and has led to the development of cutting-edge AI models such as OpenAI-o1 and DeepSeek-R1. Moreover, the efficient application of RFT to enhance the reasoning capability of multimodal large language models (MLLMs) has attracted widespread attention from the community. In this position paper, we argue that reinforcement fine-tuning powers the reasoning capability of multimodal large language models. To begin with, we provide a detailed introduction to the fundamental background knowledge that researchers interested in this field should be familiar with. Furthermore, we meticulously summarize the improvements of RFT in powering reasoning capability of MLLMs into five key points: diverse modalities, diverse tasks and domains, better training algorithms, abundant benchmarks and thriving engineering frameworks. Finally, we propose five promising directions for future research that the community might consider. We hope that this position paper will provide valuable insights to the community at this pivotal stage in the advancement toward AGI. Summary of works done on RFT for MLLMs is available at https://github.com/Sun-Haoyuan23/Awesome-RL-based-Reasoning-MLLMs.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 113 of its 160 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
113 of 160 references.
Closest ancestors · 51
Same direction, newest first
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
- 2025Skywork-VL Reward: An Effective Reward Model for Multimodal Understanding and Reasoning12 May
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling30 Apr
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr
- 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
- 2025Relation-R1: Progressively Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relation Comprehension20 Apr
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
38 more
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning10 Apr
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models8 Apr
- 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
- 2025Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme3 Apr
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R131 Mar
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
- 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning23 Mar
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning20 Mar
- 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning20 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model7 Mar
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2025MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts28 Feb
- 2025Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study17 Feb
- 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency13 Feb
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models21 Nov
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
50 newest of 51 All 51 (JSON)
Other references · 62
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2016Concrete Problems in AI Safetycited by 1,582
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
38 more
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
- 2025Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyondcited by 175
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
- 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 135
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilitiescited by 133
- 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
- 2025What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secretcited by 95
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1cited by 89
- 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
- 2025R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learningcited by 65
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 64
- 2025ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Modelscited by 56
- 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Trainingcited by 51
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 50
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2025A Mousetrap: Fooling Large Reasoning Models for Jailbreak with Chain of Iterative Chaoscited by 39
- 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learningcited by 37
- 2025Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmarkcited by 37
- 2025Fast-Slow Thinking GRPO for Large Vision-Language Model Reasoningcited by 34
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 7.
13 papers.
Sort:
By area:
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 52
- 2025Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimizationcited by 13
- 2025Reinforcement Learning Meets Masked Generative Models: Mask-GRPO for Text-to-Image Generationcited by 12
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 8
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Modelcited by 5
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoningcited by 4
- 2026StreamingClaw Technical Reportcited by 4
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shapingcited by 3
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
- 2026TexEditor: Structure-Preserving Text-Driven Texture Editingcited by 1
- 2026SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessitycited by 1
- 2026SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity24 Jun 2026
- 2026Balancing Performance and Diversity in GRPO Autoregressive Text-to-Image Post-Training19 Jun 2026
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping11 May 2026
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks9 Apr 2026
- 2026StreamingClaw Technical Report23 Mar 2026
- 2026TexEditor: Structure-Preserving Text-Driven Texture Editing19 Mar 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Model25 Dec 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov 2025
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning17 Nov 2025
- 2025Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimization24 Oct 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 52
- 2025Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimizationcited by 13
- 2025Reinforcement Learning Meets Masked Generative Models: Mask-GRPO for Text-to-Image Generationcited by 12
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 8
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Modelcited by 5
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoningcited by 4
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shapingcited by 3
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
- 2026Balancing Performance and Diversity in GRPO Autoregressive Text-to-Image Post-Trainingcited by 0
- 2026Balancing Performance and Diversity in GRPO Autoregressive Text-to-Image Post-Training19 Jun 2026
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping11 May 2026
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks9 Apr 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Model25 Dec 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov 2025
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning17 Nov 2025
- 2025Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimization24 Oct 2025
- 2025Reinforcement Learning Meets Masked Generative Models: Mask-GRPO for Text-to-Image Generation15 Oct 2025
- 2026StreamingClaw Technical Reportcited by 4
- 2026TexEditor: Structure-Preserving Text-Driven Texture Editingcited by 1
- 2026StreamingClaw Technical Report23 Mar 2026
- 2026TexEditor: Structure-Preserving Text-Driven Texture Editing19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025Large Language Models Reasoning Abilities Under Non-Ideal Conditions After RL-Fine-Tuning
- 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigm
- 2025Empowering Lightweight MLLMs with Reasoning via Long CoT SFT
- 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning
- 2025Enhancing Large Language Model Reasoning via Selective Critical Token Fine-Tuning
- 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning
- 2025SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning