mlsanityData to 7 Oct 2026

Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models

arXiv 2505.18536 ↗First posted 24 May 2025cs.CL cs.AI cs.CVcited by 13

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Standing in 2025, at a critical juncture in the pursuit of Artificial General Intelligence (AGI), reinforcement fine-tuning (RFT) has demonstrated significant potential in enhancing the reasoning capability of large language models (LLMs) and has led to the development of cutting-edge AI models such as OpenAI-o1 and DeepSeek-R1. Moreover, the efficient application of RFT to enhance the reasoning capability of multimodal large language models (MLLMs) has attracted widespread attention from the community. In this position paper, we argue that reinforcement fine-tuning powers the reasoning capability of multimodal large language models. To begin with, we provide a detailed introduction to the fundamental background knowledge that researchers interested in this field should be familiar with. Furthermore, we meticulously summarize the improvements of RFT in powering reasoning capability of MLLMs into five key points: diverse modalities, diverse tasks and domains, better training algorithms, abundant benchmarks and thriving engineering frameworks. Finally, we propose five promising directions for future research that the community might consider. We hope that this position paper will provide valuable insights to the community at this pivotal stage in the advancement toward AGI. Summary of works done on RFT for MLLMs is available at https://github.com/Sun-Haoyuan23/Awesome-RL-based-Reasoning-MLLMs.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 113 of its 160 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

113 of 160 references.

Closest ancestors · 51

Same direction, newest first

  1. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
  2. 2025Skywork-VL Reward: An Effective Reward Model for Multimodal Understanding and Reasoning12 May
  3. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
  4. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  5. 2025GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling30 Apr
  6. 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr
  7. 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
  8. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
  9. 2025Relation-R1: Progressively Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relation Comprehension20 Apr
  10. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
  11. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
  12. 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
38 more
  1. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  2. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  3. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning10 Apr
  4. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
  5. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  6. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  7. 2025Kimi-VL Technical Report10 Apr
  8. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  9. 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models8 Apr
  10. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
  11. 2025Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme3 Apr
  12. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R131 Mar
  13. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  14. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  15. 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
  16. 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning23 Mar
  17. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  18. 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning20 Mar
  19. 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning20 Mar
  20. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  21. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  22. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
  23. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  24. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  25. 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning10 Mar
  26. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  27. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  28. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model7 Mar
  29. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  30. 2025MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts28 Feb
  31. 2025Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study17 Feb
  32. 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency13 Feb
  33. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
  34. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
  35. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
  36. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models21 Nov
  37. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
  38. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul

50 newest of 51 All 51 (JSON)

Other references · 62

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  9. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  10. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  11. 2016Concrete Problems in AI Safetycited by 1,582
  12. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
38 more
  1. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  2. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
  3. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  5. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  6. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
  7. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  8. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  9. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  10. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  11. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
  12. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
  13. 2025Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyondcited by 175
  14. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
  15. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
  16. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
  17. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
  18. 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
  19. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  20. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 135
  21. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilitiescited by 133
  22. 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
  23. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
  24. 2025What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secretcited by 95
  25. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
  26. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  27. 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1cited by 89
  28. 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
  29. 2025R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learningcited by 65
  30. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 64
  31. 2025ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Modelscited by 56
  32. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Trainingcited by 51
  33. 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 50
  34. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
  35. 2025A Mousetrap: Fooling Large Reasoning Models for Jailbreak with Chain of Iterative Chaoscited by 39
  36. 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learningcited by 37
  37. 2025Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmarkcited by 37
  38. 2025Fast-Slow Thinking GRPO for Large Vision-Language Model Reasoningcited by 34

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 7.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
  2. 2025Large Language Models Reasoning Abilities Under Non-Ideal Conditions After RL-Fine-Tuning
  3. 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigm
  4. 2025Empowering Lightweight MLLMs with Reasoning via Long CoT SFT
  5. 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning
  6. 2025Enhancing Large Language Model Reasoning via Selective Critical Token Fine-Tuning
  7. 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning
  8. 2025SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning