OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproducible data curation and training strategies remains a major barrier to scalable research. In this work, we introduce OpenMMReasoner, a fully transparent two-stage recipe for multimodal reasoning spanning supervised fine-tuning (SFT) and reinforcement learning (RL). In the SFT stage, we construct an 874K-sample cold-start dataset with rigorous step-by-step validation, providing a strong foundation for reasoning capabilities. The subsequent RL stage leverages a 74K-sample dataset across diverse domains to further sharpen and stabilize these abilities, resulting in a more robust and efficient learning process. Extensive evaluations demonstrate that our training recipe not only surpasses strong baselines but also highlights the critical role of data quality and training design in shaping multimodal reasoning performance. Notably, our method achieves a 11.6% improvement over the Qwen2.5-VL-7B-Instruct baseline across nine multimodal reasoning benchmarks, establishing a solid empirical foundation for future large-scale multimodal reasoning research. We open-sourced all our codes, pipeline, and data at https://github.com/EvolvingLMMs-Lab/OpenMMReasoner.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 55 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
44 of 55 references.
Closest ancestors · 19
Same direction, newest first
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
- 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
- 2025VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning30 Jul
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
- 2025MiMo-VL Technical Report4 Jun
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
7 more
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar
- 2024Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning6 Mar
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 25
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
13 more
- 2025Group Sequence Policy Optimizationcited by 788
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2025LIMO: Less is More for Reasoningcited by 488
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
- 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 101
- 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoningcited by 16
- 2025MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimizationcited by 12
Built on by
Citing papers per year: 2025: 4; 2026: 33.
37 papers.
Sort:
By area:
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipecited by 43
- 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methodscited by 27
- 2026Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Modelscited by 13
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Modelscited by 10
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
- 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Modelcited by 8
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discoverycited by 7
- 2025InEx: Hallucination Mitigation via Introspection and Cross-Modal Multi-Agent Collaborationcited by 5
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoningcited by 5
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5
25 more
- 2026SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMscited by 4
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaborationcited by 4
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysiscited by 3
- 2026MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documentscited by 3
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 3
- 2025Script: Graph-Structured and Query-Conditioned Semantic Token Pruning for Multimodal Large Language Modelscited by 2
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 2
- 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctnesscited by 2
- 2026Reinforcement Learning with Robust Rubric Rewardscited by 2
- 2026Valley3: Scaling Omni Foundation Models for E-commercecited by 1
- 2026OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Modelscited by 1
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolutioncited by 1
- 2026Stage-1 Controls the Entropy Regime, Not the Outcomecited by 1
- 2026StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understandingcited by 1
- 2026RL Starts before RL: On Policy Distillation for Better Reinforcement Learningcited by 1
- 2026LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoningcited by 0
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learningcited by 0
- 2026HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Modelscited by 0
- 2026Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMscited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
- 2026CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractionscited by 0
- 2026Dual-Latent Memory Routing for Vision-Language Reasoningcited by 0
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
- 2026SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Modelscited by 0
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoningcited by 0
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning1 Oct 2026
- 2026SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models28 Sep 2026
- 2026RL Starts before RL: On Policy Distillation for Better Reinforcement Learning23 Sep 2026
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models22 Sep 2026
- 2026Dual-Latent Memory Routing for Vision-Language Reasoning2 Sep 2026
- 2026CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions29 Aug 2026
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning26 Aug 2026
- 2026StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understanding17 Aug 2026
- 2026Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs13 Aug 2026
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model27 Jul 2026
- 2026HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models23 Jul 2026
- 2026Stage-1 Controls the Entropy Regime, Not the Outcome8 Jun 2026
25 more
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning29 May 2026
- 2026Reinforcement Learning with Robust Rubric Rewards28 May 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning19 May 2026
- 2026OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models12 May 2026
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe5 May 2026
- 2026Valley3: Scaling Omni Foundation Models for E-commerce2 May 2026
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs1 May 2026
- 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RL30 Apr 2026
- 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctness20 Apr 2026
- 2026Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Models9 Apr 2026
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration6 Apr 2026
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models18 Mar 2026
- 2026LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoning12 Mar 2026
- 2026MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documents5 Mar 2026
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning18 Feb 2026
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysis12 Feb 2026
- 2026SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMs5 Feb 2026
- 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods29 Jan 2026
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery27 Jan 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models17 Dec 2025
- 2025InEx: Hallucination Mitigation via Introspection and Cross-Modal Multi-Agent Collaboration2 Dec 2025
- 2025Script: Graph-Structured and Query-Conditioned Semantic Token Pruning for Multimodal Large Language Models1 Dec 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methodscited by 27
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Modelcited by 8
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoningcited by 5
- 2026SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMscited by 4
- 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysiscited by 3
- 2026MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documentscited by 3
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 2
- 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctnesscited by 2
- 2026Reinforcement Learning with Robust Rubric Rewardscited by 2
- 2026Valley3: Scaling Omni Foundation Models for E-commercecited by 1
12 most cited of 22 All 22 (JSON)
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning1 Oct 2026
- 2026SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models28 Sep 2026
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models22 Sep 2026
- 2026Dual-Latent Memory Routing for Vision-Language Reasoning2 Sep 2026
- 2026CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions29 Aug 2026
- 2026Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs13 Aug 2026
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model27 Jul 2026
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning29 May 2026
- 2026Reinforcement Learning with Robust Rubric Rewards28 May 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models12 May 2026
- 2026Valley3: Scaling Omni Foundation Models for E-commerce2 May 2026
12 newest of 22 All 22 (JSON)
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Modelscited by 10
- 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discoverycited by 7
- 2025InEx: Hallucination Mitigation via Introspection and Cross-Modal Multi-Agent Collaborationcited by 5
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 3
- 2025Script: Graph-Structured and Query-Conditioned Semantic Token Pruning for Multimodal Large Language Modelscited by 2
- 2026Stage-1 Controls the Entropy Regime, Not the Outcomecited by 1
- 2026HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Modelscited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning26 Aug 2026
- 2026HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models23 Jul 2026
- 2026Stage-1 Controls the Entropy Regime, Not the Outcome8 Jun 2026
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning19 May 2026
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs1 May 2026
- 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RL30 Apr 2026
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery27 Jan 2026
- 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models17 Dec 2025
- 2025InEx: Hallucination Mitigation via Introspection and Cross-Modal Multi-Agent Collaboration2 Dec 2025
- 2025Script: Graph-Structured and Query-Conditioned Semantic Token Pruning for Multimodal Large Language Models1 Dec 2025
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipecited by 43
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaborationcited by 4
- 2026StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understandingcited by 1
- 2026RL Starts before RL: On Policy Distillation for Better Reinforcement Learningcited by 1
- 2026RL Starts before RL: On Policy Distillation for Better Reinforcement Learning23 Sep 2026
- 2026StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understanding17 Aug 2026
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe5 May 2026
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL
- 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
- 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking
- 2026AdaReasoner: Dynamic Tool Orchestration for Iterative Visual Reasoning
- 2025Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models