mlsanityData to 7 Oct 2026

OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe

arXiv 2511.16334 ↗First posted 20 Nov 2025cs.AI cs.CLcited by 37

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproducible data curation and training strategies remains a major barrier to scalable research. In this work, we introduce OpenMMReasoner, a fully transparent two-stage recipe for multimodal reasoning spanning supervised fine-tuning (SFT) and reinforcement learning (RL). In the SFT stage, we construct an 874K-sample cold-start dataset with rigorous step-by-step validation, providing a strong foundation for reasoning capabilities. The subsequent RL stage leverages a 74K-sample dataset across diverse domains to further sharpen and stabilize these abilities, resulting in a more robust and efficient learning process. Extensive evaluations demonstrate that our training recipe not only surpasses strong baselines but also highlights the critical role of data quality and training design in shaping multimodal reasoning performance. Notably, our method achieves a 11.6% improvement over the Qwen2.5-VL-7B-Instruct baseline across nine multimodal reasoning benchmarks, establishing a solid empirical foundation for future large-scale multimodal reasoning research. We open-sourced all our codes, pipeline, and data at https://github.com/EvolvingLMMs-Lab/OpenMMReasoner.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 55 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

44 of 55 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
  2. 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
  3. 2025VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning30 Jul
  4. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
  5. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  6. 2025MiMo-VL Technical Report4 Jun
  7. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  8. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  9. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  10. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  11. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  12. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
7 more
  1. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  2. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
  3. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  4. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  5. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar
  6. 2024Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning6 Mar
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  9. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  11. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  12. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
13 more
  1. 2025Group Sequence Policy Optimizationcited by 788
  2. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  3. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  4. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  5. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  6. 2025LIMO: Less is More for Reasoningcited by 488
  7. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
  8. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  9. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  10. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
  11. 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 101
  12. 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoningcited by 16
  13. 2025MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimizationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 33.

37 papers.

Sort:

By area:

  1. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
  2. 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipecited by 43
  3. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methodscited by 27
  4. 2026Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Modelscited by 13
  5. 2025DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Modelscited by 10
  6. 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
  7. 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
  8. 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Modelcited by 8
  9. 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discoverycited by 7
  10. 2025InEx: Hallucination Mitigation via Introspection and Cross-Modal Multi-Agent Collaborationcited by 5
  11. 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoningcited by 5
  12. 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5
25 more
  1. 2026SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMscited by 4
  2. 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaborationcited by 4
  3. 2026What does RL improve for Visual Reasoning? A Frankenstein-Style Analysiscited by 3
  4. 2026MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documentscited by 3
  5. 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 3
  6. 2025Script: Graph-Structured and Query-Conditioned Semantic Token Pruning for Multimodal Large Language Modelscited by 2
  7. 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 2
  8. 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctnesscited by 2
  9. 2026Reinforcement Learning with Robust Rubric Rewardscited by 2
  10. 2026Valley3: Scaling Omni Foundation Models for E-commercecited by 1
  11. 2026OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Modelscited by 1
  12. 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolutioncited by 1
  13. 2026Stage-1 Controls the Entropy Regime, Not the Outcomecited by 1
  14. 2026StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understandingcited by 1
  15. 2026RL Starts before RL: On Policy Distillation for Better Reinforcement Learningcited by 1
  16. 2026LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoningcited by 0
  17. 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learningcited by 0
  18. 2026HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Modelscited by 0
  19. 2026Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMscited by 0
  20. 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
  21. 2026CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractionscited by 0
  22. 2026Dual-Latent Memory Routing for Vision-Language Reasoningcited by 0
  23. 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
  24. 2026SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Modelscited by 0
  25. 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  2. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
  3. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
  4. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL
  5. 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
  6. 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking
  7. 2026AdaReasoner: Dynamic Tool Orchestration for Iterative Visual Reasoning
  8. 2025Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models