mlsanityData to 14 Oct 2026

Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning

arXiv 2507.05255 ↗First posted 7 Jul 2025cs.CV cs.CLcited by 34

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

The remarkable reasoning capability of large language models (LLMs) stems from cognitive behaviors that emerge through reinforcement with verifiable rewards. This work investigates how to transfer this principle to Multimodal LLMs (MLLMs) to unlock advanced visual reasoning. We introduce a two-stage paradigm built on Qwen2.5-VL-7B: a massive linguistic cold-start fine-tuning, followed by multimodal reinforcement learning (RL) spanning nearly 1,000 steps, surpassing all previous open-source efforts in scale. This pioneering work reveals three fundamental insights: 1) Behavior transfer emerges surprisingly early in cold start due to linguistic mental imagery. 2) Cold start broadly memorizes visual behaviors, while RL critically discerns and scales up effective patterns. 3) Transfer strategically favors high-utility behaviors such as visual reflection. Our resulting model, Open-Vision-Reasoner (OVR), achieves state-of-the-art performance on a suite of reasoning benchmarks, including 95.3% on MATH500, 51.8% on MathVision and 54.6% on MathVerse. We release our model, data, and training dynamics to catalyze the development of more capable, behavior-aligned multimodal reasoners.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 96 of its 140 references that are in the map. First posted on arXiv 7 Jul 2025.

Builds on

96 of 140 references.

Closest ancestors · 28

Same direction, newest first

  1. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  2. 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun
  3. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
  4. 2025LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception21 Apr
  5. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  6. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  7. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
  8. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  9. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  10. 2025Kimi-VL Technical Report10 Apr
  11. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
  12. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
16 more
  1. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  2. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  3. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  5. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  6. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
  7. 2024Self-Correction is More than Refinement: A Learning Framework for Visual and Language Reasoning Tasks5 Oct
  8. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  9. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  10. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar
  11. 2024Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning6 Mar
  12. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  13. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  14. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
  15. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
  16. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 68

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2023Visual Instruction Tuningcited by 7,869
  8. 2025Qwen2.5-VL Technical Reportcited by 5,587
  9. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  10. 2024Qwen2.5 Technical Reportcited by 4,942
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
38 more
  1. 2023Qwen Technical Reportcited by 3,344
  2. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  7. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  8. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  10. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  11. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  12. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  13. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  14. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  15. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  16. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  17. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
  18. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  19. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  20. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  21. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
  22. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  23. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  24. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  25. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  26. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
  27. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 426
  28. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
  29. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  30. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
  31. 2025Seed1.5-VL Technical Reportcited by 373
  32. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
  33. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  34. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  35. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
  36. 2025Reasoning with Exploration: An Entropy Perspectivecited by 281
  37. 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
  38. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 20.

34 papers.

Sort:

By area:

  1. 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 99
  2. 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origincited by 97
  3. 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 39
  4. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
  5. 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
  6. 2026STEP3-VL-10B Technical Reportcited by 32
  7. 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 26
  8. 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-trainingcited by 23
  9. 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
  10. 2025VACoT: Rethinking Visual Data Augmentation with VLMscited by 9
  11. 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoningcited by 8
  12. 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoningcited by 7
22 more
  1. 2025What MLLMs Learn about When they Learn about Multimodal Reasoningcited by 6
  2. 2026MM-ReCoder: Advancing Chart-to-Code Generation with Reinforcement Learning and Self-Correctioncited by 5
  3. 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Groundingcited by 4
  4. 2026Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programscited by 4
  5. 2025MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Modelscited by 3
  6. 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuningcited by 3
  7. 2026CodePercept: Code-Grounded Visual STEM Perception for MLLMscited by 3
  8. 2025Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interactioncited by 2
  9. 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 2
  10. 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctnesscited by 2
  11. 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Modelscited by 1
  12. 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolutioncited by 1
  13. 2026From Imitation to Intuition: Intrinsic Reasoning for Open-Instance Video Classificationcited by 0
  14. 2026QTrack: Query-Driven Reasoning for Multi-modal MOTcited by 0
  15. 2026Learning to Draw ASCII Improves Spatial Reasoning in Language Modelscited by 0
  16. 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instructcited by 0
  17. 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
  18. 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
  19. 2026VC-Tooler: Learning Compositional and Adaptive Visual Tool Usecited by 0
  20. 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
  21. 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoningcited by 0
  22. 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models
  2. 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models
  3. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  4. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback
  5. 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
  6. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles
  7. 2025RewardMap: Tackling Sparse Rewards in Fine-grained Visual Reasoning via Multi-Stage Reinforcement Learning
  8. 2026Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs