Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The remarkable reasoning capability of large language models (LLMs) stems from cognitive behaviors that emerge through reinforcement with verifiable rewards. This work investigates how to transfer this principle to Multimodal LLMs (MLLMs) to unlock advanced visual reasoning. We introduce a two-stage paradigm built on Qwen2.5-VL-7B: a massive linguistic cold-start fine-tuning, followed by multimodal reinforcement learning (RL) spanning nearly 1,000 steps, surpassing all previous open-source efforts in scale. This pioneering work reveals three fundamental insights: 1) Behavior transfer emerges surprisingly early in cold start due to linguistic mental imagery. 2) Cold start broadly memorizes visual behaviors, while RL critically discerns and scales up effective patterns. 3) Transfer strategically favors high-utility behaviors such as visual reflection. Our resulting model, Open-Vision-Reasoner (OVR), achieves state-of-the-art performance on a suite of reasoning benchmarks, including 95.3% on MATH500, 51.8% on MathVision and 54.6% on MathVerse. We release our model, data, and training dynamics to catalyze the development of more capable, behavior-aligned multimodal reasoners.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 96 of its 140 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
96 of 140 references.
Closest ancestors · 28
Same direction, newest first
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
- 2025LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception21 Apr
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
16 more
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2024Self-Correction is More than Refinement: A Learning Framework for Visual and Language Reasoning Tasks5 Oct
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar
- 2024Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning6 Mar
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 68
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
38 more
- 2023Qwen Technical Reportcited by 3,344
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 426
- 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
- 2025Reasoning with Exploration: An Entropy Perspectivecited by 281
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 14; 2026: 20.
34 papers.
Sort:
By area:
- 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 99
- 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origincited by 97
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 39
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
- 2026STEP3-VL-10B Technical Reportcited by 32
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 26
- 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-trainingcited by 23
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2025VACoT: Rethinking Visual Data Augmentation with VLMscited by 9
- 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoningcited by 8
- 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoningcited by 7
22 more
- 2025What MLLMs Learn about When they Learn about Multimodal Reasoningcited by 6
- 2026MM-ReCoder: Advancing Chart-to-Code Generation with Reinforcement Learning and Self-Correctioncited by 5
- 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Groundingcited by 4
- 2026Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programscited by 4
- 2025MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Modelscited by 3
- 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuningcited by 3
- 2026CodePercept: Code-Grounded Visual STEM Perception for MLLMscited by 3
- 2025Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interactioncited by 2
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 2
- 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctnesscited by 2
- 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Modelscited by 1
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolutioncited by 1
- 2026From Imitation to Intuition: Intrinsic Reasoning for Open-Instance Video Classificationcited by 0
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOTcited by 0
- 2026Learning to Draw ASCII Improves Spatial Reasoning in Language Modelscited by 0
- 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instructcited by 0
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
- 2026VC-Tooler: Learning Compositional and Adaptive Visual Tool Usecited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
- 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoningcited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoningcited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning17 Sep 2026
- 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning3 Sep 2026
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning26 Aug 2026
- 2026VC-Tooler: Learning Compositional and Adaptive Visual Tool Use3 Aug 2026
- 2026MentalThink: Shaping Thoughts in Mental SVG World3 Jul 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct22 Jun 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctness20 Apr 2026
- 2026Learning to Draw ASCII Improves Spatial Reasoning in Language Models16 Apr 2026
- 2026Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programs14 Apr 2026
- 2026MM-ReCoder: Advancing Chart-to-Code Generation with Reinforcement Learning and Self-Correction2 Apr 2026
22 more
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models18 Mar 2026
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT14 Mar 2026
- 2026CodePercept: Code-Grounded Visual STEM Perception for MLLMs11 Mar 2026
- 2026From Imitation to Intuition: Intrinsic Reasoning for Open-Instance Video Classification11 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoning4 Mar 2026
- 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Models26 Feb 2026
- 2026STEP3-VL-10B Technical Report14 Jan 2026
- 2025VACoT: Rethinking Visual Data Augmentation with VLMs2 Dec 2025
- 2025Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interaction28 Nov 2025
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov 2025
- 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning16 Oct 2025
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learning10 Oct 2025
- 2025What MLLMs Learn about When they Learn about Multimodal Reasoning2 Oct 2025
- 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-training30 Sep 2025
- 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding29 Sep 2025
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis28 Sep 2025
- 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoning26 Sep 2025
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Model31 Aug 2025
- 2025MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Models8 Aug 2025
- 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origin20 Jul 2025
- 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul 2025
- 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 99
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 39
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 26
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2025VACoT: Rethinking Visual Data Augmentation with VLMscited by 9
- 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoningcited by 8
- 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoningcited by 7
- 2025What MLLMs Learn about When they Learn about Multimodal Reasoningcited by 6
- 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Groundingcited by 4
- 2026Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programscited by 4
- 2025MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Modelscited by 3
12 most cited of 25 All 25 (JSON)
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning17 Sep 2026
- 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning3 Sep 2026
- 2026VC-Tooler: Learning Compositional and Adaptive Visual Tool Use3 Aug 2026
- 2026MentalThink: Shaping Thoughts in Mental SVG World3 Jul 2026
- 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct22 Jun 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctness20 Apr 2026
- 2026Learning to Draw ASCII Improves Spatial Reasoning in Language Models16 Apr 2026
- 2026Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programs14 Apr 2026
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models18 Mar 2026
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT14 Mar 2026
- 2026CodePercept: Code-Grounded Visual STEM Perception for MLLMs11 Mar 2026
12 newest of 25 All 25 (JSON)
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
- 2026MM-ReCoder: Advancing Chart-to-Code Generation with Reinforcement Learning and Self-Correctioncited by 5
- 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Modelscited by 1
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning26 Aug 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026MM-ReCoder: Advancing Chart-to-Code Generation with Reinforcement Learning and Self-Correction2 Apr 2026
- 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Models26 Feb 2026
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Model31 Aug 2025
- 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origincited by 97
- 2026STEP3-VL-10B Technical Reportcited by 32
- 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-trainingcited by 23
- 2026STEP3-VL-10B Technical Report14 Jan 2026
- 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-training30 Sep 2025
- 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origin20 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback
- 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles
- 2025RewardMap: Tackling Sparse Rewards in Fine-grained Visual Reasoning via Multi-Stage Reinforcement Learning
- 2026Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs