Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reinforcement learning with verifiable rewards (RLVR) has substantially enhanced the reasoning capabilities of multimodal large language models (MLLMs). However, existing RLVR approaches typically rely on outcome-driven optimization that updates both perception and reasoning using a shared reward based solely on the final answer. This shared reward blurs credit assignment, frequently improving reasoning patterns while failing to reliably enhance the accuracy of upstream visual evidence extraction. To address this perception bottleneck, we introduce PRCO (Perception-Reasoning Coevolution), a dual-role RLVR framework with a shared policy. PRCO consists of two cooperative roles: an Observer that generates an evidence caption tailored to the question and a Solver that predicts the final answer based on this caption. Crucially, PRCO employs role-specific reward signals: the Solver is optimized using verifiable outcome rewards on the final answer, while the Observer receives a utility reward derived from the Solver's downstream success. Extensive experiments across eight challenging multimodal reasoning benchmarks demonstrate that PRCO yields consistent improvements across model scales by over 7 points on average accuracy compared to the base model, outperforming prior open-source RL-tuned baselines.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 48 of its 59 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
48 of 59 references.
Closest ancestors · 29
Same direction, newest first
- 2026SketchVL: Policy Optimization via Fine-Grained Credit Assignment for Chart Understanding and More9 Jan
- 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning23 Nov
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learning10 Oct
- 2025Perception-Consistency Multimodal Large Language Models Reasoning via Caption-Regularized Policy Optimization26 Sep
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
- 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
- 2025Semi-off-Policy Reinforcement Learning for Vision-Language Slow-Thinking Reasoning22 Jul
- 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul
- 2025ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs11 Jun
- 2025Revisiting Visual Understanding in Multimodal Reasoning through a Lens of Image Perturbation11 Jun
- 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Reward8 Jun
- 2025Truth in the Few: High-Value Data Selection for Efficient Multi-Modal Reasoning5 Jun
17 more
- 2025SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis2 Jun
- 2025SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learning2 Jun
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning26 May
- 2025R1-ShareVL: Incentivizing Reasoning Capability of Multimodal Large Language Models via Share-GRPO22 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 19
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
- 2025Are Reasoning Models More Prone to Hallucination?cited by 62
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
7 more
- 2025ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learningcited by 41
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 36
- 2026Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameterscited by 33
- 2026Look Inward to Explore Outward: Learning Temperature Policy from LLM Internal States via Hierarchical RLcited by 27
- 2026TabSieve: Explicit In-Table Evidence Selection for Tabular Predictioncited by 4
- 2026Stable Adaptive Thinking via Advantage Shaping and Length-Aware Gradient Regulationcited by 4
- 2026DeepSight: An All-in-One LM Safety Toolkitcited by 2
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidancecited by 12
- 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillationcited by 11
- 2026Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVRcited by 9
- 2026One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinementcited by 6
- 2026Structured Role-Aware Policy Optimization for Multimodal Reasoningcited by 1
- 2026Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Modelscited by 0
- 2026Re3Cap: Retrieval-Guided Refinement for Image Captioning Enhancement via Reinforcement Learningcited by 0
- 2026UniCAR-RL: Seeing Better before Thinking Deeper in Visual Mathematicscited by 0
- 2026Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoningcited by 0
- 2026Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning28 Sep 2026
- 2026UniCAR-RL: Seeing Better before Thinking Deeper in Visual Mathematics12 Sep 2026
- 2026Re3Cap: Retrieval-Guided Refinement for Image Captioning Enhancement via Reinforcement Learning21 Aug 2026
- 2026Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Models9 Jun 2026
- 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidance29 May 2026
- 2026Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR19 May 2026
- 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation10 May 2026
- 2026Structured Role-Aware Policy Optimization for Multimodal Reasoning8 May 2026
- 2026One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement28 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Bridging Perception and Reasoning: Token Reweighting for RLVR in Multimodal LLMs
- 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
- 2026Disentangling Perception and Reasoning in Multimodal LLMs via Reward Design
- 2026Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning
- 2026Reinforcing Multimodal Reasoning via Token-Level Perception-Grounded Advantage Estimation
- 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding
- 2026Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning
- 2026Visually-Guided Policy Optimization for Multimodal Reasoning