mlsanityData to 14 Oct 2026

Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning

arXiv 2606.30217 ↗First posted 29 Jun 2026cs.CLcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Large multimodal models have achieved strong reasoning on complex visual tasks, but their inference efficiency is often restricted by long chains of thought. A promising solution is to pair a small draft model with a large target model, enabling cooperative inference employing a routing signal that adaptively routes queries to either the draft or target model based on their difficulties for optimal efficiency and accuracy. Yet, the remaining bottleneck is to establish a reliable query difficulty signal under multimodal settings. Existing approaches designed for language models either rely on post-hoc token probabilities, which fall short in multimodal scenarios, or depend on supervised fine-tuning, which is a data-sensitive strategy. Both paradigms perform routing only after a complete output, and ignore whether the target model can actually solve the routed instances. To address this, we propose PRP, a Proactive Routing Paradigm that enables early decision-making by jointly evaluating the competence of both the draft and target models. Our Draft Rating Learning (DRL) equips the draft model with an internal confidence estimator, while Joint Rating Learning (JRL) predicts how well the target model can handle a given query, thereby prioritizing the allocation of samples it excels at rather than the hardest ones. These ratings enable fine-grained, instance-level Proactive Routing and substantially accelerate inference without compromising overall performance. Extensive experiments across multiple multimodal reasoning benchmarks validate our effectiveness and efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 54 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

39 of 54 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Ovis2.5 Technical Report15 Aug
  2. 2025Skywork-R1V3 Technical Report8 Jul
  3. 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
  4. 2025Visual Agentic Reinforcement Fine-Tuning20 May
  5. 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervision19 May
  6. 2025G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning19 May
  7. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  8. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  9. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  10. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  11. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  12. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec

Other references · 27

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  9. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  10. 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 1,006
  11. 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 843
  12. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
15 more
  1. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  2. 2024EAGLE: Speculative Sampling Requires Rethinking Feature Uncertaintycited by 578
  3. 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 307
  4. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  5. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
  6. 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyondcited by 132
  7. 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoningcited by 106
  8. 2024Learning to Route LLMs with Confidence Tokenscited by 67
  9. 2024Factual Confidence of LLMs: on Reliability and Robustness of Current Estimatorscited by 61
  10. 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29
  11. 2025R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Token Routingcited by 29
  12. 2025Accelerating Large Language Model Reasoning via Speculative Searchcited by 16
  13. 2025CPGD: Toward Stable Rule-based Reinforcement Learning for Language Modelscited by 11
  14. 2025DetailFusion: A Dual-branch Framework with Detail Enhancement for Composed Image Retrievalcited by 4
  15. 2025CARGO: A Framework for Confidence-Aware Routing of Large Language Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dual-Latent Memory Routing for Vision-Language Reasoning
  2. 2026Saliency-Aware Multi-Route Thinking: Revisiting Vision-Language Reasoning
  3. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
  4. 2025Draft and Refine with Visual Experts
  5. 2026The Ebb and Flow of Multimodal Focus: Scheduling Visual Relay Windows for Grounded VLM Reasoning
  6. 2026Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration
  7. 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
  8. 2026Seeing but Not Thinking: Routing Distraction in Multimodal Mixture-of-Experts