ROVER: Routing Object-Centric Visual Evidence for Grounded Multi-Image Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have increasingly localized and interleaved visual evidence for deliberative reasoning. Grounding-based approaches typically focus on regions of interest (RoIs) by injecting cropped image patches or RoI-specific features into the reasoning context. However, such designs can weaken holistic scene understanding and inter-object relations, while incurring decoding costs that scale with the number and size of RoIs. Alternatively, adaptive visual feature selection often requires fine-grained supervision or complex heuristics. To address these limitations, we propose ROVER (Routing Object-centric Visual Evidence for grounded multi-image Reasoning), a lightweight, learnable plugin for efficient global visual evidence routing. Upon each object grounding prediction, ROVER injects a step-specific token triplet to synergistically: (i) aggregate the ongoing reasoning context, (ii) distill intra-image cues into a visual working space via object-centric differential attention, and (iii) route and integrate history-aware evidence across objects and images within this space for subsequent reasoning. We integrate ROVER into Qwen2.5-VL-7B and develop an interleaved SFT-to-GRPO training pipeline. Strictly adhering to the original datasets and evaluation protocols, our method achieves the best performance on MM-GCoT (+4.8% answer accuracy, +14.6% grounding accuracy) and VideoEspresso (+8.6% answer accuracy). The VideoEspresso-trained model demonstrates strong transferability, outperforming the base model by +4.7% on average across diverse benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 79 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
41 of 79 references.
Closest ancestors · 17
Same direction, newest first
- 2026DeepScan: A Training-Free Framework for Visually Grounded Reasoning in Large Vision-Language Models4 Mar
- 2025V-Thinker: Interactive Thinking with Images6 Nov
- 2025Simple o3: Towards Interleaved Vision-Language Reasoning16 Aug
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025FOCUS: Internal MLLM Representations for Efficient Fine-Grained Visual Question Answering26 Jun
- 2025VGR: Visual Grounded Reasoning13 Jun
- 2025Multi-Step Visual Reasoning with Visual Tokens Scaling and Verification8 Jun
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025SATORI-R1: Incentivizing Multimodal Reasoning through Explicit Visual Anchoring25 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
5 more
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 24
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
12 more
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024Long Context Transfer from Language to Visioncited by 515
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 216
- 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 146
- 2024Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoderscited by 139
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 69
- 2025Introducing Visual Perception Token into Multimodal Large Language Modelcited by 26
- 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinementcited by 18
- 2024Differential Transformercited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Improving Visual Reasoning with Iterative Evidence Refinement
- 2026VG-CoT: Towards Trustworthy Visual Reasoning via Grounded Chain-of-Thought
- 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning
- 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
- 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
- 2026Evidence-RL: Towards Evidence-intensive Visual Reasoning
- 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
- 2025DeepSketcher: Internalizing Visual Manipulation for Multimodal Reasoning