mlsanityData to 7 Oct 2026

Guiding the Inner Eye: A Framework for Hierarchical and Flexible Visual Grounded Reasoning

arXiv 2511.22172 ↗First posted 27 Nov 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Models capable of "thinking with images" by dynamically grounding their reasoning in visual evidence represent a major leap in multimodal AI. However, replicating and advancing this ability is non-trivial, with current methods often trapped between the instability of end-to-end reinforcement learning (RL) and the rigidity of supervised fine-tuning (SFT). This leads to models that either struggle to learn or lack the cognitive flexibility required for complex, real-world scenes. To navigate this dilemma, we introduce GRiP (Guided Reasoning and Perception), a novel two-stage training framework that cultivates robust and flexible visual grounded reasoning by explicitly guiding the model's perceptual focus and logical pathways. GRiP's core lies in its cognitive-enhanced RL stage, which features two key innovations: (1) a Salience-Weighted IoU Reward that incentivizes the model to prioritize the localization of mission-critical objects over trivial distractors, and (2) a Multi-Heuristic Reward that encourages cognitive flexibility by rewarding diverse yet logically valid reasoning pathways. Initialized from the Qwen2.5-VL-7B model, GRiP demonstrates significant performance gains across multiple challenging benchmarks. It achieves state-of-the-art results among open-source models on the highly challenging TreeBench and V* Bench, proving its effectiveness in complex visual reasoning. Our work demonstrates that moving beyond simplistic rewards and instead guiding models with cognitively-inspired signals for what to see and how to think is crucial for unlocking the next level of multimodal intelligence. The code will be made publicly available.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 20 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

19 of 20 references.

References · 19

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Segment Anythingcited by 8,158
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  10. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  11. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  12. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
7 more
  1. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  2. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  3. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  4. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  5. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  6. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
  7. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning
  2. 2025Grounded Reinforcement Learning for Visual Reasoning
  3. 2026Anchoring What Matters: A Dual-Level Learning Framework for Visually-Grounded Multimodal Reasoning
  4. 2026MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding
  5. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
  6. 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning
  7. 2025Learning When to Look: A Disentangled Curriculum for Strategic Perception in Multimodal Reasoning
  8. 2025V-Thinker: Interactive Thinking with Images