SIFThinker: Spatially-Aware Image Focus for Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Current multimodal large language models (MLLMs) still face significant challenges in complex visual tasks (e.g., spatial understanding, fine-grained perception). Prior methods have tried to incorporate visual reasoning, however, they fail to leverage attention correction with spatial cues to iteratively refine their focus on prompt-relevant regions. In this paper, we introduce SIFThinker, a spatially-aware "think-with-images" framework that mimics human visual perception. Specifically, SIFThinker enables attention correcting and image region focusing by interleaving depth-enhanced bounding boxes and natural language. Our contributions are twofold: First, we introduce a reverse-expansion-forward-inference strategy that facilitates the generation of interleaved image-text chains of thought for process-level supervision, which in turn leads to the construction of the SIF-50K dataset. Besides, we propose GRPO-SIF, a reinforced training paradigm that integrates depth-informed visual grounding into a unified reasoning pipeline, teaching the model to dynamically correct and focus on prompt-relevant regions. Extensive experiments demonstrate that SIFThinker outperforms state-of-the-art methods in spatial understanding and fine-grained visual perception, while maintaining strong general capabilities, highlighting the effectiveness of our method. Code: https://github.com/zhangquanchen/SIFThinker.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 76 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
32 of 76 references.
Closest ancestors · 10
Same direction, newest first
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use25 May
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning20 May
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
- 2025VisRL: Intention-Driven Visual Perception via Reinforced Reasoning10 Mar
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
- 2024SegLLM: Multi-round Reasoning Segmentation24 Oct
Other references · 22
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 166
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
10 more
- 2024OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Frameworkcited by 73
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planningcited by 62
- 2024EventHallusion: Diagnosing Event Hallucinations in Video LLMscited by 57
- 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoningcited by 46
- 2024Align Anything: Training All-Modality Models to Follow Instructions with Language Feedbackcited by 39
- 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
- 2025Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modificationscited by 21
- 2023How to Evaluate the Generalization of Detection? A Benchmark for Comprehensive Open-Vocabulary Detectioncited by 15
- 2025FinMultiTime: A Four-Modal Bilingual Dataset for Financial Time-Series Analysiscited by 11
- 2025Optimization of bi-directional gated loop cell based on multi-head attention mechanism for SSD health state classification modelcited by 4
Built on by
Citing papers per year: 2025: 9; 2026: 16.
25 papers.
Sort:
By area:
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 65
- 2025VisMem: Latent Vision Memory Unlocks Potential of Vision-Language Modelscited by 37
- 2025Explain Before You Answer: A Survey on Compositional Visual Reasoningcited by 28
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Modelscited by 26
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Modelscited by 21
- 2025Learning How to Use Tools, Not Just When: Pattern-Aware Tool-Integrated Reasoningcited by 15
- 2026Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Modelscited by 15
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 11
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoningcited by 9
- 2025Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarioscited by 8
13 more
- 2026PatchCue: Enhancing Vision-Language Model Reasoning with Patch-Based Visual Cuescited by 8
- 2025CATCH: A Modular Cross-domain Adaptive Template with Hookcited by 6
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
- 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesiscited by 6
- 2026Improving Visual Reasoning with Iterative Evidence Refinementcited by 5
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 4
- 2026DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Modelscited by 1
- 2026DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Groundingcited by 0
- 2026Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillationcited by 0
- 2026EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perceptioncited by 0
- 2026HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agentcited by 0
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Modelscited by 0
- 2026Soft Spatial Reasoningcited by 0
- 2026Soft Spatial Reasoning30 Sep 2026
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models30 Sep 2026
- 2026HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agent29 Sep 2026
- 2026EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perception29 Sep 2026
- 2026Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation29 Sep 2026
- 2026DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Grounding21 Sep 2026
- 2026DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models9 Jul 2026
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding7 May 2026
- 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis10 Apr 2026
- 2026Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models22 Mar 2026
- 2026Improving Visual Reasoning with Iterative Evidence Refinement14 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
13 more
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulation9 Mar 2026
- 2026PatchCue: Enhancing Vision-Language Model Reasoning with Patch-Based Visual Cues6 Mar 2026
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention5 Feb 2026
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Models7 Jan 2026
- 2025Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarios30 Nov 2025
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning28 Nov 2025
- 2025VisMem: Latent Vision Memory Unlocks Potential of Vision-Language Models14 Nov 2025
- 2025CATCH: A Modular Cross-domain Adaptive Template with Hook30 Oct 2025
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct 2025
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models29 Sep 2025
- 2025Learning How to Use Tools, Not Just When: Pattern-Aware Tool-Integrated Reasoning27 Sep 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025Explain Before You Answer: A Survey on Compositional Visual Reasoning24 Aug 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 65
- 2025Explain Before You Answer: A Survey on Compositional Visual Reasoningcited by 28
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Modelscited by 26
- 2025Learning How to Use Tools, Not Just When: Pattern-Aware Tool-Integrated Reasoningcited by 15
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 11
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoningcited by 9
- 2026PatchCue: Enhancing Vision-Language Model Reasoning with Patch-Based Visual Cuescited by 8
- 2025CATCH: A Modular Cross-domain Adaptive Template with Hookcited by 6
- 2026Improving Visual Reasoning with Iterative Evidence Refinementcited by 5
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 4
12 most cited of 16 All 16 (JSON)
- 2026Soft Spatial Reasoning30 Sep 2026
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models30 Sep 2026
- 2026Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation29 Sep 2026
- 2026DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models9 Jul 2026
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding7 May 2026
- 2026Improving Visual Reasoning with Iterative Evidence Refinement14 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026PatchCue: Enhancing Vision-Language Model Reasoning with Patch-Based Visual Cues6 Mar 2026
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention5 Feb 2026
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning28 Nov 2025
- 2025CATCH: A Modular Cross-domain Adaptive Template with Hook30 Oct 2025
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct 2025
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
- 2025DeepSketcher: Internalizing Visual Manipulation for Multimodal Reasoning
- 2026Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration
- 2025Visual Structures Helps Visual Reasoning: Addressing the Binding Problem in VLMs
- 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
- 2026Look Where You Say You're Looking: Self-Grounded Attention for Visual Reasoning