mlsanityData to 14 Oct 2026

GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking

arXiv 2506.01078 ↗First posted 1 Jun 2025cs.CV cs.AIcited by 15

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Despite notable advancements in multimodal reasoning, leading Multimodal Large Language Models (MLLMs) still underperform on vision-centric multimodal reasoning tasks in general scenarios. This shortfall stems from their predominant reliance on logic- and knowledge-based slow thinking strategies, while effective for domains like math and science, fail to integrate visual information effectively during reasoning. Consequently, these models often fail to adequately ground visual cues, resulting in suboptimal performance in tasks that require multiple plausible visual interpretations and inferences. To address this, we present GThinker (General Thinker), a novel reasoning MLLM excelling in multimodal reasoning across general scenarios, mathematics, and science. GThinker introduces Cue-Rethinking, a flexible reasoning pattern that grounds inferences in visual cues and iteratively reinterprets these cues to resolve inconsistencies. Building on this pattern, we further propose a two-stage training pipeline, including pattern-guided cold start and incentive reinforcement learning, designed to enable multimodal reasoning capabilities across domains. Furthermore, to support the training, we construct GThinker-11K, comprising 7K high-quality, iteratively-annotated reasoning paths and 4K curated reinforcement learning samples, filling the data gap toward general multimodal reasoning. Extensive experiments demonstrate that GThinker achieves 81.5% on the challenging comprehensive multimodal reasoning benchmark M3CoT, surpassing the latest O4-mini model. It also shows an average improvement of 2.1% on general scenario multimodal reasoning benchmarks, while maintaining on-par performance in mathematical reasoning compared to counterpart advanced reasoning models. The code, model, and data will be released soon at https://github.com/jefferyZhan/GThinker.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 70 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

41 of 70 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  2. 2025Kimi-VL Technical Report10 Apr
  3. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
  4. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  5. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
  6. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  7. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  8. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  9. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
  10. 2024Diving into Self-Evolving Training for Multimodal Reasoning23 Dec
  11. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec
  12. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
6 more
  1. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  2. 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct
  3. 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought26 May
  4. 2024TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding15 Apr
  5. 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models19 Mar
  6. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 23

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  9. 2024OpenAI o1 System Cardcited by 1,244
  10. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  11. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  12. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
11 more
  1. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
  2. 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 169
  3. 2024O1 Replication Journey: A Strategic Progress Report -- Part 1cited by 143
  4. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
  5. 2023Silkie: Preference Distillation for Large Visual Language Modelscited by 130
  6. 2024SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Modelcited by 85
  7. 2025MM-RLHF: The Next Step Forward in Multimodal LLM Alignmentcited by 83
  8. 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 50
  9. 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
  10. 2025Rethinking Reflection in Pre-Trainingcited by 43
  11. 2025Valley2: Exploring Multimodal Models with Scalable Vision-Language Designcited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 7.

15 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  2. 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecyclecited by 35
  3. 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Modelscited by 26
  4. 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
  5. 2025A Survey on Agentic Multimodal Large Language Modelscited by 23
  6. 2025Reinforcement Learning for Large Model: A Surveycited by 9
  7. 2025Perception-Consistency Multimodal Large Language Models Reasoning via Caption-Regularized Policy Optimizationcited by 9
  8. 2026Chain-of-Thought Degrades Visual Spatial Reasoning Capabilities of Multimodal LLMscited by 6
  9. 2026From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Modelscited by 6
  10. 2026RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoningcited by 5
  11. 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflectioncited by 3
  12. 2025Think-Reflect-Revise: A Policy-Guided Reflective Framework for Safety Alignment in Large Vision Language Modelscited by 1
3 more
  1. 2026Attention at Rest Stays at Rest: Breaking Visual Inertia for Cognitive Hallucination Mitigationcited by 0
  2. 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Modelscited by 0
  3. 2026ReTAC: Residual Test-Time Agentic Computation for Video Spatial Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
  2. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning
  3. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  4. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
  5. 2026Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs
  6. 2025Activating Visual Context and Commonsense Reasoning through Masked Prediction in VLMs
  7. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback
  8. 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning