SketchThinker-R1: Towards Efficient Sketch-Style Reasoning in Large Multimodal Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Despite the empirical success of extensive, step-by-step reasoning in large multimodal models, long reasoning processes inevitably incur substantial computational overhead, i.e., in terms of higher token costs and increased response time, which undermines inference efficiency. In contrast, humans often employ sketch-style reasoning: a concise, goal-directed cognitive process that prioritizes salient information and enables efficient problem-solving. Inspired by this cognitive efficiency, we propose SketchThinker-R1, which incentivizes sketch-style reasoning ability in large multimodal models. Our method consists of three primary stages. In the Sketch-Mode Cold Start stage, we convert standard long reasoning process into sketch-style reasoning and finetune base multimodal model, instilling initial sketch-style reasoning capability. Next, we train SketchJudge Reward Model, which explicitly evaluates thinking process of model and assigns higher scores to sketch-style reasoning. Finally, we conduct Sketch-Thinking Reinforcement Learning under supervision of SketchJudge to further generalize sketch-style reasoning ability. Experimental evaluation on four benchmarks reveals that our SketchThinker-R1 achieves over 64% reduction in reasoning token cost without compromising final answer accuracy. Qualitative analysis further shows that sketch-style reasoning focuses more on key cues during problem solving.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 50 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
43 of 50 references.
Closest ancestors · 15
Same direction, newest first
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning20 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model7 Mar
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
3 more
Other references · 28
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 456
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
16 more
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learningcited by 187
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Taskscited by 150
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectivenesscited by 117
- 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Costcited by 108
- 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
- 2025Self-Training Elicits Concise Reasoning in Large Language Modelscited by 97
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
- 2025Efficient Reasoning Models: A Surveycited by 93
- 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decodingcited by 62
- 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoningcited by 32
- 2025VeriThinker: Learning to Verify Makes Reasoning Model Efficientcited by 24
- 2025FastMCTS: A Simple Sampling Strategy for Data Synthesiscited by 16
- 2024Harnessing Uncertainty-aware Bounding Boxes for Unsupervised 3D Object Detectioncited by 9
- 2024Approaching Outside: Scaling Unsupervised 3D Object Detection from 2D Scenecited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Latent Sketchpad: Sketching Visual Thoughts to Elicit Multimodal Reasoning in MLLMs
- 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning
- 2026InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Reward
- 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMs
- 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketching