mlsanityData to 7 Oct 2026

SketchThinker-R1: Towards Efficient Sketch-Style Reasoning in Large Multimodal Models

arXiv 2601.02825 ↗First posted 6 Jan 2026cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Despite the empirical success of extensive, step-by-step reasoning in large multimodal models, long reasoning processes inevitably incur substantial computational overhead, i.e., in terms of higher token costs and increased response time, which undermines inference efficiency. In contrast, humans often employ sketch-style reasoning: a concise, goal-directed cognitive process that prioritizes salient information and enables efficient problem-solving. Inspired by this cognitive efficiency, we propose SketchThinker-R1, which incentivizes sketch-style reasoning ability in large multimodal models. Our method consists of three primary stages. In the Sketch-Mode Cold Start stage, we convert standard long reasoning process into sketch-style reasoning and finetune base multimodal model, instilling initial sketch-style reasoning capability. Next, we train SketchJudge Reward Model, which explicitly evaluates thinking process of model and assigns higher scores to sketch-style reasoning. Finally, we conduct Sketch-Thinking Reinforcement Learning under supervision of SketchJudge to further generalize sketch-style reasoning ability. Experimental evaluation on four benchmarks reveals that our SketchThinker-R1 achieves over 64% reduction in reasoning token cost without compromising final answer accuracy. Qualitative analysis further shows that sketch-style reasoning focuses more on key cues during problem solving.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 50 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

43 of 50 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
  2. 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr
  3. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
  4. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  5. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  6. 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning20 Mar
  7. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  8. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  9. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  10. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  11. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model7 Mar
  12. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
3 more
  1. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  2. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  3. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 28

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  3. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  4. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  5. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  6. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
  7. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 456
  8. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
  9. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
  10. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
  11. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
  12. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
16 more
  1. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
  2. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learningcited by 187
  3. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
  4. 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Taskscited by 150
  5. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectivenesscited by 117
  6. 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Costcited by 108
  7. 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
  8. 2025Self-Training Elicits Concise Reasoning in Large Language Modelscited by 97
  9. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
  10. 2025Efficient Reasoning Models: A Surveycited by 93
  11. 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decodingcited by 62
  12. 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoningcited by 32
  13. 2025VeriThinker: Learning to Verify Makes Reasoning Model Efficientcited by 24
  14. 2025FastMCTS: A Simple Sampling Strategy for Data Synthesiscited by 16
  15. 2024Harnessing Uncertainty-aware Bounding Boxes for Unsupervised 3D Object Detectioncited by 9
  16. 2024Approaching Outside: Scaling Unsupervised 3D Object Detection from 2D Scenecited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Latent Sketchpad: Sketching Visual Thoughts to Elicit Multimodal Reasoning in MLLMs
  2. 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
  3. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  4. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning
  5. 2026InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Reward
  6. 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMs
  7. 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning
  8. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketching