Revisiting the Necessity of Lengthy Chain-of-Thought in Vision-centric Reasoning Generalization
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
We study how different Chain-of-Thought (CoT) designs affect the acquisition of the generalizable visual reasoning ability in vision-language models (VLMs). While CoT data, especially long or visual CoT such as "think with image", has been widely used to supervise intermediate reasoning, it remains unclear why specific CoT designs help and which ones truly support generalizable reasoning. To systematically evaluate this, we focus on a controlled maze-solving benchmark where reasoning rules are fully visual, difficulty can be tuned by grid size, and all the intermediate steps can be automatically generated. Using Qwen2.5-VL-7B under a standard SFT-then-RL pipeline, we compare three representative CoT formats: Language CoT, Grounding CoT (with spatial coordinate trajectories), and Visual CoT (with image manipulations). Our experiments reveal that visual and longer CoT mainly accelerate convergence but do not lift the final performance ceiling; concise CoT containing only essential grounding steps outperforms longer traces; and, strikingly, CoT retaining only the minimal grounding results generalizes best across different maze sizes. We further validate these insights on other vision-centric tasks. These findings highlight a "short is long" effect and provide practical guidance for constructing more generalizable SFT datasets for visual reasoning.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 53 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
47 of 53 references.
Closest ancestors · 18
Same direction, newest first
- 2025Visual Jigsaw Post-Training Improves MLLMs29 Sep
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
- 2025Simple o3: Towards Interleaved Vision-Language Reasoning16 Aug
- 2025Thyme: Think Beyond Images15 Aug
- 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
- 2025Grounded Reinforcement Learning for Visual Reasoning29 May
- 2025ReasonMap: Towards Fine-Grained Visual Reasoning from Transit Maps24 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
6 more
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 29
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Visual Instruction Tuningcited by 7,792
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023A Survey of Large Language Modelscited by 2,537
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
17 more
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2025Seed1.5-VL Technical Reportcited by 367
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 224
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
- 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 116
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
- 2025ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Modelscited by 56
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzlescited by 36
- 2023A Configurable Library for Generating and Manipulating Maze Datasetscited by 31
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 47
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 18
- 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Modelscited by 18
- 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoomcited by 9
- 2026Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillationcited by 9
- 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoningcited by 2
- 2026Rule-Compliant Visual Spatial Planning for Multimodal Large Language Modelscited by 1
- 2026Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agentscited by 0
- 2026Rule-Compliant Visual Spatial Planning for Multimodal Large Language Models20 Aug 2026
- 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoning10 Aug 2026
- 2026Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation7 Jun 2026
- 2026Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents25 May 2026
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception12 Feb 2026
- 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoom1 Feb 2026
- 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models27 Jan 2026
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models30 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning
- 2026Visual Access Boundaries in Vision-Language Model Reasoning
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision
- 2026On the Out-of-Distribution Generalization of Reasoning in Multimodal LLMs for Simple Visual Planning Tasks
- 2025VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning
- 2025ViC-Bench: Benchmarking Visual-Interleaved Chain-of-Thought Capability in MLLMs with Free-Style Intermediate State Representations
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
- 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning