From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as opaque reasoning paths and insufficient generalization ability. Chain-of-Thought (CoT) reasoning, which has demonstrated significant efficacy in language models by enhancing reasoning transparency and output interpretability, holds promise for improving model reasoning capabilities when extended to the multimodal domain. This paper provides a systematic review centered on "Multimodal Chain-of-Thought" (MCoT). First, it analyzes the background and theoretical motivations for its inception from the perspectives of technical evolution and task demands. Then, it introduces mainstream MCoT methods from three aspects: CoT paradigms, the post-training stage, and the inference stage, while also analyzing their underlying mechanisms. Furthermore, the paper summarizes existing evaluation benchmarks and metrics, and discusses the application scenarios of MCoT. Finally, it analyzes the challenges currently facing MCoT and provides an outlook on its future research directions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 169 of its 248 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
169 of 248 references.
Closest ancestors · 70
Same direction, newest first
- 2025VisuRiddles: Fine-grained Perception is a Primary Bottleneck for Multimodal Large Language Models in Abstract Visual Reasoning3 Jun
- 2025MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs27 May
- 2025MMLU-Reason: Benchmarking Multi-Task Multi-modal Language Understanding and Reasoning22 May
- 2025Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging8 May
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
- 2025Reasoning Physical Video Generation with Diffusion Timestep Tokens via Reinforcement Learning22 Apr
- 2025LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception21 Apr
- 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge14 Apr
- 2025Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation13 Apr
- 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search12 Apr
- 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)4 Apr
- 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning23 Mar
38 more
- 2025Mitigating Visual Forgetting via Take-along Visual Conditioning for Multi-modal Long CoT Reasoning17 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2025Can Atomic Step Decomposition Enhance the Self-structured Reasoning of Multimodal Large Models?8 Mar
- 2025Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Models3 Mar
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models3 Mar
- 2025Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models22 Feb
- 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification19 Feb
- 2025Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study17 Feb
- 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency13 Feb
- 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking4 Feb
- 2025The Jumping Reasoning Curve? Tracking the Evolution of Reasoning Performance in GPT-[n] and o-[n] Models on Multimodal Puzzles3 Feb
- 2025Can Multimodal LLMs do Visual Temporal Understanding and Reasoning? The answer is No!18 Jan
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2025Unlocking Multimodal Mathematical Reasoning via Process Reward Model8 Jan
- 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection8 Jan
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
- 2024Progressive Multimodal Reasoning via Active Retrieval19 Dec
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing13 Dec
- 2024Scaling Inference-Time Search with Vision Value Model for Improved Visual Comprehension4 Dec
- 2024AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning18 Nov
- 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination15 Nov
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024Reasoning Limitations of Multimodal Large Language Models. A Case Study of Bongard Problems2 Nov
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflection30 Oct
- 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Models30 Oct
- 2024MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps18 Oct
- 2024HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks16 Oct
- 2024CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models4 Sep
- 2024Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities15 Aug
50 newest of 70 All 70 (JSON)
Other references · 99
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
38 more
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2023Large Language Model Guided Tree-of-Thoughtcited by 221
- 2025Dynamic Early Exit in Reasoning Modelscited by 219
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
- 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2023Image Hijacks: Adversarial Images can Control Generative Models at Runtimecited by 172
- 2023A Language Agent for Autonomous Drivingcited by 164
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 151
- 2024The Revolution of Multimodal Large Language Models: A Surveycited by 137
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilitiescited by 136
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 128
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 119
- 2024Fast Best-of-N Decoding via Speculative Rejectioncited by 112
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 100
- 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 100
- 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
- 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 95
- 2025Efficient Reasoning Models: A Surveycited by 95
- 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1cited by 91
- 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Modelscited by 80
- 2025STAIR: Improving Safety Alignment with Introspective Reasoningcited by 77
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 75
- 2025Efficient Reasoning with Hidden Thinkingcited by 75
- 2024Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Charactercited by 68
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 67
- 2025Safety in Large Reasoning Models: A Surveycited by 64
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planningcited by 62
- 2024TreeBoN: Enhancing Inference-Time Alignment with Speculative Tree-Search and Best-of-N Samplingcited by 61
- 2025Trading Inference-Time Compute for Adversarial Robustnesscited by 61
50 most cited of 99 All 99 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do
- 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought
- 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoning
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models
- 2025Deep Hidden Cognition Facilitates Reliable Chain-of-Thought Reasoning
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision