mlsanityData to 14 Oct 2026

From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models

arXiv 2511.12861 ↗First posted 17 Nov 2025cs.CL cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as opaque reasoning paths and insufficient generalization ability. Chain-of-Thought (CoT) reasoning, which has demonstrated significant efficacy in language models by enhancing reasoning transparency and output interpretability, holds promise for improving model reasoning capabilities when extended to the multimodal domain. This paper provides a systematic review centered on "Multimodal Chain-of-Thought" (MCoT). First, it analyzes the background and theoretical motivations for its inception from the perspectives of technical evolution and task demands. Then, it introduces mainstream MCoT methods from three aspects: CoT paradigms, the post-training stage, and the inference stage, while also analyzing their underlying mechanisms. Furthermore, the paper summarizes existing evaluation benchmarks and metrics, and discusses the application scenarios of MCoT. Finally, it analyzes the challenges currently facing MCoT and provides an outlook on its future research directions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 169 of its 248 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

169 of 248 references.

Closest ancestors · 70

Same direction, newest first

  1. 2025VisuRiddles: Fine-grained Perception is a Primary Bottleneck for Multimodal Large Language Models in Abstract Visual Reasoning3 Jun
  2. 2025MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs27 May
  3. 2025MMLU-Reason: Benchmarking Multi-Task Multi-modal Language Understanding and Reasoning22 May
  4. 2025Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging8 May
  5. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
  6. 2025Reasoning Physical Video Generation with Diffusion Timestep Tokens via Reinforcement Learning22 Apr
  7. 2025LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception21 Apr
  8. 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge14 Apr
  9. 2025Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation13 Apr
  10. 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search12 Apr
  11. 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)4 Apr
  12. 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning23 Mar
38 more
  1. 2025Mitigating Visual Forgetting via Take-along Visual Conditioning for Multi-modal Long CoT Reasoning17 Mar
  2. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  3. 2025MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification16 Mar
  4. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  5. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
  6. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  7. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  8. 2025Can Atomic Step Decomposition Enhance the Self-structured Reasoning of Multimodal Large Models?8 Mar
  9. 2025Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Models3 Mar
  10. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  11. 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models3 Mar
  12. 2025Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models22 Feb
  13. 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification19 Feb
  14. 2025Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study17 Feb
  15. 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency13 Feb
  16. 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking4 Feb
  17. 2025The Jumping Reasoning Curve? Tracking the Evolution of Reasoning Performance in GPT-[n] and o-[n] Models on Multimodal Puzzles3 Feb
  18. 2025Can Multimodal LLMs do Visual Temporal Understanding and Reasoning? The answer is No!18 Jan
  19. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
  20. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  21. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
  22. 2025Unlocking Multimodal Mathematical Reasoning via Process Reward Model8 Jan
  23. 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection8 Jan
  24. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
  25. 2024Progressive Multimodal Reasoning via Active Retrieval19 Dec
  26. 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing13 Dec
  27. 2024Scaling Inference-Time Search with Vision Value Model for Improved Visual Comprehension4 Dec
  28. 2024AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning18 Nov
  29. 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination15 Nov
  30. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
  31. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  32. 2024Reasoning Limitations of Multimodal Large Language Models. A Case Study of Bongard Problems2 Nov
  33. 2024Vision-Language Models Can Self-Improve Reasoning via Reflection30 Oct
  34. 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Models30 Oct
  35. 2024MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps18 Oct
  36. 2024HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks16 Oct
  37. 2024CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models4 Sep
  38. 2024Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities15 Aug

50 newest of 70 All 70 (JSON)

Other references · 99

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  6. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  7. 2023A Survey on Multimodal Large Language Modelscited by 909
  8. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  9. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  10. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  11. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  12. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
38 more
  1. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
  2. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  3. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  4. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  5. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  6. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
  7. 2023Large Language Model Guided Tree-of-Thoughtcited by 221
  8. 2025Dynamic Early Exit in Reasoning Modelscited by 219
  9. 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
  10. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
  11. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
  12. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
  13. 2023Image Hijacks: Adversarial Images can Control Generative Models at Runtimecited by 172
  14. 2023A Language Agent for Autonomous Drivingcited by 164
  15. 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 151
  16. 2024The Revolution of Multimodal Large Language Models: A Surveycited by 137
  17. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilitiescited by 136
  18. 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 128
  19. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 119
  20. 2024Fast Best-of-N Decoding via Speculative Rejectioncited by 112
  21. 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 100
  22. 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 100
  23. 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
  24. 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
  25. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 95
  26. 2025Efficient Reasoning Models: A Surveycited by 95
  27. 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1cited by 91
  28. 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Modelscited by 80
  29. 2025STAIR: Improving Safety Alignment with Introspective Reasoningcited by 77
  30. 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 75
  31. 2025Efficient Reasoning with Hidden Thinkingcited by 75
  32. 2024Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Charactercited by 68
  33. 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
  34. 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 67
  35. 2025Safety in Large Reasoning Models: A Surveycited by 64
  36. 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planningcited by 62
  37. 2024TreeBoN: Enhancing Inference-Time Alignment with Speculative Tree-Search and Best-of-N Samplingcited by 61
  38. 2025Trading Inference-Time Compute for Adversarial Robustnesscited by 61

50 most cited of 99 All 99 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do
  2. 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models
  3. 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought
  4. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoning
  5. 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought
  6. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models
  7. 2025Deep Hidden Cognition Facilitates Reliable Chain-of-Thought Reasoning
  8. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision