Think 360deg: Evaluating the Width-centric Reasoning Capability of MLLMs Beyond Depth
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
In this paper, we present a holistic multimodal benchmark that evaluates the reasoning capabilities of MLLMs with an explicit focus on reasoning width, a complementary dimension to the more commonly studied reasoning depth. Specifically, reasoning depth measures the model's ability to carry out long-chain, sequential reasoning in which each step is tightly and rigorously linked to the next. Reasoning width tends to focus more on the model's capacity for broad trial-and-error search or multi-constrained optimization: it must systematically traverse many possible and parallelized reasoning paths, apply diverse constraints to prune unpromising branches, and identify valid solution routes for efficient iteration or backtracking. To achieve it, we carefully curate 1200+ high-quality multimodal cases spanning heterogeneous domains, and propose a fine-grained tree-of-thought evaluation protocol that jointly quantifies reasoning width and depth. We evaluate 12 major model families (over 30 advanced MLLMs) across difficulty tiers, question types, and required skills. Results show that while current models exhibit strong performance on general or common-sense VQA tasks, they still struggle to combine deep sequential thought chains with wide exploratory search to perform genuine insight-based reasoning. Finally, we analyze characteristic failure modes to provide possible directions for building MLLMs that reason not only deeper but also wider.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 37 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
21 of 37 references.
Closest ancestors · 11
Same direction, newest first
- 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
- 2025MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs27 May
- 2025OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoning22 May
- 2025RBench-V: A Primary Assessment for Visual Reasoning Models with Multi-modal Outputs22 May
- 2025MMLU-Reason: Benchmarking Multi-Task Multi-modal Language Understanding and Reasoning22 May
- 2025Unlocking the Potential of Difficulty Prior in RL-based Multimodal Reasoning19 May
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 10
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2025Humanity's Last Examcited by 467
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 65
- 2025HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modelingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MMReason: An Open-Ended Multi-Modal Multi-Step Reasoning Benchmark for MLLMs Toward AGI
- 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
- 2023InfiMM-Eval: Complex Open-Ended Reasoning Evaluation For Multi-Modal Large Language Models
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning
- 2025Long Is More Important Than Difficult for Training Reasoning Models
- 2025From Long to Short: LLMs Excel at Trimming Own Reasoning Chains
- 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning