Cube Bench: A Benchmark for Spatial Visual Reasoning in MLLMs
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
We introduce Cube Bench, a Rubik's-cube benchmark for evaluating spatial and sequential reasoning in multimodal large language models (MLLMs). The benchmark decomposes performance into five skills: (i) reconstructing cube faces from images and text, (ii) choosing the optimal next move, (iii) predicting the outcome of a candidate move without applying it, (iv) executing multi-step plans while recovering from mistakes, and (v) detecting and revising one's own errors. Using a shared set of scrambled cube states, identical prompts and parsers, and a single distance-to-solved metric, we compare recent MLLMs side by side as a function of scramble depth. Across seven MLLMs, accuracy drops sharply with depth; once a trajectory stalls or diverges, models rarely recover, and high face-reconstruction accuracy does not guarantee competent action selection or multi-step execution. A pronounced closed- vs open-source gap emerges: the strongest closed model leads on both single-step perception tasks and multi-step control tasks, while open-weight models cluster near chance on the hardest settings; yet even the best MLLM degrades at higher cube complexity. A simple self-correction via reflective thinking yields modest gains but can also introduce overthinking. Cube Bench offers a compact, reproducible probe of sequential spatial reasoning in MLLMs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 31 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
21 of 31 references.
References · 21
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2025Gemma 3 Technical Reportcited by 1,824
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
9 more
- 2019Solving Rubik's Cube with a Robot Handcited by 734
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2025Why Language Models Hallucinatecited by 220
- 2024A Survey on Benchmarks of Multimodal Large Language Modelscited by 82
- 2019GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answeringcited by 78
- 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Taskscited by 47
- 2024Self-Reflection in LLM Agents: Effects on Problem-Solving Performancecited by 39
- 2025CubeRobot: Grounding Language in Rubik's Cube Manipulation via Vision-Language Modelcited by 2
- 2025Structured Task Solving via Modular Embodied Intelligence: A Case Study on Rubik's Cubecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
- 2026WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models