MMPerspective: Do MLLMs Understand Perspective? A Comprehensive Benchmark for Perspective Perception, Reasoning, and Robustness
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Understanding perspective is fundamental to human visual perception, yet the extent to which multimodal large language models (MLLMs) internalize perspective geometry remains unclear. We introduce MMPerspective, the first benchmark specifically designed to systematically evaluate MLLMs' understanding of perspective through 10 carefully crafted tasks across three complementary dimensions: Perspective Perception, Reasoning, and Robustness. Our benchmark comprises 2,711 real-world and synthetic image instances with 5,083 question-answer pairs that probe key capabilities, such as vanishing point perception and counting, perspective type reasoning, line relationship understanding in 3D space, invariance to perspective-preserving transformations, etc. Through a comprehensive evaluation of 43 state-of-the-art MLLMs, we uncover significant limitations: while models demonstrate competence on surface-level perceptual tasks, they struggle with compositional reasoning and maintaining spatial consistency under perturbations. Our analysis further reveals intriguing patterns between model architecture, scale, and perspective capabilities, highlighting both robustness bottlenecks and the benefits of chain-of-thought prompting. MMPerspective establishes a valuable testbed for diagnosing and advancing spatial understanding in vision-language systems. Resources available at: https://yunlong10.github.io/MMPerspective/
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 52 of its 84 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
52 of 84 references.
References · 52
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2015VQA: Visual Question Answeringcited by 2,506
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
38 more
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
- 2024Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoderscited by 139
- 2024DOCCI: Descriptions of Connected and Contrasting Imagescited by 132
- 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
- 2024NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samplescited by 97
- 2023AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesiscited by 49
- 2020Deep Hough Transform for Semantic Line Detectioncited by 44
- 2023Egocentric Audio-Visual Object Localizationcited by 40
- 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approachcited by 35
- 2024MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Modelscited by 31
- 2022GRIT: General Robust Image Task Benchmarkcited by 26
- 2019NeurVPS: Neural Vanishing Point Scanning via Conic Convolutioncited by 24
- 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelitycited by 23
- 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)cited by 23
- 2024TextToon: Real-Time Text Toonify Head Avatar from Single Videocited by 21
- 2024KinMo: Kinematic-aware Human Motion Understanding and Generationcited by 21
- 2024An Empirical Analysis on Large Language Models in Debate Evaluationcited by 20
- 2024Language-Guided Joint Audio-Visual Editing via One-Shot Adaptationcited by 19
- 2022Deep vanishing point detection: Geometric priors make dataset variations vanishcited by 18
- 2024VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?cited by 18
- 2025Towards Visual Text Grounding of Multimodal Large Language Modelcited by 18
- 2023Emotional Listener Portrait: Neural Listener Head Generation with Emotioncited by 17
- 2024FINEMATCH: Aspect-based Fine-grained Image and Text Mismatch Detection and Correctioncited by 17
- 2025Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Promptingcited by 10
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025Video-R4: Reinforcing Text-Rich Video Reasoning with Visual Ruminationcited by 6
- 2026BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blendercited by 6
- 2026Video-MSR: Benchmarking Multi-hop Spatial Reasoning Capabilities of MLLMscited by 5
- 2026VideoFDB: Evaluating Full-Duplex Vision-Speech Capabilities in Conversational Agentscited by 1
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Modelscited by 0
- 2026BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender14 Sep 2026
- 2026VideoFDB: Evaluating Full-Duplex Vision-Speech Capabilities in Conversational Agents28 May 2026
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Models14 Mar 2026
- 2026Video-MSR: Benchmarking Multi-hop Spatial Reasoning Capabilities of MLLMs14 Jan 2026
- 2025Video-R4: Reinforcing Text-Rich Video Reasoning with Visual Rumination21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
- 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
- 2026Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images
- 2025Beyond Recognition: Evaluating Visual Perspective Taking in Vision Language Models
- 2025Visual Room 2.0: Seeing is Not Understanding for MLLMs
- 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning
- 2025The Perceptual Observatory Characterizing Robustness and Grounding in MLLMs