mlsanityData to 14 Oct 2026

MMPerspective: Do MLLMs Understand Perspective? A Comprehensive Benchmark for Perspective Perception, Reasoning, and Robustness

arXiv 2505.20426 ↗First posted 26 May 2025cs.CVcited by 5

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Understanding perspective is fundamental to human visual perception, yet the extent to which multimodal large language models (MLLMs) internalize perspective geometry remains unclear. We introduce MMPerspective, the first benchmark specifically designed to systematically evaluate MLLMs' understanding of perspective through 10 carefully crafted tasks across three complementary dimensions: Perspective Perception, Reasoning, and Robustness. Our benchmark comprises 2,711 real-world and synthetic image instances with 5,083 question-answer pairs that probe key capabilities, such as vanishing point perception and counting, perspective type reasoning, line relationship understanding in 3D space, invariance to perspective-preserving transformations, etc. Through a comprehensive evaluation of 43 state-of-the-art MLLMs, we uncover significant limitations: while models demonstrate competence on surface-level perceptual tasks, they struggle with compositional reasoning and maintaining spatial consistency under perturbations. Our analysis further reveals intriguing patterns between model architecture, scale, and perspective capabilities, highlighting both robustness bottlenecks and the benefits of chain-of-thought prompting. MMPerspective establishes a valuable testbed for diagnosing and advancing spatial understanding in vision-language systems. Resources available at: https://yunlong10.github.io/MMPerspective/

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 52 of its 84 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

52 of 84 references.

References · 52

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  9. 2015VQA: Visual Question Answeringcited by 2,506
  10. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  11. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  12. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
38 more
  1. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  2. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  3. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  4. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  5. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  6. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  7. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  9. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
  10. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  11. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  12. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
  13. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  14. 2023Video Understanding with Large Language Models: A Surveycited by 206
  15. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
  16. 2024Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoderscited by 139
  17. 2024DOCCI: Descriptions of Connected and Contrasting Imagescited by 132
  18. 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
  19. 2024NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samplescited by 97
  20. 2023AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesiscited by 49
  21. 2020Deep Hough Transform for Semantic Line Detectioncited by 44
  22. 2023Egocentric Audio-Visual Object Localizationcited by 40
  23. 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approachcited by 35
  24. 2024MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Modelscited by 31
  25. 2022GRIT: General Robust Image Task Benchmarkcited by 26
  26. 2019NeurVPS: Neural Vanishing Point Scanning via Conic Convolutioncited by 24
  27. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelitycited by 23
  28. 2025Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1)cited by 23
  29. 2024TextToon: Real-Time Text Toonify Head Avatar from Single Videocited by 21
  30. 2024KinMo: Kinematic-aware Human Motion Understanding and Generationcited by 21
  31. 2024An Empirical Analysis on Large Language Models in Debate Evaluationcited by 20
  32. 2024Language-Guided Joint Audio-Visual Editing via One-Shot Adaptationcited by 19
  33. 2022Deep vanishing point detection: Geometric priors make dataset variations vanishcited by 18
  34. 2024VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?cited by 18
  35. 2025Towards Visual Text Grounding of Multimodal Large Language Modelcited by 18
  36. 2023Emotional Listener Portrait: Neural Listener Head Generation with Emotioncited by 17
  37. 2024FINEMATCH: Aspect-based Fine-grained Image and Text Mismatch Detection and Correctioncited by 17
  38. 2025Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Promptingcited by 10

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
  2. 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation
  3. 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
  4. 2026Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images
  5. 2025Beyond Recognition: Evaluating Visual Perspective Taking in Vision Language Models
  6. 2025Visual Room 2.0: Seeing is Not Understanding for MLLMs
  7. 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning
  8. 2025The Perceptual Observatory Characterizing Robustness and Grounding in MLLMs