SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have shown remarkable progress in single-image perception, yet their ability to reason about complex cross-view human-centric scenes remains largely unverified. Current multi-view benchmarks evaluate models using a fixed "bag of frames" and thus conflate a model's robustness to visual distraction with its genuine ability to fuse fragmented cross-view evidence. To address this issue, we introduce SSMNBench, a diagnostic benchmark comprising 3,300 curated QA pairs for cross-view human and human-object understanding. SSMNBench uniquely categorizes tasks into Single-View Sufficiency (SVS) and Multi-View Necessity (MVN). By systematically perturbing view availability across 17 state-of-the-art MLLMs, critical limitations are revealed: models suffer from severe "distraction degradation" when presented with redundant views (SVS), and fail to integrate fragmented geometric evidence across cameras (MVN). Our evaluations demonstrate that modern MLLMs rely on multiple single-image semantic averaging and view preference rather than genuine cross-view synthesis. By exposing these fundamental vulnerabilities, SSMNBench provides a rigorous diagnostic framework to drive the advancement of future cross-view-aware multimodal architectures. The code is available at: hrefhttps://github.com/gtc-gh/SSMNBenchSSMNBench
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 57 of its 81 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
57 of 81 references.
Closest ancestors · 9
Same direction, newest first
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Training28 Sep
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding13 Dec
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding13 Jun
- 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Model31 May
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceive18 Apr
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks21 Dec
- 2023Multimodal Large Language Models: A Survey22 Nov
- 2023A Survey on Multimodal Large Language Models23 Jun
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models23 Jun
Other references · 48
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Qwen Technical Reportcited by 3,273
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
36 more
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 105
- 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 88
- 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenescited by 62
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 52
- 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
- 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Modelscited by 37
- 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
- 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecturecited by 30
- 2025MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environmentscited by 28
- 2025OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoningcited by 25
- 2025Identifying and Mitigating Position Bias of Multi-image Vision-Language Modelscited by 24
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
- 2024MVGS: Multi-view Regulated Gaussian Splatting for Novel View Synthesiscited by 19
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 19
- 2024Affective Behaviour Analysis via Integrating Multi-Modal Knowledgecited by 18
- 2024DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstructioncited by 15
- 2025Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMscited by 14
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 13
- 2025Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistantscited by 12
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Roboticscited by 12
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devicescited by 10
- 2025Dynamic Derivation and Elimination: Audio Visual Segmentation with Enhanced Audio Semanticscited by 8
- 2025WearVQA: A Visual Question Answering Benchmark for Wearables in Egocentric Authentic Real-world scenarioscited by 8
- 2024Affective Behaviour Analysis via Progressive Learningcited by 7
- 2025Robust Audio-Visual Segmentation via Audio-Guided Visual Convergent Alignmentcited by 7
- 2024A Large-scale Investigation of Semantically Incompatible APIs behind Compatibility Issues in Android Appscited by 5
- 2025From Objects to Anywhere: A Holistic Benchmark for Multi-level Visual Grounding in 3D Scenescited by 4
- 2025SmokeBench: Evaluating Multimodal Large Language Models for Wildfire Smoke Detectioncited by 4
- 2022ShowFace: Coordinated Face Inpainting with Memory-Disentangled Refinement Networkscited by 3
- 2025Investigating Spatial Attention Bias in Vision-Language Modelscited by 2
- 2025Dynamic Orchestration of Multi-Agent System for Real-World Multi-Image Agricultural VQAcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
- 2024JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
- 2026Revealing the Gap in Human and VLM Scene Perception through Counterfactual Semantic Saliency
- 2026MVVBench: Benchmarking 4D Reasoning in Vision-Language Models
- 2025Human-MME: A Holistic Evaluation Benchmark for Human-Centric Multimodal Large Language Models
- 2026CrossView: Can Vision-Language Models Reason Across Cameras?
- 2026Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models