mlsanityData to 7 Oct 2026

SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity

arXiv 2606.25634 ↗First posted 24 Jun 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have shown remarkable progress in single-image perception, yet their ability to reason about complex cross-view human-centric scenes remains largely unverified. Current multi-view benchmarks evaluate models using a fixed "bag of frames" and thus conflate a model's robustness to visual distraction with its genuine ability to fuse fragmented cross-view evidence. To address this issue, we introduce SSMNBench, a diagnostic benchmark comprising 3,300 curated QA pairs for cross-view human and human-object understanding. SSMNBench uniquely categorizes tasks into Single-View Sufficiency (SVS) and Multi-View Necessity (MVN). By systematically perturbing view availability across 17 state-of-the-art MLLMs, critical limitations are revealed: models suffer from severe "distraction degradation" when presented with redundant views (SVS), and fail to integrate fragmented geometric evidence across cameras (MVN). Our evaluations demonstrate that modern MLLMs rely on multiple single-image semantic averaging and view preference rather than genuine cross-view synthesis. By exposing these fundamental vulnerabilities, SSMNBench provides a rigorous diagnostic framework to drive the advancement of future cross-view-aware multimodal architectures. The code is available at: hrefhttps://github.com/gtc-gh/SSMNBenchSSMNBench

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 57 of its 81 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

57 of 81 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Training28 Sep
  2. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding13 Dec
  3. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding13 Jun
  4. 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Model31 May
  5. 2024BLINK: Multimodal Large Language Models Can See but Not Perceive18 Apr
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks21 Dec
  7. 2023Multimodal Large Language Models: A Survey22 Nov
  8. 2023A Survey on Multimodal Large Language Models23 Jun
  9. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models23 Jun

Other references · 48

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2023Qwen Technical Reportcited by 3,273
  7. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  10. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  11. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  12. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
36 more
  1. 2024A Survey on 3D Gaussian Splattingcited by 221
  2. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
  3. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 105
  4. 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 88
  5. 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenescited by 62
  6. 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
  7. 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 52
  8. 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
  9. 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
  10. 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
  11. 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Modelscited by 37
  12. 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
  13. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecturecited by 30
  14. 2025MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environmentscited by 28
  15. 2025OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoningcited by 25
  16. 2025Identifying and Mitigating Position Bias of Multi-image Vision-Language Modelscited by 24
  17. 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
  18. 2024MVGS: Multi-view Regulated Gaussian Splatting for Novel View Synthesiscited by 19
  19. 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 19
  20. 2024Affective Behaviour Analysis via Integrating Multi-Modal Knowledgecited by 18
  21. 2024DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstructioncited by 15
  22. 2025Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMscited by 14
  23. 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 13
  24. 2025Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistantscited by 12
  25. 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Roboticscited by 12
  26. 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devicescited by 10
  27. 2025Dynamic Derivation and Elimination: Audio Visual Segmentation with Enhanced Audio Semanticscited by 8
  28. 2025WearVQA: A Visual Question Answering Benchmark for Wearables in Egocentric Authentic Real-world scenarioscited by 8
  29. 2024Affective Behaviour Analysis via Progressive Learningcited by 7
  30. 2025Robust Audio-Visual Segmentation via Audio-Guided Visual Convergent Alignmentcited by 7
  31. 2024A Large-scale Investigation of Semantically Incompatible APIs behind Compatibility Issues in Android Appscited by 5
  32. 2025From Objects to Anywhere: A Holistic Benchmark for Multi-level Visual Grounding in 3D Scenescited by 4
  33. 2025SmokeBench: Evaluating Multimodal Large Language Models for Wildfire Smoke Detectioncited by 4
  34. 2022ShowFace: Coordinated Face Inpainting with Memory-Disentangled Refinement Networkscited by 3
  35. 2025Investigating Spatial Attention Bias in Vision-Language Modelscited by 2
  36. 2025Dynamic Orchestration of Multi-Agent System for Real-World Multi-Image Agricultural VQAcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
  2. 2024JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
  3. 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  4. 2026Revealing the Gap in Human and VLM Scene Perception through Counterfactual Semantic Saliency
  5. 2026MVVBench: Benchmarking 4D Reasoning in Vision-Language Models
  6. 2025Human-MME: A Holistic Evaluation Benchmark for Human-Centric Multimodal Large Language Models
  7. 2026CrossView: Can Vision-Language Models Reason Across Cameras?
  8. 2026Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models