mlsanityData to 14 Oct 2026

PinpointQA: A Benchmark for Small Object-Centric Spatial Understanding in Indoor Videos

arXiv 2604.08991 ↗First posted 10 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable embodied interaction in indoor environments requires agents to precisely localize small everyday objects from visual observations. Yet this fundamental capability remains challenging for multimodal large language models (MLLMs), particularly when spatial understanding must be performed from indoor videos. Existing benchmarks study video spatial intelligence and embodied reasoning, but do not directly evaluate whether a model can localize a small target object and express its position with sufficient precision. We introduce PinpointQA, a benchmark built from ScanNet++ and ScanNet200. It contains 1,024 scenes and 10,094 QA pairs across four progressively challenging tasks: Target Presence Verification, Nearest Reference Identification, Fine-Grained Spatial Description, and Structured Spatial Prediction. Ground-truth annotations are constructed from intermediate spatial representations derived from aligned 3D geometry and instance-level annotations, while evaluated models receive only sampled RGB video frames. Evaluations of representative MLLMs reveal a consistent performance decline across the task progression, with structured spatial prediction remaining particularly challenging, while supervised fine-tuning substantially improves performance. By isolating the spatial grounding capabilities that precede downstream embodied interaction, PinpointQA serves as both a diagnostic benchmark and an effective training resource. The project page is available at https://rainchowz.github.io/PinpointQA/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

32 of 42 references.

References · 32

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  7. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  8. 2025OpenAI GPT-5 System Cardcited by 989
  9. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  10. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  11. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  12. 2020Rescaling Egocentric Visioncited by 540
20 more
  1. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  2. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
  3. 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 246
  4. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  5. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  6. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
  7. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  8. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  9. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
  10. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 79
  11. 2024VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLMcited by 72
  12. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 68
  13. 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
  14. 2023EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understandingcited by 40
  15. 2025Open3D-VQA: A Benchmark for Comprehensive Spatial Reasoning with Multimodal Large Language Model in Open Spacecited by 39
  16. 2025ReferDINO: Referring Video Object Segmentation with Visual Grounding Foundationscited by 30
  17. 2025SITE: towards Spatial Intelligence Thorough Evaluationcited by 29
  18. 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
  19. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
  20. 2026Video-MSR: Benchmarking Multi-hop Spatial Reasoning Capabilities of MLLMscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpatialPoint: Spatial-aware Point Prediction for Embodied Localization
  2. 2026Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models
  3. 2025From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs
  4. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  5. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligence
  6. 2026Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models
  7. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models
  8. 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding