mlsanityData to 14 Oct 2026

Frame Evidence:A Benchmark for Reference Frames and Visual Evidence in Multi-Image Spatial Reasoning

arXiv 2610.19564 ↗First posted 14 Oct 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning also fits: Spatial and embodied reasoning

Abstract (arXiv)

A spatial answer depends on the reference frame specified in language and its supporting visual evidence. Item accuracy alone obscures whether correctness persists when either changes. We introduce Frame Evidence, a benchmark of 320 matched triplets and 960 Chinese multiple-choice questions from captured and rendered scenes. One family compares three grounded reference frames over fixed images. The other pairs image deletion annotated as insufficient with answer-preserving addition. Joint metrics require correct answers across all three frames and paired evidence variants. Across 20 configurations on 288 held-out questions, GPT three-shot reaches 50.00% item accuracy, but the best three-frame group accuracy is 5/48 (10.42%), reached by GPT two-shot. Few-shot prompting and task-specific adaptation improve item accuracy without consistently improving joint correctness. Input controls show where images support matched success, while repeated executions reveal answer instability beneath similar scores.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 26 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

19 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Where Does the Answer Come From? Benchmarking View-Level Visual Evidence Identification in Multi-View MLLMs for Autonomous Driving8 Jun
  2. 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning18 Jun
  3. 2024ReMI: A Dataset for Reasoning with Multiple Images13 Jun
  4. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality7 Apr

Other references · 15

  1. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  2. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  3. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
  4. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
  5. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
  6. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
  7. 2024Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguitiescited by 59
  8. 2026CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environmentscited by 11
  9. 2025FoREST: Frame of Reference Evaluation in Spatial Reasoning Taskscited by 9
  10. 2026More Images, More Problems? A Controlled Analysis of VLM Failure Modescited by 9
  11. 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photoscited by 4
  12. 2026MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMscited by 4
3 more
  1. 2026CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmarkcited by 3
  2. 2026SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessitycited by 2
  3. 2026Learning Multi-View Spatial Reasoning from Cross-View Relationscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Trace, Verify, and Correct: A Training-Free Framework for Spatial Reasoning in Multimodal LLMs
  2. 2026SpatialChain: A Benchmark for Auditing Spatial Reasoning Faithfulness in VLMs
  3. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
  4. 2026Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning
  5. 2026SpatiaLQA: A Benchmark for Evaluating Spatial Logical Reasoning in Vision-Language Models
  6. 2026VisualFLIP: Do Predictions Depend on Task-Critical Visual Evidence in Multimodal Reasoning?
  7. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  8. 2026VISTAQA: Benchmarking Joint Visual Question Answering and Pixel-Level Evidence