Game2Real-Bench: Do Toy Games Reveal and Transfer to Real-World Visual Reasoning?
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Visual reasoning is an important capability for vision-language models (VLMs) to understand visual evidence, spatial structure, constraints, and state changes. Existing evaluations mainly rely on real-world data or procedurally generated tasks. Real-world data preserve natural complexity, while procedural games provide controllable generation and verifiable solutions. However, it remains unclear whether abilities measured in toy games correspond to real-world visual reasoning and whether game examples can support transfer. We introduce Game2Real-Bench, a benchmark that studies these connections across four capability groups, including fine-grained perception, spatial reasoning, constraint reasoning, and sequential planning. We construct 1,000 procedurally generated game samples with executable verification and curate 400 real-world samples aligned by shared reasoning requirements rather than visual similarity. We evaluate 25 representative VLMs and observe strong game-to-real consistency, with Pearson and Spearman correlations of 0.935. We further study one-shot game-to-real transfer on four models. Constraint reasoning improves for several models, while fine-grained perception declines with game demonstrations. We also construct Game2Real-Dataset with nearly 24K verified game samples across 18 tasks and 65 QA families. Our benchmark, dataset, and code are available at https://github.com/QingAnLiu/Game2Real-Bench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 42 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
37 of 42 references.
Closest ancestors · 6
Same direction, newest first
- 2026SpatiaLQA: A Benchmark for Evaluating Spatial Logical Reasoning in Vision-Language Models24 Feb
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces8 Feb
- 2025Spatial-DISE: A Unified Benchmark for Evaluating Spatial Reasoning in Vision-Language Models15 Oct
- 2025VisualTrans: A Benchmark for Real-World Visual Transformation Reasoning6 Aug
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting21 Apr
Other references · 31
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
- 2026Gemma 4 Technical Reportcited by 259
- 2019SPair-71k: A Large-scale Benchmark for Semantic Correspondencecited by 146
- 2025MiMo-VL Technical Reportcited by 115
19 more
- 2025Ovis2.5 Technical Reportcited by 108
- 2024Unveiling Encoder-Free Vision-Language Modelscited by 94
- 2025lmgame-Bench: How Good are LLMs at Playing Games?cited by 55
- 2026BabyVision: Visual Reasoning Beyond Languagecited by 49
- 2025EVEv2: Improved Baselines for Encoder-Free Vision-Language Modelscited by 41
- 2025VideoGameBench: Can Vision-Language Models complete popular video games?cited by 36
- 2026A Very Big Video Reasoning Suitecited by 34
- 2025Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoningcited by 32
- 2026STEP3-VL-10B Technical Reportcited by 32
- 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 32
- 2026GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agentscited by 28
- 2025Visual Jigsaw Post-Training Improves MLLMscited by 26
- 2025ReasonMap: Towards Fine-Grained Visual Reasoning from Transit Mapscited by 23
- 2025From Pixels to Words -- Towards Native Vision-Language Primitives at Scalecited by 18
- 2021OCID-Ref: A 3D Robotic Dataset with Embodied Language for Clutter Scene Groundingcited by 16
- 2025Play to Generalize: Learning to Reason Through Game Playcited by 16
- 2024IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videoscited by 12
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scalecited by 8
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Are Large Vision Language Models Good Game Players?
- 2025V-MAGE: A Game Evaluation Framework for Assessing Vision-Centric Capabilities in Multimodal Large Language Models
- 2024ING-VP: MLLMs cannot Play Easy Vision-based Games Yet
- 2026GameVerse: Can Vision-Language Models Learn from Video-based Reflection?
- 2026Do Vision-Language-Models show human-like logical problem-solving capability in point and click puzzle games?
- 2026Reasoning or Pattern Matching? Probing Large Vision-Language Models with Visual Puzzles
- 2026GameReplica: A Benchmark for Black-Box Visual Game Replication by Vision-Language Agents
- 2026From Perception to Action: An Interactive Benchmark for Vision Reasoning