mlsanityData to 14 Oct 2026

TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables

arXiv 2604.03660 ↗First posted 4 Apr 2026cs.AIcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Structured tables are essential for conveying high-density information in professional domains such as finance, healthcare, and scientific research. Despite the progress in Multimodal Large Language Models (MLLMs), reasoning performance remains limited for complex tables with hierarchical layouts. In this paper, we identify a critical Perception Bottleneck through quantitative analysis. We find that as task complexity scales, the number of involved discrete visual regions increases disproportionately. This processing density leads to an internal "Perceptual Overload," where MLLMs struggle to maintain accurate spatial attention during implicit generation. To address this bottleneck, we introduce TableVision, a large-scale, trajectory-aware benchmark designed for spatially grounded reasoning. TableVision stratifies tabular tasks into three cognitive levels (Perception, Reasoning, and Analysis) across 13 sub-categories. By utilizing a rendering-based deterministic grounding pipeline, the dataset explicitly couples multi-step logical deductions with pixel-perfect spatial ground truths, comprising 6,799 high-fidelity reasoning trajectories. Our empirical results, supported by diagnostic probing, demonstrate that explicit spatial constraints significantly recover the reasoning potential of MLLMs. Furthermore, our two-stage decoupled framework achieves a robust 12.3% overall accuracy improvement on the test set. TableVision provides a rigorous testbed and a fresh perspective on the synergy between perception and logic in document understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 55 of its 59 references that are in the map. First posted on arXiv 4 Apr 2026.

Builds on

55 of 59 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Visual Planning: Let's Think Only with Images16 May
  2. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun

Other references · 53

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  8. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  9. 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
  10. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
  11. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  12. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
38 more
  1. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  2. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  3. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  4. 2021OCR-free Document Understanding Transformercited by 407
  5. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  6. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 264
  7. 2019Image-based table recognition: data, model, and evaluationcited by 237
  8. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  9. 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 195
  10. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
  11. 2020Open Question Answering over Tables and Textcited by 163
  12. 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 160
  13. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
  14. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
  15. 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 118
  16. 2022PromptCap: Prompt-Guided Task-Aware Image Captioningcited by 104
  17. 2022TableFormer: Table Structure Understanding with Transformerscited by 94
  18. 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 86
  19. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
  20. 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
  21. 2024TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table Domainscited by 69
  22. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
  23. 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
  24. 2024Multimodal Table Understandingcited by 44
  25. 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
  26. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognitioncited by 35
  27. 2017Representation Learning for Grounded Spatial Reasoningcited by 23
  28. 2025TableMaster: A Recipe to Advance Table Understanding with Language Modelscited by 18
  29. 2023API-Assisted Code Generation for Question Answering on Varied Table Structurescited by 14
  30. 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmarkcited by 14
  31. 2025RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysiscited by 12
  32. 2025Can GRPO Boost Complex Multimodal Table Understanding?cited by 10
  33. 2025VGent: Visual Grounding via Modular Design for Disentangling Reasoning and Predictioncited by 7
  34. 2023Localize, Retrieve and Fuse: A Generalized Framework for Free-Form Question Answering over Tablescited by 6
  35. 2025Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Imagescited by 6
  36. 2025T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tablescited by 5
  37. 2024See then Tell: Enhancing Key Information Extraction with Vision Groundingcited by 3
  38. 2024Template-Driven LLM-Paraphrased Framework for Tabular Math Word Problem Generationcited by 3

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  2. 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
  3. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  4. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
  5. 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
  6. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  7. 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
  8. 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models