Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Images
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Visual reasoning over structured data such as tables is a critical capability for modern vision-language models (VLMs), yet current benchmarks remain limited in scale, diversity, or reasoning depth, especially when it comes to rendered table images. Addressing this gap, we introduce Visual-TableQA, a large-scale, open-domain multimodal dataset specifically designed to evaluate and enhance visual reasoning over complex tabular data. Our generation pipeline is modular, scalable, and fully autonomous, involving multiple reasoning LLMs collaborating across distinct roles: generation, validation, and inspiration. Visual-TableQA comprises 2.5k richly structured LaTeX-rendered tables and 6k reasoning-intensive QA pairs, all produced at a cost of under USD 100. To promote diversity and creativity, our pipeline performs multi-model collaborative data generation via cross-model prompting ('inspiration') and LLM-jury filtering. Stronger models seed layouts and topics that weaker models elaborate, collectively distilling diverse reasoning patterns and visual structures into the dataset. Empirical results show that models fine-tuned on Visual-TableQA generalize robustly to external benchmarks, outperforming several proprietary models despite the dataset's synthetic nature. The full pipeline and resources are publicly available at https://github.com/AI-4-Everyone/Visual-TableQA.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 45 references that are in the map. First posted on arXiv 9 Sep 2025.
Builds on
24 of 45 references.
References · 24
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
- 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
- 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 264
12 more
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
- 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 177
- 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 147
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2024TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table Domainscited by 69
- 2021AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industrycited by 44
- 2024Distill Visual Chart Reasoning Ability from LLMs to MLLMscited by 31
- 2024MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasetscited by 10
- 2025TeXpert: A Multi-Level Benchmark for Evaluating LaTeX Code Generation by LLMscited by 7
- 2025SMIR: Efficient Synthetic Data Pipeline To Improve Multi-Image Reasoningcited by 3
- 2025Supernova Event Dataset: Interpreting Large Language Models' Personality through Critical Event Analysiscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluationcited by 5
- 2025TALENT: Table VQA via Augmented Language-Enhanced Natural-text Transcriptioncited by 2
- 2026Automatic Slide Updating with User-Defined Dynamic Templates and Natural Language Instructionscited by 1
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMscited by 1
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tablescited by 0
- 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoningcited by 0
- 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning26 Sep 2026
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs8 Jun 2026
- 2026Automatic Slide Updating with User-Defined Dynamic Templates and Natural Language Instructions20 Apr 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation8 Oct 2025
- 2025TALENT: Table VQA via Augmented Language-Enhanced Natural-text Transcription8 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2024Beyond Embeddings: The Promise of Visual Table in Visual Reasoning
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understanding
- 2025MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual Space
- 2025MMTABREAL: Real-World Benchmark for Multimodal Table Understanding
- 2026Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidance
- 2025Multimodal Tabular Reasoning with Privileged Structured Information
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy
- 2025Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning