mlsanityData to 14 Oct 2026

Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Images

arXiv 2509.07966 ↗First posted 9 Sep 2025cs.CV cs.CLcited by 6

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

Visual reasoning over structured data such as tables is a critical capability for modern vision-language models (VLMs), yet current benchmarks remain limited in scale, diversity, or reasoning depth, especially when it comes to rendered table images. Addressing this gap, we introduce Visual-TableQA, a large-scale, open-domain multimodal dataset specifically designed to evaluate and enhance visual reasoning over complex tabular data. Our generation pipeline is modular, scalable, and fully autonomous, involving multiple reasoning LLMs collaborating across distinct roles: generation, validation, and inspiration. Visual-TableQA comprises 2.5k richly structured LaTeX-rendered tables and 6k reasoning-intensive QA pairs, all produced at a cost of under USD 100. To promote diversity and creativity, our pipeline performs multi-model collaborative data generation via cross-model prompting ('inspiration') and LLM-jury filtering. Stronger models seed layouts and topics that weaker models elaborate, collectively distilling diverse reasoning patterns and visual structures into the dataset. Empirical results show that models fine-tuned on Visual-TableQA generalize robustly to external benchmarks, outperforming several proprietary models despite the dataset's synthetic nature. The full pipeline and resources are publicly available at https://github.com/AI-4-Everyone/Visual-TableQA.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 45 references that are in the map. First posted on arXiv 9 Sep 2025.

Builds on

24 of 45 references.

References · 24

  1. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  2. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  3. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  4. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  5. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  6. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  7. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  8. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
  9. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  10. 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
  11. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
  12. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 264
12 more
  1. 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
  2. 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 177
  3. 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 147
  4. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
  5. 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
  6. 2024TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table Domainscited by 69
  7. 2021AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industrycited by 44
  8. 2024Distill Visual Chart Reasoning Ability from LLMs to MLLMscited by 31
  9. 2024MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasetscited by 10
  10. 2025TeXpert: A Multi-Level Benchmark for Evaluating LaTeX Code Generation by LLMscited by 7
  11. 2025SMIR: Efficient Synthetic Data Pipeline To Improve Multi-Image Reasoningcited by 3
  12. 2025Supernova Event Dataset: Interpreting Large Language Models' Personality through Critical Event Analysiscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Beyond Embeddings: The Promise of Visual Table in Visual Reasoning
  2. 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understanding
  3. 2025MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual Space
  4. 2025MMTABREAL: Real-World Benchmark for Multimodal Table Understanding
  5. 2026Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidance
  6. 2025Multimodal Tabular Reasoning with Privileged Structured Information
  7. 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy
  8. 2025Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning