MMTABREAL: Real-World Benchmark for Multimodal Table Understanding
Not on the map. Why?
Abstract (arXiv)
Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image understanding, systematic evaluation of table-centric multimodal reasoning is limited. We introduce MMTABREAL, a MultiModal Table Benchmark, human-curated suite of 500 real-world tables paired with 4,021 question-answer pairs. MMTABREAL spans four question types, five reasoning categories, and eight structural archetypes. Evaluations of state-of-the-art models reveal substantial gaps, especially in visual grounding, spatial alignment, and multi-step inference, with 20-40% performance drops relative to existing benchmarks. These results highlight the need for architectures that more tightly fuse vision with tabular structure and support explicit numeric/logical operations. MMTABREAL is released for evaluation only, providing a rigorous, reproducible testbed that reflects the linguistic, structural, and reasoning complexity of real-world multimodal tables.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 27 of its 53 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
27 of 53 references.
References · 27
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 264
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 254
- 2024Rotary Position Embedding for Vision Transformercited by 236
15 more
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 216
- 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
- 2021FeTaQA: Free-form Table Question Answeringcited by 175
- 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agentscited by 159
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
- 2024What makes unlearning hard and what to do about itcited by 89
- 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 81
- 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2022SPIQ: Data-Free Per-Channel Static Input Quantizationcited by 12
- 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoningcited by 9
- 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tablescited by 9
- 2024KET-QA: A Dataset for Knowledge Enhanced Table Question Answeringcited by 5
- 2021An Algorithm to Warm Start Perturbed (WASP) Constrained Dynamic Programscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understandingcited by 5
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluationcited by 5
- 2026CoReTab: Improving Multimodal Table Understanding with Code-driven Reasoningcited by 3
- 2026Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidancecited by 3
- 2026VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learningcited by 3
- 2026Yuan3.0 Flash: An Open Multimodal Large Language Model for Enterprise Applicationscited by 2
- 2026V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimizationcited by 1
- 2026Yuan3.0 Ultra: A Trillion-Parameter Enterprise-Oriented MoE LLMcited by 0
- 2026Chart Deep Research in LVLMs via Parallel Relative Policy Optimizationcited by 0
- 2026VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning3 May 2026
- 2026V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization22 Apr 2026
- 2026Chart Deep Research in LVLMs via Parallel Relative Policy Optimization3 Mar 2026
- 2026Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidance3 Feb 2026
- 2026CoReTab: Improving Multimodal Table Understanding with Code-driven Reasoning27 Jan 2026
- 2026Yuan3.0 Ultra: A Trillion-Parameter Enterprise-Oriented MoE LLM20 Jan 2026
- 2026Yuan3.0 Flash: An Open Multimodal Large Language Model for Enterprise Applications5 Jan 2026
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation8 Oct 2025
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understanding25 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs
- 2024Multimodal Table Understanding
- 2025Multimodal Tabular Reasoning with Privileged Structured Information
- 2026Thinking with Tables: Enhancing Multi-Modal Tabular Understanding via Neuro-Symbolic Reasoning
- 2025MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual Space
- 2025TableDART: Dynamic Adaptive Multi-Modal Routing for Table Understanding
- 2026CFMS: A Coarse-to-Fine Multimodal Synthesis Framework for Enhanced Tabular Reasoning
- 2025Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Images