CoReTab: Improving Multimodal Table Understanding with Code-driven Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Existing datasets for multimodal table understanding, such as MMTab, primarily provide short factual answers without explicit multi-step reasoning supervision. Models trained on these datasets often generate brief responses that offers insufficient accuracy and limited interpretability into how these models arrive at the final answer. We introduce CoReTab, a code-driven reasoning framework that produces scalable, interpretable, and automatically verifiable annotations by coupling multi-step reasoning with executable Python code. Using the CoReTab framework, we curate a dataset of 115K verified samples averaging 529 tokens per response and fine-tune open-source MLLMs through a three-stage pipeline. We evaluate the resulting model trained on CoReTab across 17 MMTab benchmarks spanning table question answering, fact verification, and table structure understanding. Our model achieves significant gains of +6.2%, +5.7%, and +25.6%, respectively, over MMTab-trained baselines, while producing transparent and verifiable reasoning traces. These results establish CoReTab as a robust and generalizable supervision framework for improving multi-step reasoning in multimodal table understanding.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 65 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
13 of 65 references.
References · 13
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
- 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 169
- 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuningcited by 79
- 2024Small Language Model Meets with Reinforced Vision Vocabularycited by 43
1 more
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026TABQAWORLD: Optimizing Multimodal Reasoning for Multi-Turn Table Question Answering
- 2024TART: An Open-Source Tool-Augmented Framework for Explainable Table-based Reasoning
- 2025ExpliCIT-QA: Explainable Code-Based Image Table Question Answering
- 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tables
- 2025TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
- 2026ProgramTab: Boosting Table Reasoning of LLMs via Programmatic Paradigm
- 2024TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition
- 2025Multimodal Tabular Reasoning with Privileged Structured Information