A Table Is Worth 64 Tokens: Pixel-level Compression for Multi-Table Document Question Answering
Not on the map. Why?
Abstract (arXiv)
Answering questions over real-world documents requires processing long inputs that interleave text with tables. Optical context compression, which represents context as images, promises to reduce token cost, but its effect on table understanding remains unclear. We study pixel-level table compression for question answering over documents with multiple tables, evaluating five VLMs across two benchmarks and five visual-token budgets. Representing tables as images at native resolution matches text in both performance and efficiency, but downscaling them makes models compensate the loss in readability with longer, less effective reasoning traces that cancel the expected savings. Highly downscaled tables, however, preserve enough signal to identify whether they are relevant to a question. We exploit this asymmetry with a training-free, two-step method: the model first identifies the tables needed to answer a question from a pixel-compressed context, and then reasons over those at native resolution. On long documents, our method saves 41% of total tokens and gains 7 accuracy points over single-step QA with native resolution tables. It also uses 15% fewer tokens than the most efficient single-step compressed configuration, with no accuracy loss.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
32 of 49 references.
References · 32
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Taskscited by 201
- 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understandingcited by 185
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 120
20 more
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 84
- 2024Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Modelscited by 70
- 2024TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table Domainscited by 68
- 2024CompAct: Compressing Retrieved Documents Actively for Question Answeringcited by 64
- 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
- 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMscited by 40
- 2024Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Passcited by 26
- 2023Text Rendering Strategies for Pixel Language Modelscited by 22
- 2024Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learningcited by 17
- 2025MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual Spacecited by 9
- 2025NeedleInATable: Exploring Long-Context Capability of Large Language Models towards Long-Structured Tablescited by 8
- 2026Evidence-Augmented Policy Optimization with Reward Co-Evolution for Long-Context Reasoningcited by 7
- 2023PixT3: Pixel-based Table-To-Text Generationcited by 6
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understandingcited by 5
- 2025TaTToo: Tool-Grounded Thinking PRM for Test-Time Scaling in Tabular Reasoningcited by 5
- 2026DocPrune:Efficient Document Question Answering via Background, Question, and Comprehension-aware Token Pruningcited by 4
- 2025TableDART: Dynamic Adaptive Multi-Modal Routing for Table Understandingcited by 3
- 2026TABQAWORLD: Optimizing Multimodal Reasoning for Multi-Turn Table Question Answeringcited by 3
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoningcited by 2
- 2026Document-Level Numerical Reasoning across Single and Multiple Tables in Financial Reportscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Texts or Images? A Fine-grained Analysis on the Effectiveness of Input Representations and Models for Table Question Answering
- 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understanding
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs
- 2024Efficient Large Multi-modal Models via Visual Context Compression
- 2025Interpret, prune and distill Donut : towards lightweight VLMs for VQA on document
- 2026TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Charts
- 2025TabFlash: Efficient Table Understanding with Progressive Question Conditioning and Token Focusing