PubTables-1M: Towards comprehensive table extraction from unstructured documents
Not on the map. Why?
Abstract (arXiv)
Recently, significant progress has been made applying machine learning to the problem of table structure inference and extraction from unstructured documents. However, one of the greatest challenges remains the creation of datasets with complete, unambiguous ground truth at scale. To address this, we develop a new, more comprehensive dataset for table extraction, called PubTables-1M. PubTables-1M contains nearly one million tables from scientific articles, supports multiple input modalities, and contains detailed header and location information for table structures, making it useful for a wide variety of modeling approaches. It also addresses a significant source of ground truth inconsistency observed in prior datasets called oversegmentation, using a novel canonicalization procedure. We demonstrate that these improvements lead to a significant increase in training performance and a more reliable estimate of model performance at evaluation for table structure recognition. Further, we show that transformer-based object detection models trained on PubTables-1M produce excellent results for all three tasks of detection, structure recognition, and functional analysis without the need for any special customization for these tasks. Data and code will be released at https://github.com/microsoft/table-transformer.
Key facts. Cited by 126 papers in the map (data through 14 Oct 2026). Builds on 8 of its 28 references that are in the map. First posted on arXiv 30 Sep 2021.
Builds on
8 of 28 references.
References · 8
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019Image-based table recognition: data, model, and evaluationcited by 237
- 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 147
- 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
- 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
- 2019Complicated Table Structure Recognitioncited by 92
- 2020TableNet: Deep Learning model for end-to-end Table detection and Tabular data extraction from Scanned Document Imagescited by 69
Built on by
Citing papers per year: 2022: 6; 2023: 22; 2024: 25; 2025: 31; 2026: 42.
126 papers.
Sort:
By area:
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 53
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2023Improving Table Structure Recognition with Visual-Alignment Sequential Coordinate Modelingcited by 41
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
- 2023Optimized Table Tokenization for Table Structure Recognitioncited by 34
- 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
- 2022GriTS: Grid table similarity metric for table structure recognitioncited by 28
38 more
- 2023A large-scale dataset for end-to-end table recognition in the wildcited by 24
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 23
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligencecited by 20
- 2023LORE: Logical Location Regression Network for Table Structure Recognitioncited by 19
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 19
- 2022Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networkscited by 17
- 2025NVIDIA Nemotron Nano V2 VLcited by 17
- 2022Deep learning for table detection and structure recognition: A surveycited by 15
- 2023Aligning benchmark datasets for table structure recognitioncited by 15
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 14
- 2024Enhancing Vision-Language Pre-training with Rich Supervisionscited by 13
- 2024UniTable: Towards a Unified Framework for Table Recognition via Self-Supervised Pretrainingcited by 13
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tablescited by 13
- 2023SEMv2: Table Separation Line Detection Based on Instance Segmentationcited by 12
- 2023Robust Table Structure Recognition with Dynamic Queries Enhanced Detection Transformercited by 12
- 2024Efficient Prompting for LLM-based Generative Internet of Thingscited by 12
- 2024UniTabNet: Bridging Vision and Language Models for Enhanced Table Structure Recognitioncited by 11
- 2023Rethinking Image-based Table Recognition Using Weakly Supervised Methodscited by 10
- 2025FS-DAG: Few Shot Domain Adapting Graph Networks for Visually Rich Document Understandingcited by 10
- 2024JDocQA: Japanese Document Question Answering Dataset for Generative Language Modelscited by 9
- 2024LORE++: Logical Location Regression Network for Table Structure Recognition with Pre-trainingcited by 8
- 2025Granite Embedding R2 Modelscited by 8
- 2023Towards End-to-End Semi-Supervised Table Detection with Deformable Transformercited by 7
- 2023Bridging the Performance Gap between DETR and R-CNN for Graphical Object Detection in Document Imagescited by 7
- 2023DSG: An End-to-End Document Structure Generatorcited by 7
- 2024SEMv3: A Fast and Robust Approach to Table Separation Line Detectioncited by 7
- 2023Grab What You Need: Rethinking Complex Table Structure Recognition with Flexible Components Deliberationcited by 6
- 2023Table Detection for Visually Rich Document Imagescited by 6
- 2024A Hybrid Approach for Document Layout Analysis in Document imagescited by 6
- 2025SPRINT: Script-agnostic Structure Recognition in Tablescited by 6
- 2024Towards End-to-End Semi-Supervised Table Detection with Semantic Aligned Matching Transformercited by 5
- 2025SCORE: A Semantic Evaluation Framework for Generative Document Parsingcited by 5
- 2024The Socface Project: Large-Scale Collection, Processing, and Analysis of a Century of French Censusescited by 4
- 2024End-to-End Semi-Supervised approach with Modulated Object Queries for Table Detection in Documentscited by 4
- 2025DocSAM: Unified Document Image Segmentation via Query Decomposition and Heterogeneous Mixed Learningcited by 4
- 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settingscited by 4
- 2023Revisiting Table Detection Datasets for Visually Rich Documentscited by 3
50 most cited of 126 All 126 (JSON)
- 2026Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation14 Oct 2026
- 2026The Last Mile of Coding Agents for Long-Document Tasks: An Empirical Study on Clinical Trial Protocol Digitization13 Oct 2026
- 2026TableVision: Recovering Verified Structure from Historical Tables12 Oct 2026
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Back2Struct: Making Structured Images Editable Again29 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding22 Sep 2026
- 2026PrismAlign: Prior-Steered Multi-View VLM Alignment for Hallucination-Robust Table OCR18 Sep 2026
- 2026Tables Decoded: DELTA for Structure, TARQA for Understanding15 Sep 2026
- 2026Enhancing Table Structure Recognition via Bounding Box Guidance8 Sep 2026
- 2026EMBLEM: Enhancing Multi-script Table Detection through Masking8 Sep 2026
- 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Models29 Aug 2026
38 more
- 2026Industrial-Instruction: An End-to-End Framework for Building Instruction-Tuning and Benchmark Datasets from Industrial Technical Reports24 Aug 2026
- 2026StagedWorkspace: A Versioned Workspace for Knowledge-Work Agents18 Aug 2026
- 2026FormStruct-Bench:A Hierarchical and Diagnostic Benchmark for Table-Form Document Structure Recognition11 Aug 2026
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing10 Aug 2026
- 2026LLM-as-a-Judge Scores Are Unreliable Optimization Signals in Closed-Loop Table Recognition15 Jul 2026
- 2026Multimodal CoLRAG-TF: Triple-Filtered Retrieval for Complex PDFs7 Jul 2026
- 2026Active Learning for Cascaded Object Detection: Balancing Coverage and Uncertainty in Table Extraction Pipelines1 Jul 2026
- 2026ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition1 Jul 2026
- 2026Building Agent Harnesses for Scientific Curation from Multimodal Sources19 Jun 2026
- 2026TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-217 Jun 2026
- 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction8 Jun 2026
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs8 Jun 2026
- 2026FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformers21 May 2026
- 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings8 May 2026
- 2026RaV-IDP: A Reconstruction-as-Validation Framework for Faithful Intelligent Document Processing26 Apr 2026
- 2026DenTab: A Dataset for Table Recognition and Visual QA on Real-World Dental Estimates17 Apr 2026
- 2026TableSeq: Unified Generation of Structure, Content, and Layout17 Apr 2026
- 2026INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents13 Apr 2026
- 2026InstructTable: Improving Table Structure Recognition Through Instructions3 Apr 2026
- 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment24 Mar 2026
- 2026Beyond String Matching: Semantic Evaluation of PDF Table Extraction19 Mar 2026
- 2026A Proactive EMR Assistant for Doctor-Patient Dialogue: Streaming ASR, Belief Stabilization, and Preliminary Controlled Evaluation18 Mar 2026
- 2026Proactive Knowledge Inquiry in Doctor-Patient Dialogue: Stateful Extraction, Belief Updating, and Path-Aware Action Planning18 Mar 2026
- 2026LingDT-VL-OCR: Structure-Aware Document-Level Parsing with Fine-Grained Visual Reference11 Mar 2026
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence23 Feb 2026
- 2026BLUEPRINT Rebuilding a Legacy: Multimodal Retrieval for Complex Engineering Drawings and Documents12 Feb 2026
- 2026ExStrucTiny: A Benchmark for Schema-Variable Structured Information Extraction from Document Images12 Feb 2026
- 2026AI-assisted Protocol Information Extraction For Improved Accuracy and Efficiency in Clinical Trial Workflows19 Jan 2026
- 2026PubMed-OCR: PMC Open Access OCR Annotations16 Jan 2026
- 2025Post-Processing Mask-Based Table Segmentation for Structural Coordinate Extraction24 Dec 2025
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agents19 Dec 2025
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extraction11 Dec 2025
- 2025NVIDIA Nemotron Parse 1.125 Nov 2025
- 2025Hierarchical structure understanding in complex tables with VLLMs: a benchmark and experiments11 Nov 2025
- 2025NVIDIA Nemotron Nano V2 VL6 Nov 2025
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs23 Oct 2025
- 2025Exploring OCR-augmented Generation for Bilingual VQA2 Oct 2025
50 newest of 126 All 126 (JSON)
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 53
- 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 19
- 2024Enhancing Vision-Language Pre-training with Rich Supervisionscited by 13
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tablescited by 13
- 2025MindVL: Towards Efficient and Effective Training of Multimodal Large Language Models on Ascend NPUscited by 3
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agentscited by 2
- 2026TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2cited by 2
- 2025Exploring OCR-augmented Generation for Bilingual VQAcited by 1
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMscited by 1
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMscited by 1
- 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Modelscited by 0
- 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Models29 Aug 2026
- 2026TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-217 Jun 2026
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs8 Jun 2026
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agents19 Dec 2025
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs23 Oct 2025
- 2025Exploring OCR-augmented Generation for Bilingual VQA2 Oct 2025
- 2025MindVL: Towards Efficient and Effective Training of Multimodal Large Language Models on Ascend NPUs15 Sep 2025
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables13 Jun 2025
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar 2025
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understanding25 Oct 2024
- 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokens7 Oct 2024
- 2024Enhancing Vision-Language Pre-training with Rich Supervisions5 Mar 2024
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 23
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 14
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomouscited by 0
- 2026Multimodal CoLRAG-TF: Triple-Filtered Retrieval for Complex PDFscited by 0
- 2026Multimodal CoLRAG-TF: Triple-Filtered Retrieval for Complex PDFs7 Jul 2026
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Models22 Feb 2025
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables5 Dec 2024
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligencecited by 0
- 2026RaV-IDP: A Reconstruction-as-Validation Framework for Faithful Intelligent Document Processingcited by 0
- 2026RaV-IDP: A Reconstruction-as-Validation Framework for Faithful Intelligent Document Processing26 Apr 2026
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence23 Feb 2026
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction28 Oct 2024
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis21 Jun 2024
- 2024Latent Diffusion for Guided Document Table Generationcited by 2
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2023Improving Table Structure Recognition with Visual-Alignment Sequential Coordinate Modelingcited by 41
- 2023Optimized Table Tokenization for Table Structure Recognitioncited by 34
- 2022GriTS: Grid table similarity metric for table structure recognitioncited by 28
- 2023A large-scale dataset for end-to-end table recognition in the wildcited by 24
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligencecited by 20
- 2023LORE: Logical Location Regression Network for Table Structure Recognitioncited by 19
- 2022Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networkscited by 17
12 most cited of 102 All 102 (JSON)
- 2026Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation14 Oct 2026
- 2026TableVision: Recovering Verified Structure from Historical Tables12 Oct 2026
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Back2Struct: Making Structured Images Editable Again29 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026PrismAlign: Prior-Steered Multi-View VLM Alignment for Hallucination-Robust Table OCR18 Sep 2026
- 2026Tables Decoded: DELTA for Structure, TARQA for Understanding15 Sep 2026
- 2026Enhancing Table Structure Recognition via Bounding Box Guidance8 Sep 2026
- 2026EMBLEM: Enhancing Multi-script Table Detection through Masking8 Sep 2026
- 2026Industrial-Instruction: An End-to-End Framework for Building Instruction-Tuning and Benchmark Datasets from Industrial Technical Reports24 Aug 2026
- 2026FormStruct-Bench:A Hierarchical and Diagnostic Benchmark for Table-Form Document Structure Recognition11 Aug 2026
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing10 Aug 2026
12 newest of 102 All 102 (JSON)