Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Context
Not on the map. Why?
Abstract (arXiv)
Documents are often used for knowledge sharing and preservation in business and science, within which are tables that capture most of the critical data. Unfortunately, most documents are stored and distributed as PDF or scanned images, which fail to preserve logical table structure. Recent vision-based deep learning approaches have been proposed to address this gap, but most still cannot achieve state-of-the-art results. We present Global Table Extractor (GTE), a vision-guided systematic framework for joint table detection and cell structured recognition, which could be built on top of any object detection model. With GTE-Table, we invent a new penalty based on the natural cell containment constraint of tables to train our table network aided by cell location predictions. GTE-Cell is a new hierarchical cell detection network that leverages table styles. Further, we design a method to automatically label table and cell structure in existing documents to cheaply create a large corpus of training and test data. We use this to enhance PubTabNet with cell labels and create FinTabNet, real-world and complex scientific and financial datasets with detailed table structure annotations to help train and test structure recognition. Our framework surpasses previous state-of-the-art results on the ICDAR 2013 and ICDAR 2019 table competition in both table detection and cell structure recognition with a significant 5.8% improvement in the full table extraction system. Further experiments demonstrate a greater than 45% improvement in cell structure recognition when compared to a vanilla RetinaNet object detection model in our new out-of-domain FinTabNet.
Key facts. Cited by 146 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 28; 2024: 28; 2025: 31; 2026: 32.
146 papers.
Sort:
By area:
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2021PubTables-1M: Towards comprehensive table extraction from unstructured documentscited by 122
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 120
- 2021TABBIE: Pretrained Representations of Tabular Datacited by 111
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2022TableFormer: Table Structure Understanding with Transformerscited by 93
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
38 more
- 2024TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table Domainscited by 68
- 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
- 2021LGPMA: Complicated Table Structure Recognition with Local and Global Pyramid Mask Alignmentcited by 46
- 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2021Parsing Table Structures in the Wildcited by 43
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2023Improving Table Structure Recognition with Visual-Alignment Sequential Coordinate Modelingcited by 41
- 2023Optimized Table Tokenization for Table Structure Recognitioncited by 34
- 2025REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmarkcited by 34
- 2021Neural Collaborative Graph Machines for Table Structure Recognitioncited by 30
- 2022Robust Table Detection and Structure Recognition from Heterogeneous Document Imagescited by 30
- 2022TSRFormer: Table Structure Recognition with Transformerscited by 27
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
- 2021Retrieving Complex Tables with Multi-Granular Graph Representation Learningcited by 24
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 22
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligencecited by 20
- 2022TRUST: An Accurate and End-to-End Table structure Recognizer Using Splitting-based Transformerscited by 19
- 2023LORE: Logical Location Regression Network for Table Structure Recognitioncited by 19
- 2021Current Status and Performance Analysis of Table Recognition in Document Images with Deep Neural Networkscited by 18
- 2022PP-StructureV2: A Stronger Document Analysis Systemcited by 18
- 2023DocTr: Document Transformer for Structured Information Extraction in Documentscited by 18
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2021Visual Understanding of Complex Table Structures from Document Imagescited by 17
- 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answeringcited by 17
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsingcited by 17
- 2025Logics-Parsing Technical Reportcited by 16
- 2023Aligning benchmark datasets for table structure recognitioncited by 15
- 2025NVIDIA Nemotron Nano V2 VLcited by 15
- 2022Deep learning for table detection and structure recognition: A surveycited by 14
- 2023An End-to-End Multi-Task Learning Model for Image-based Table Recognitioncited by 14
- 2023GridFormer: Towards Accurate Table Structure Recognition via Grid Predictioncited by 13
- 2023SEMv2: Table Separation Line Detection Based on Instance Segmentationcited by 12
- 2023Robust Table Structure Recognition with Dynamic Queries Enhanced Detection Transformercited by 12
- 2024UniTable: Towards a Unified Framework for Table Recognition via Self-Supervised Pretrainingcited by 12
50 most cited of 146 All 146 (JSON)
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding22 Sep 2026
- 2026Tables Decoded: DELTA for Structure, TARQA for Understanding15 Sep 2026
- 2026Enhancing Table Structure Recognition via Bounding Box Guidance8 Sep 2026
- 2026EMBLEM: Enhancing Multi-script Table Detection through Masking8 Sep 2026
- 2026State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models27 Aug 2026
- 2026WildHandBench: A Benchmark for Handwritten Text Understanding that Challenges MLLMs and Humans24 Aug 2026
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing10 Aug 2026
- 2026LLM-as-a-Judge Scores Are Unreliable Optimization Signals in Closed-Loop Table Recognition15 Jul 2026
- 2026Infinity-Parser2 Technical Report8 Jul 2026
- 2026Active Learning for Cascaded Object Detection: Balancing Coverage and Uncertainty in Table Extraction Pipelines1 Jul 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026Revisiting Structural Dependency in Autoregressive Multi-Task Table Recognition via Order-Independent Cell-Level Representations16 Jun 2026
38 more
- 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction8 Jun 2026
- 2026ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats31 May 2026
- 2026FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformers21 May 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognition16 May 2026
- 2026WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild1 May 2026
- 2026PulseBench-Tab: A Multilingual Benchmark for Table Extraction with Graph-Based Evaluation21 Apr 2026
- 2026DenTab: A Dataset for Table Recognition and Visual QA on Real-World Dental Estimates17 Apr 2026
- 2026TableSeq: Unified Generation of Structure, Content, and Layout17 Apr 2026
- 2026ParseBench: A Document Parsing Benchmark for AI Agents9 Apr 2026
- 2026InstructTable: Improving Table Structure Recognition Through Instructions3 Apr 2026
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios30 Mar 2026
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training25 Mar 2026
- 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment24 Mar 2026
- 2026Beyond String Matching: Semantic Evaluation of PDF Table Extraction19 Mar 2026
- 2026Logics-Parsing-Omni Technical Report10 Mar 2026
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2026DocSplit: A Comprehensive Benchmark Dataset and Evaluation Approach for Document Packet Recognition and Splitting17 Feb 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2025Hierarchical Modeling Approach to Fast and Accurate Table Recognition24 Dec 2025
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agents19 Dec 2025
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extraction11 Dec 2025
- 2025NVIDIA Nemotron Nano V2 VL6 Nov 2025
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing17 Oct 2025
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep 2025
- 2025Logics-Parsing Technical Report24 Sep 2025
- 2025Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Images9 Sep 2025
- 2025From Search to Reasoning: A Five-Level RAG Capability Framework for Enterprise Data27 Aug 2025
- 2025Granite Embedding R2 Models26 Aug 2025
- 2025TASER: Table Agents for Schema-guided Extraction and Recommendation18 Aug 2025
- 2025TEN: Table Explicitization, Neurosymbolically12 Aug 2025
- 2025Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Models4 Aug 2025
- 2025TableMoE: Neuro-Symbolic Routing for Structured Expert Reasoning in Multimodal Table Understanding26 Jun 2025
- 2025QUEST: Quality-aware Semi-supervised Table Extraction for Business Documents17 Jun 2025
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables13 Jun 2025
- 2025TABLET: Table Structure Recognition using Encoder-only Transformers8 Jun 2025
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigm5 Jun 2025
50 newest of 146 All 146 (JSON)
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsingcited by 17
- 2025Logics-Parsing Technical Reportcited by 16
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyondcited by 11
- 2024HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embeddingcited by 10
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tablescited by 10
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Trainingcited by 7
- 2026Infinity-Parser2 Technical Reportcited by 4
12 most cited of 15 All 15 (JSON)
- 2026State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models27 Aug 2026
- 2026Infinity-Parser2 Technical Report8 Jul 2026
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training25 Mar 2026
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agents19 Dec 2025
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing17 Oct 2025
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep 2025
- 2025Logics-Parsing Technical Report24 Sep 2025
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables13 Jun 2025
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar 2025
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning31 Dec 2024
- 2024HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding20 Dec 2024
12 newest of 15 All 15 (JSON)
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 22
- 2024Enhancing Table Recognition with Vision LLMs: A Benchmark and Neighbor-Guided Toolchain Reasonercited by 9
- 2025TableMoE: Neuro-Symbolic Routing for Structured Expert Reasoning in Multimodal Table Understandingcited by 6
- 2025Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Imagescited by 6
- 2023GPT-3 Models are Few-Shot Financial Reasonerscited by 2
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomouscited by 0
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2025Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Images9 Sep 2025
- 2025TableMoE: Neuro-Symbolic Routing for Structured Expert Reasoning in Multimodal Table Understanding26 Jun 2025
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Models22 Feb 2025
- 2024Enhancing Table Recognition with Vision LLMs: A Benchmark and Neighbor-Guided Toolchain Reasoner30 Dec 2024
- 2023GPT-3 Models are Few-Shot Financial Reasoners25 Jul 2023
- 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2025REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmarkcited by 34
- 2025DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankerscited by 9
- 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generationcited by 3
- 2025From Search to Reasoning: A Five-Level RAG Capability Framework for Enterprise Datacited by 1
- 2025From Search to Reasoning: A Five-Level RAG Capability Framework for Enterprise Data27 Aug 2025
- 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generation4 Jun 2025
- 2025DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers28 May 2025
- 2025REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark17 Feb 2025
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction28 Oct 2024
- 2024Financial Report Chunking for Effective Retrieval Augmented Generation5 Feb 2024
- 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognition16 May 2026
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
- 2026ParseBench: A Document Parsing Benchmark for AI Agentscited by 9
- 2026ParseBench: A Document Parsing Benchmark for AI Agents9 Apr 2026
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2021PubTables-1M: Towards comprehensive table extraction from unstructured documentscited by 122
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 120
- 2021TABBIE: Pretrained Representations of Tabular Datacited by 111
- 2022TableFormer: Table Structure Understanding with Transformerscited by 93
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
- 2024TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table Domainscited by 68
- 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
12 most cited of 115 All 115 (JSON)
- 2026Tables Decoded: DELTA for Structure, TARQA for Understanding15 Sep 2026
- 2026Enhancing Table Structure Recognition via Bounding Box Guidance8 Sep 2026
- 2026EMBLEM: Enhancing Multi-script Table Detection through Masking8 Sep 2026
- 2026WildHandBench: A Benchmark for Handwritten Text Understanding that Challenges MLLMs and Humans24 Aug 2026
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing10 Aug 2026
- 2026LLM-as-a-Judge Scores Are Unreliable Optimization Signals in Closed-Loop Table Recognition15 Jul 2026
- 2026Active Learning for Cascaded Object Detection: Balancing Coverage and Uncertainty in Table Extraction Pipelines1 Jul 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026Revisiting Structural Dependency in Autoregressive Multi-Task Table Recognition via Order-Independent Cell-Level Representations16 Jun 2026
- 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction8 Jun 2026
- 2026ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats31 May 2026
- 2026FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformers21 May 2026
12 newest of 115 All 115 (JSON)