Optimized Table Tokenization for Table Structure Recognition
Not on the map. Why?
Abstract (arXiv)
Extracting tables from documents is a crucial task in any document conversion pipeline. Recently, transformer-based models have demonstrated that table-structure can be recognized with impressive accuracy using Image-to-Markup-Sequence (Im2Seq) approaches. Taking only the image of a table, such models predict a sequence of tokens (e.g. in HTML, LaTeX) which represent the structure of the table. Since the token representation of the table structure has a significant impact on the accuracy and run-time performance of any Im2Seq model, we investigate in this paper how table-structure representation can be optimised. We propose a new, optimised table-structure language (OTSL) with a minimized vocabulary and specific rules. The benefits of OTSL are that it reduces the number of tokens to 5 (HTML needs 28+) and shortens the sequence length to half of HTML on average. Consequently, model accuracy improves significantly, inference time is halved compared to HTML-based models, and the predicted table structures are always syntactically correct. This in turn eliminates most post-processing needs.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 5 May 2023.
Builds on
15 of 24 references.
References · 15
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2021PubTables-1M: Towards comprehensive table extraction from unstructured documentscited by 122
- 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
- 2022TableFormer: Table Structure Understanding with Transformerscited by 93
- 2019Complicated Table Structure Recognitioncited by 91
- 2021Split, embed and merge: An accurate table structure recognizercited by 42
- 2021PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Literature Parsing Task B: Table Recognition to HTMLcited by 39
- 2021TGRNet: A Table Graph Reconstruction Network for Table Structure Recognitioncited by 27
- 2018Corpus Conversion Service: A Machine Learning Platform to Ingest Documents at Scalecited by 12
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 10; 2026: 18.
34 papers.
Sort:
By area:
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
- 2024Docling Technical Reportcited by 29
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligencecited by 20
- 2024UniTable: Towards a Unified Framework for Table Recognition via Self-Supervised Pretrainingcited by 12
- 2025TFLOP: Table Structure Recognition Framework with Layout Pointer Mechanismcited by 9
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 9
- 2024SEMv3: A Fast and Robust Approach to Table Separation Line Detectioncited by 7
- 2025SPRINT: Script-agnostic Structure Recognition in Tablescited by 6
- 2025Advanced Layout Analysis Models for Doclingcited by 6
- 2025TABLET: Table Structure Recognition using Encoder-only Transformerscited by 5
- 2026ScreenParse: Moving Beyond Sparse Grounding with Complete Screen Parsing Supervisioncited by 4
22 more
- 2026Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processingcited by 3
- 2023ESG Accountability Made Easy: DocQA at Your Servicecited by 2
- 2024PdfTable: A Unified Toolkit for Deep Learning-Based Table Extractioncited by 1
- 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignmentcited by 1
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Modelscited by 1
- 2026InstructTable: Improving Table Structure Recognition Through Instructionscited by 1
- 2026LLM-as-a-Judge Scores Are Unreliable Optimization Signals in Closed-Loop Table Recognitioncited by 1
- 2024MaterioMiner -- An ontology-based text mining dataset for extraction of process-structure-property entitiescited by 0
- 2025CISOL: An Open and Extensible Dataset for Table Structure Recognition in the Construction Industrycited by 0
- 2025SepFormer: Coarse-to-fine Separator Regression Network for Table Structure Recognitioncited by 0
- 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Taskscited by 0
- 2026VERSE: Visual Embedding Reduction and Space Exploration. Clustering-Guided Insights for Training Data Enhancement in Visually-Rich Document Understandingcited by 0
- 2026TableSeq: Unified Generation of Structure, Content, and Layoutcited by 0
- 2026LIFT: Last-Mile Fine-Tuning for Table Explicitationcited by 0
- 2026FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformerscited by 0
- 2026Rethinking the Pointer Loss in Table Structure Recognition: Geometry-Aware Pointer Loss for Spatial Localitycited by 0
- 2026ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognitioncited by 0
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsingcited by 0
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documentscited by 0
- 2026Identify, Locate, Link: End-to-End Key-Value Extraction from Document Imagescited by 0
- 2026How Far Can Synthetic Data Take Thai OCR?cited by 0
- 2026Tables Decoded: DELTA for Structure, TARQA for Understandingcited by 0
- 2026Tables Decoded: DELTA for Structure, TARQA for Understanding15 Sep 2026
- 2026How Far Can Synthetic Data Take Thai OCR?3 Sep 2026
- 2026Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images21 Aug 2026
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents13 Aug 2026
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing10 Aug 2026
- 2026LLM-as-a-Judge Scores Are Unreliable Optimization Signals in Closed-Loop Table Recognition15 Jul 2026
- 2026ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition1 Jul 2026
- 2026Rethinking the Pointer Loss in Table Structure Recognition: Geometry-Aware Pointer Loss for Spatial Locality17 Jun 2026
- 2026FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformers21 May 2026
- 2026LIFT: Last-Mile Fine-Tuning for Table Explicitation13 May 2026
- 2026TableSeq: Unified Generation of Structure, Content, and Layout17 Apr 2026
- 2026InstructTable: Improving Table Structure Recognition Through Instructions3 Apr 2026
22 more
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processing25 Mar 2026
- 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment24 Mar 2026
- 2026ScreenParse: Moving Beyond Sparse Grounding with Complete Screen Parsing Supervision15 Feb 2026
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding28 Jan 2026
- 2026VERSE: Visual Embedding Reduction and Space Exploration. Clustering-Guided Insights for Training Data Enhancement in Visually-Rich Document Understanding8 Jan 2026
- 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Tasks7 Oct 2025
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep 2025
- 2025Advanced Layout Analysis Models for Docling15 Sep 2025
- 2025SepFormer: Coarse-to-fine Separator Regression Network for Table Structure Recognition27 Jun 2025
- 2025TABLET: Table Structure Recognition using Encoder-only Transformers8 Jun 2025
- 2025SPRINT: Script-agnostic Structure Recognition in Tables15 Mar 2025
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar 2025
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligence14 Feb 2025
- 2025CISOL: An Open and Extensible Dataset for Table Structure Recognition in the Construction Industry26 Jan 2025
- 2025TFLOP: Table Structure Recognition Framework with Layout Pointer Mechanism21 Jan 2025
- 2024PdfTable: A Unified Toolkit for Deep Learning-Based Table Extraction8 Sep 2024
- 2024Docling Technical Report19 Aug 2024
- 2024MaterioMiner -- An ontology-based text mining dataset for extraction of process-structure-property entities5 Aug 2024
- 2024SEMv3: A Fast and Robust Approach to Table Separation Line Detection20 May 2024
- 2024UniTable: Towards a Unified Framework for Table Recognition via Self-Supervised Pretraining7 Mar 2024
- 2023ESG Accountability Made Easy: DocQA at Your Service30 Nov 2023
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
- 2026Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processingcited by 3
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Modelscited by 1
- 2026VERSE: Visual Embedding Reduction and Space Exploration. Clustering-Guided Insights for Training Data Enhancement in Visually-Rich Document Understandingcited by 0
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processing25 Mar 2026
- 2026VERSE: Visual Embedding Reduction and Space Exploration. Clustering-Guided Insights for Training Data Enhancement in Visually-Rich Document Understanding8 Jan 2026
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep 2025
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar 2025
- 2024Docling Technical Reportcited by 29
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligencecited by 20
- 2024UniTable: Towards a Unified Framework for Table Recognition via Self-Supervised Pretrainingcited by 12
- 2025TFLOP: Table Structure Recognition Framework with Layout Pointer Mechanismcited by 9
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 9
- 2024SEMv3: A Fast and Robust Approach to Table Separation Line Detectioncited by 7
- 2025SPRINT: Script-agnostic Structure Recognition in Tablescited by 6
- 2025Advanced Layout Analysis Models for Doclingcited by 6
- 2025TABLET: Table Structure Recognition using Encoder-only Transformerscited by 5
- 2026ScreenParse: Moving Beyond Sparse Grounding with Complete Screen Parsing Supervisioncited by 4
- 2023ESG Accountability Made Easy: DocQA at Your Servicecited by 2
- 2024PdfTable: A Unified Toolkit for Deep Learning-Based Table Extractioncited by 1
12 most cited of 29 All 29 (JSON)
- 2026Tables Decoded: DELTA for Structure, TARQA for Understanding15 Sep 2026
- 2026How Far Can Synthetic Data Take Thai OCR?3 Sep 2026
- 2026Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images21 Aug 2026
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents13 Aug 2026
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing10 Aug 2026
- 2026LLM-as-a-Judge Scores Are Unreliable Optimization Signals in Closed-Loop Table Recognition15 Jul 2026
- 2026ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition1 Jul 2026
- 2026Rethinking the Pointer Loss in Table Structure Recognition: Geometry-Aware Pointer Loss for Spatial Locality17 Jun 2026
- 2026FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformers21 May 2026
- 2026LIFT: Last-Mile Fine-Tuning for Table Explicitation13 May 2026
- 2026TableSeq: Unified Generation of Structure, Content, and Layout17 Apr 2026
- 2026InstructTable: Improving Table Structure Recognition Through Instructions3 Apr 2026
12 newest of 29 All 29 (JSON)