DocBank: A Benchmark Dataset for Document Layout Analysis
Not on the map. Why?
Abstract (arXiv)
Document layout analysis usually relies on computer vision models to understand documents while ignoring textual information that is vital to capture. Meanwhile, high quality labeled datasets with both visual and textual information are still insufficient. In this paper, we present DocBank, a benchmark dataset that contains 500K document pages with fine-grained token-level annotations for document layout analysis. DocBank is constructed using a simple yet effective way with weak supervision from the LaTeX documents available on the arXiv.com. With DocBank, models from different modalities can be compared fairly and multi-modal approaches will be further investigated and boost the performance of document layout analysis. We build several strong baselines and manually split train/dev/test sets for evaluation. Experiment results show that models trained on DocBank accurately recognize the layout information for a variety of documents. The DocBank dataset is publicly available at urlhttps://github.com/doc-analysis/DocBank.
Key facts. Cited by 152 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 13; 2023: 31; 2024: 33; 2025: 30; 2026: 24.
152 papers.
Sort:
By area:
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
- 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 98
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
38 more
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
- 2021Document AI: Benchmarks, Models and Applicationscited by 61
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2023Vision Grid Transformer for Document Layout Analysiscited by 45
- 2023M6Doc: A Large-Scale Multi-Format, Multi-Type, Multi-Layout, Multi-Language, Multi-Annotation Category Dataset for Modern Document Layout Analysiscited by 44
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2021VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relationscited by 40
- 2024Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matchingcited by 39
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2022VRDU: A Benchmark for Visually-rich Document Understandingcited by 35
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Modelscited by 34
- 2022Robust Table Detection and Structure Recognition from Heterogeneous Document Imagescited by 30
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
- 2024InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructionscited by 27
- 2021Entity Relation Extraction as Dependency Parsing in Visually Rich Documentscited by 23
- 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understandingcited by 23
- 2023HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structurescited by 22
- 2023Diffusion-based Document Layout Generationcited by 21
- 2023CCpdf: Building a High Quality Corpus for Visually Rich Documents from Web Crawl Datacited by 21
- 2024Deep Learning based Visually Rich Document Content Understanding: A Surveycited by 21
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2022Doc-GCN: Heterogeneous Graph Convolutional Networks for Document Layout Analysiscited by 17
- 2021LAMPRET: Layout-Aware Multimodal PreTraining for Document Understandingcited by 15
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
- 2025P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmarkcited by 15
- 2024Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysiscited by 14
- 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
- 2024PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Samplingcited by 14
- 2025KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understandingcited by 14
- 2023BaDLAD: A Large Multi-Domain Bengali Document Layout Analysis Datasetcited by 13
- 2024RoDLA: Benchmarking the Robustness of Document Layout Analysis Modelscited by 12
- 2024Visually Guided Generative Text-Layout Pre-training for Document Intelligencecited by 12
- 2025Handwritten Text Recognition: A Surveycited by 12
- 2022Relational Representation Learning in Visually-Rich Documentscited by 11
- 2023Beyond Document Page Classification: Design, Datasets, and Challengescited by 10
- 2024LAPDoc: Layout-Aware Prompting for Documentscited by 9
50 most cited of 152 All 152 (JSON)
- 2026Source-preserving alignment for robust evidence localization in scientific PDFS28 Sep 2026
- 2026Robust Hierarchical Structures for Agentic Document Analysis27 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection7 Sep 2026
- 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarks24 Aug 2026
- 2026BaFCo: A Document Understanding Benchmark for Complex Bangla Form Comprehension6 Jul 2026
- 2026Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding29 Jun 2026
- 2026Bounding Box Label Propagation for Re-Annotation of Document Layout Analysis Datasets16 Jun 2026
- 2026RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents5 Jun 2026
- 2026DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions4 Jun 2026
- 2026DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents27 May 2026
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languages12 May 2026
38 more
- 2026Lightweight and Production-Ready PDF Visual Element Parsing25 Apr 2026
- 2026Improving Layout Representation Learning Across Inconsistently Annotated Datasets via Agentic Harmonization13 Apr 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026Revise: A Framework for Revising OCRed text in Practical Information Systems with Data Contamination Strategy9 Apr 2026
- 2026A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents26 Mar 2026
- 2026SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asia16 Mar 2026
- 2026PromptDLA: A Domain-aware Prompt Document Layout Analysis Framework with Descriptive Knowledge as a Cue10 Mar 2026
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence23 Feb 2026
- 2026DocSplit: A Comprehensive Benchmark Dataset and Evaluation Approach for Document Packet Recognition and Splitting17 Feb 2026
- 2026Combined Flicker-banding and Moire Removal for Screen-Captured Images2 Feb 2026
- 2026PubMed-OCR: PMC Open Access OCR Annotations16 Jan 2026
- 2026MathDoc: Benchmarking Structured Extraction and Active Refusal on Noisy Mathematics Exam Papers15 Jan 2026
- 2025From Chaos to Clarity: Schema-Constrained AI for Auditable Biomedical Evidence Extraction from Full-Text PDFs31 Dec 2025
- 2025IndicDLP: A Foundational Dataset for Multi-Lingual and Multi-Domain Document Layout Parsing23 Dec 2025
- 2025Layout-Aware Text Editing for Efficient Transformation of Academic PDFs to Markdown19 Dec 2025
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agents19 Dec 2025
- 2025PharmaShip: An Entity-Centric, Reading-Order-Supervised Benchmark for Chinese Pharmaceutical Shipping Documents29 Nov 2025
- 2025HybriDLA: Hybrid Generation for Document Layout Analysis25 Nov 2025
- 2025SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understanding30 Oct 2025
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs23 Oct 2025
- 2025Paper2Web: Let's Make Your Paper Alive!17 Oct 2025
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition24 Sep 2025
- 2025Layout-Aware OCR for Black Digital Archives with Unsupervised Evaluation16 Sep 2025
- 2025DREAM: Document Reconstruction via End-to-end Autoregressive Model8 Jul 2025
- 2025AI-Generated Lecture Slides for Improving Slide Element Detection and Retrieval30 Jun 2025
- 2025Synthetic Data Augmentation for Table Detection: Re-evaluating TableNet's Performance with Automatically Generated Document Images17 Jun 2025
- 2025FormGym: Doing Paperwork with Agents17 Jun 2025
- 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs26 May 2025
- 2025P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmark21 May 2025
- 2025SCAN: Semantic Document Layout Analysis for Textual and Visual Retrieval-Augmented Generation20 May 2025
- 2025Single Document Image Highlight Removal via A Large-Scale Real-World Dataset and A Location-Aware Network19 Apr 2025
- 2025XY-Cut++: Advanced Layout Ordering via Hierarchical Mask Mechanism on a Novel Benchmark14 Apr 2025
- 2025DocSAM: Unified Document Image Segmentation via Query Decomposition and Heterogeneous Mixed Learning5 Apr 2025
- 2025AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization28 Mar 2025
- 2025TextBite: A Historical Czech Document Dataset for Logical Page Segmentation20 Mar 2025
- 2025EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation23 Feb 2025
50 newest of 152 All 152 (JSON)
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Modelscited by 34
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2024PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Samplingcited by 14
- 2025SCAN: Semantic Document Layout Analysis for Textual and Visual Retrieval-Augmented Generationcited by 5
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agentscited by 2
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMscited by 1
- 2026BaFCo: A Document Understanding Benchmark for Complex Bangla Form Comprehensioncited by 0
- 2026BaFCo: A Document Understanding Benchmark for Complex Bangla Form Comprehension6 Jul 2026
- 2025DAVE: A VLM Vision Encoder for Document Understanding and Web Agents19 Dec 2025
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs23 Oct 2025
- 2025SCAN: Semantic Document Layout Analysis for Textual and Visual Retrieval-Augmented Generation20 May 2025
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understanding25 Oct 2024
- 2024PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling8 Oct 2024
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models17 Jun 2024
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding8 Apr 2024
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want29 Mar 2024
- 2025SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understandingcited by 3
- 2026DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agentscited by 2
- 2025FormGym: Doing Paperwork with Agentscited by 1
- 2026DragOn: A Benchmark and Dataset for Drag-Based GUI Interactionscited by 0
- 2026Robust Hierarchical Structures for Agentic Document Analysiscited by 0
- 2026Robust Hierarchical Structures for Agentic Document Analysis27 Sep 2026
- 2026DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions4 Jun 2026
- 2026DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents27 May 2026
- 2025SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understanding30 Oct 2025
- 2025FormGym: Doing Paperwork with Agents17 Jun 2025
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2025XY-Cut++: Advanced Layout Ordering via Hierarchical Mask Mechanism on a Novel Benchmarkcited by 1
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligencecited by 0
- 2026Lightweight and Production-Ready PDF Visual Element Parsingcited by 0
- 2026Lightweight and Production-Ready PDF Visual Element Parsing25 Apr 2026
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence23 Feb 2026
- 2025XY-Cut++: Advanced Layout Ordering via Hierarchical Mask Mechanism on a Novel Benchmark14 Apr 2025
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations10 Dec 2024
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction28 Oct 2024
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
- 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 98
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
12 most cited of 131 All 131 (JSON)
- 2026Source-preserving alignment for robust evidence localization in scientific PDFS28 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection7 Sep 2026
- 2026Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding29 Jun 2026
- 2026Bounding Box Label Propagation for Re-Annotation of Document Layout Analysis Datasets16 Jun 2026
- 2026RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents5 Jun 2026
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languages12 May 2026
- 2026Improving Layout Representation Learning Across Inconsistently Annotated Datasets via Agentic Harmonization13 Apr 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026Revise: A Framework for Revising OCRed text in Practical Information Systems with Data Contamination Strategy9 Apr 2026
- 2026A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents26 Mar 2026
- 2026SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asia16 Mar 2026
12 newest of 131 All 131 (JSON)