LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysis
Not on the map. Why?
Abstract (arXiv)
Recent advances in document image analysis (DIA) have been primarily driven by the application of neural networks. Ideally, research outcomes could be easily deployed in production and extended for further investigation. However, various factors like loosely organized codebases and sophisticated model configurations complicate the easy reuse of important innovations by a wide audience. Though there have been on-going efforts to improve reusability and simplify deep learning (DL) model development in disciplines like natural language processing and computer vision, none of them are optimized for challenges in the domain of DIA. This represents a major gap in the existing toolkit, as DIA is central to academic research across a wide range of disciplines in the social sciences and humanities. This paper introduces layoutparser, an open-source library for streamlining the usage of DL in DIA research and applications. The core layoutparser library comes with a set of simple and intuitive interfaces for applying and customizing DL models for layout detection, character recognition, and many other document processing tasks. To promote extensibility, layoutparser also incorporates a community platform for sharing both pre-trained models and full document digitization pipelines. We demonstrate that layoutparser is helpful for both lightweight and large-scale digitization pipelines in real-word use cases. The library is publicly available at https://layout-parser.github.io/.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 23 of its 45 references that are in the map. First posted on arXiv 29 Mar 2021.
Builds on
23 of 45 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
11 more
- 2019Character Region Awareness for Text Detectioncited by 273
- 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
- 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
- 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
- 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
- 2018dhSegment: A generic deep-learning approach for document segmentationcited by 32
- 2020A Large Dataset of Historical Japanese Documents with Complex Layoutscited by 24
- 2020The Newspaper Navigator Dataset: Extracting And Analyzing Visual Content from 16 Million Historic Newspaper Pages in Chronicling Americacited by 14
- 2019A Comprehensive Study of ImageNet Pre-Training for Historical Document Image Analysiscited by 11
- 2018DeepDIVA: A Highly-Functional Python Framework for Reproducible Experimentscited by 3
- 2020OLALA: Object-Level Active Learning for Efficient Document Layout Annotationcited by 2
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 12; 2024: 12; 2025: 11; 2026: 14.
58 papers.
Sort:
By area:
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
- 2022DocSegTr: An Instance-Level End-to-End Document Image Segmentation Transformercited by 19
- 2022PP-StructureV2: A Stronger Document Analysis Systemcited by 18
- 2022Noise-Robust De-Duplication at Scalecited by 17
- 2024OpenChemIE: An Information Extraction Toolkit For Chemistry Literaturecited by 16
- 2023SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentationcited by 13
- 2024RoDLA: Benchmarking the Robustness of Document Layout Analysis Modelscited by 12
- 2025Multimodal LLMs for OCR, OCR Post-Correction, and Named Entity Recognition in Historical Documentscited by 12
- 2023Efficient OCR for Building a Diverse Digital Historycited by 10
- 2024Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology using Large Language Models -- A Case in Optimizing Intermodal Freight Transportationcited by 10
38 more
- 2024GUI Action Narrator: Where and When Did That Action Take Place?cited by 9
- 2023SelfDocSeg: A Self-Supervised vision-based Approach towards Document Segmentationcited by 7
- 2024Reference-Based Post-OCR Processing with LLM for Precise Diacritic Text in Historical Document Recognitioncited by 5
- 2024DocXplain: A Novel Model-Agnostic Explainability Method for Document Image Classificationcited by 4
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracycited by 4
- 2022OCR Synthetic Benchmark Dataset for Indic Languagescited by 3
- 2025CommonForms: A Large, Diverse Dataset for Form Field Detectioncited by 3
- 2022TableParser: Automatic Table Parsing with Weak Supervision from Spreadsheetscited by 2
- 2023Quantifying Character Similarity with Vision Transformerscited by 2
- 2023PrIeD-KIE: Towards Privacy Preserved Document Key Information Extractioncited by 2
- 2023On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrievalcited by 2
- 2024UnSupDLA: Towards Unsupervised Document Layout Analysiscited by 2
- 2024DocParseNet: Advanced Semantic Segmentation and OCR Embeddings for Efficient Scanned Document Annotationcited by 2
- 2024Latent Diffusion for Guided Document Table Generationcited by 2
- 2025DocSpiral: A Platform for Integrated Assistive Document Annotation through Human-in-the-Spiralcited by 2
- 2025MolMole: Molecule Mining from Scientific Literaturecited by 2
- 2025DIGMAPPER: A Modular System for Automated Geologic Map Digitizationcited by 2
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wildcited by 2
- 2021Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editorcited by 1
- 2022Digitizing Historical Balance Sheet Data: A Practitioner's Guidecited by 1
- 2023Machine Learning for Economics Research: When What and How?cited by 1
- 2023Linking Representations with Multimodal Contrastive Learningcited by 1
- 2023Harnessing the Power of Multi-Lingual Datasets for Pre-training: Towards Enhancing Text Spotting Performancecited by 1
- 2024PdfTable: A Unified Toolkit for Deep Learning-Based Table Extractioncited by 1
- 2024AiBAT: Artificial Intelligence/Instructions for Build, Assembly, and Testcited by 1
- 2024NewsHomepages: Homepage Layouts Capture Information Prioritization Decisionscited by 1
- 2025Harnessing PDF Data for Improving Japanese Large Multimodal Modelscited by 1
- 2025DP-DocLDM: Differentially Private Document Image Generation using Latent Diffusion Modelscited by 1
- 2025Detecting Legend Items on Historical Maps Using GPT-4o with In-Context Learningcited by 1
- 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysiscited by 1
- 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editingcited by 1
- 2022DIVA-DAF: A Deep Learning Framework for Historical Document Image Analysiscited by 0
- 2023Document Understanding for Healthcare Referralscited by 0
- 2025Predicting the Past: Estimating Historical Appraisals with OCR and Machine Learningcited by 0
- 2025DocVCE: Diffusion-based Visual Counterfactual Explanations for Document Image Classificationcited by 0
- 2026TCM-DiffRAG: Personalized Syndrome Differentiation Reasoning Method for Traditional Chinese Medicine based on Knowledge Graph and Chain of Thoughtcited by 0
- 2026Automating Document Intelligence in Statutory City Planningcited by 0
- 2026Adaptive Query Routing: A Tier-Based Framework for Hybrid Retrieval Across Financial, Legal, and Medical Documentscited by 0
50 most cited of 58 All 58 (JSON)
- 2026Source-preserving alignment for robust evidence localization in scientific PDFS28 Sep 2026
- 2026EMBLEM: Enhancing Multi-script Table Detection through Masking8 Sep 2026
- 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Models29 Aug 2026
- 2026LAVA: Logic-Aware Validation and Augmentation Framework for Large-Scale Financial Document Auditing17 Aug 2026
- 2026VDGR-RAG: Vectors, Directories, Graphs, and Reflection Are All You Need for Unified Reasoning over Hierarchical Enterprise Knowledge8 Aug 2026
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild22 Jun 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languages12 May 2026
- 2026Adaptive Query Routing: A Tier-Based Framework for Hybrid Retrieval Across Financial, Legal, and Medical Documents14 Apr 2026
- 2026Hybrid Multi-Phase Page Matching and Multi-Layer Diff Detection for Japanese Building Permit Document Review27 Mar 2026
- 2026TCM-DiffRAG: Personalized Syndrome Differentiation Reasoning Method for Traditional Chinese Medicine based on Knowledge Graph and Chain of Thought26 Feb 2026
- 2026Automating Document Intelligence in Statutory City Planning20 Feb 2026
38 more
- 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editing9 Feb 2026
- 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysis12 Jan 2026
- 2025Detecting Legend Items on Historical Maps Using GPT-4o with In-Context Learning9 Oct 2025
- 2025CommonForms: A Large, Diverse Dataset for Form Field Detection20 Sep 2025
- 2025DocVCE: Diffusion-based Visual Counterfactual Explanations for Document Image Classification6 Aug 2025
- 2025DP-DocLDM: Differentially Private Document Image Generation using Latent Diffusion Models6 Aug 2025
- 2025DIGMAPPER: A Modular System for Automated Geologic Map Digitization19 Jun 2025
- 2025Predicting the Past: Estimating Historical Appraisals with OCR and Machine Learning30 May 2025
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracy26 May 2025
- 2025DocSpiral: A Platform for Integrated Assistive Document Annotation through Human-in-the-Spiral6 May 2025
- 2025MolMole: Molecule Mining from Scientific Literature30 Apr 2025
- 2025Multimodal LLMs for OCR, OCR Post-Correction, and Named Entity Recognition in Historical Documents1 Apr 2025
- 2025Harnessing PDF Data for Improving Japanese Large Multimodal Models20 Feb 2025
- 2024NewsHomepages: Homepage Layouts Capture Information Prioritization Decisions21 Nov 2024
- 2024Reference-Based Post-OCR Processing with LLM for Precise Diacritic Text in Historical Document Recognition17 Oct 2024
- 2024AiBAT: Artificial Intelligence/Instructions for Build, Assembly, and Test3 Oct 2024
- 2024PdfTable: A Unified Toolkit for Deep Learning-Based Table Extraction8 Sep 2024
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
- 2024DocXplain: A Novel Model-Agnostic Explainability Method for Document Image Classification4 Jul 2024
- 2024DocParseNet: Advanced Semantic Segmentation and OCR Embeddings for Efficient Scanned Document Annotation25 Jun 2024
- 2024GUI Action Narrator: Where and When Did That Action Take Place?19 Jun 2024
- 2024UnSupDLA: Towards Unsupervised Document Layout Analysis10 Jun 2024
- 2024Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology using Large Language Models -- A Case in Optimizing Intermodal Freight Transportation29 May 2024
- 2024OpenChemIE: An Information Extraction Toolkit For Chemistry Literature1 Apr 2024
- 2024RoDLA: Benchmarking the Robustness of Document Layout Analysis Models21 Mar 2024
- 2023On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval1 Nov 2023
- 2023PrIeD-KIE: Towards Privacy Preserved Document Key Information Extraction5 Oct 2023
- 2023Harnessing the Power of Multi-Lingual Datasets for Pre-training: Towards Enhancing Text Spotting Performance2 Oct 2023
- 2023Document Understanding for Healthcare Referrals22 Sep 2023
- 2023Quantifying Character Similarity with Vision Transformers24 May 2023
- 2023SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentation8 May 2023
- 2023SelfDocSeg: A Self-Supervised vision-based Approach towards Document Segmentation1 May 2023
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documents13 Apr 2023
- 2023Linking Representations with Multimodal Contrastive Learning7 Apr 2023
- 2023Efficient OCR for Building a Diverse Digital History5 Apr 2023
- 2023Machine Learning for Economics Research: When What and How?31 Mar 2023
- 2023The Semantic Scholar Open Data Platform24 Jan 2023
- 2022PP-StructureV2: A Stronger Document Analysis System11 Oct 2022
50 newest of 58 All 58 (JSON)
- 2025Multimodal LLMs for OCR, OCR Post-Correction, and Named Entity Recognition in Historical Documentscited by 12
- 2024GUI Action Narrator: Where and When Did That Action Take Place?cited by 9
- 2025Harnessing PDF Data for Improving Japanese Large Multimodal Modelscited by 1
- 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Modelscited by 0
- 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Models29 Aug 2026
- 2025Multimodal LLMs for OCR, OCR Post-Correction, and Named Entity Recognition in Historical Documents1 Apr 2025
- 2025Harnessing PDF Data for Improving Japanese Large Multimodal Models20 Feb 2025
- 2024GUI Action Narrator: Where and When Did That Action Take Place?19 Jun 2024
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
- 2022DocSegTr: An Instance-Level End-to-End Document Image Segmentation Transformercited by 19
- 2022PP-StructureV2: A Stronger Document Analysis Systemcited by 18
- 2022Noise-Robust De-Duplication at Scalecited by 17
- 2024OpenChemIE: An Information Extraction Toolkit For Chemistry Literaturecited by 16
- 2023SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentationcited by 13
- 2024RoDLA: Benchmarking the Robustness of Document Layout Analysis Modelscited by 12
- 2023Efficient OCR for Building a Diverse Digital Historycited by 10
- 2024Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology using Large Language Models -- A Case in Optimizing Intermodal Freight Transportationcited by 10
- 2023SelfDocSeg: A Self-Supervised vision-based Approach towards Document Segmentationcited by 7
12 most cited of 49 All 49 (JSON)
- 2026Source-preserving alignment for robust evidence localization in scientific PDFS28 Sep 2026
- 2026EMBLEM: Enhancing Multi-script Table Detection through Masking8 Sep 2026
- 2026LAVA: Logic-Aware Validation and Augmentation Framework for Large-Scale Financial Document Auditing17 Aug 2026
- 2026VDGR-RAG: Vectors, Directories, Graphs, and Reflection Are All You Need for Unified Reasoning over Hierarchical Enterprise Knowledge8 Aug 2026
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild22 Jun 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languages12 May 2026
- 2026Hybrid Multi-Phase Page Matching and Multi-Layer Diff Detection for Japanese Building Permit Document Review27 Mar 2026
- 2026Automating Document Intelligence in Statutory City Planning20 Feb 2026
- 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysis12 Jan 2026
- 2025Detecting Legend Items on Historical Maps Using GPT-4o with In-Context Learning9 Oct 2025
- 2025CommonForms: A Large, Diverse Dataset for Form Field Detection20 Sep 2025
12 newest of 49 All 49 (JSON)