mlsanityData to 7 Oct 2026

Document AI: Benchmarks, Models and Applications

arXiv 2111.08609 ↗First posted 16 Nov 2021cs.CLcited by 61

Not on the map. Why?

Abstract (arXiv)

Document AI, or Document Intelligence, is a relatively new research topic that refers to the techniques for automatically reading, understanding, and analyzing business documents. It is an important research direction for natural language processing and computer vision. In recent years, the popularity of deep learning technology has greatly advanced the development of Document AI, such as document layout analysis, visual information extraction, document visual question answering, document image classification, etc. This paper briefly reviews some of the representative models, tasks, and benchmark datasets. Furthermore, we also introduce early-stage heuristic rule-based document analysis, statistical machine learning algorithms, and deep learning approaches especially pre-training methods. Finally, we look into future directions for Document AI research.

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Builds on 62 of its 117 references that are in the map. First posted on arXiv 16 Nov 2021.

Builds on

62 of 117 references.

References · 62

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  9. 2018YOLOv3: An Incremental Improvementcited by 2,652
  10. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  11. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  12. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
38 more
  1. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  2. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
  3. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
  4. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  5. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  6. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 254
  7. 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
  8. 2019Image-based table recognition: data, model, and evaluationcited by 233
  9. 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
  10. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
  11. 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
  12. 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
  13. 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
  14. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  15. 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
  16. 2018Chargrid: Towards Understanding 2D Documentscited by 100
  17. 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
  18. 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 98
  19. 2017Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networkcited by 92
  20. 2021StructuralLM: Structural Pre-training for Form Understandingcited by 91
  21. 2019Graph Convolution for Multimodal Information Extraction from Visually Rich Documentscited by 88
  22. 2021Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layoutscited by 82
  23. 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
  24. 2020PICK: Processing Key Information Extraction from Documents using Improved Graph Learning-Convolutional Networkscited by 70
  25. 2020Spatial Dependency Parsing for Semi-Structured Document Information Extractioncited by 65
  26. 2021Towards Robust Visual Information Extraction in Real World: New Dataset and Novel Solutioncited by 64
  27. 2019BERTgrid: Contextualized Embedding for 2D Document Representation and Understandingcited by 63
  28. 2020TRIE: End-to-End Text Reading and Information Extraction for Document Understandingcited by 61
  29. 2020LAMBERT: Layout-Aware (Language) Modeling for information extractioncited by 53
  30. 2021MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understandingcited by 44
  31. 2018dhSegment: A generic deep-learning approach for document segmentationcited by 32
  32. 2020DocStruct: A Multimodal Method to Extract Hierarchy Structure in Document for General Form Understandingcited by 31
  33. 2019EATEN: Entity-aware Attention for Single Shot Visual Text Extractioncited by 29
  34. 2021ViBERTgrid: A Jointly Trained Multi-Modal 2D Document Representation for Key Information Extraction from Documentscited by 29
  35. 2018A Two-Stage Method for Text Line Detection in Historical Documentscited by 26
  36. 2017Cutting the Error by Half: Investigation of Very Deep CNN and Advanced Training Strategies for Document Image Classificationcited by 22
  37. 2018Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networkscited by 20
  38. 2020Robust Layout-aware IE for Visually Rich Documents with Pre-trained Language Modelscited by 20

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 8; 2023: 17; 2024: 17; 2025: 10; 2026: 9.

61 papers.

Sort:

By area:

  1. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  2. 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
  3. 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
  4. 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
  5. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
  6. 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
  7. 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 66
  8. 2023Vision Grid Transformer for Document Layout Analysiscited by 45
  9. 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
  10. 2023GeoLayoutLM: Geometric Pre-training for Visual Information Extractioncited by 40
  11. 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
  12. 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimmingcited by 35
38 more
  1. 2024A Survey of Table Reasoning with Large Language Modelscited by 29
  2. 2023HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structurescited by 22
  3. 2024Deep Learning based Visually Rich Document Content Understanding: A Surveycited by 21
  4. 2025MM-R5: MultiModal Reasoning-Enhanced ReRanker via Reinforcement Learning for Document Retrievalcited by 21
  5. 2022Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understandingcited by 20
  6. 2023DocTr: Document Transformer for Structured Information Extraction in Documentscited by 18
  7. 2023Attention Where It Matters: Rethinking Visual Document Understanding with Selective Region Concentrationcited by 18
  8. 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
  9. 2023GridFormer: Towards Accurate Table Structure Recognition via Grid Predictioncited by 13
  10. 2022XDoc: Unified Pre-training for Cross-Format Document Understandingcited by 12
  11. 2022ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understandingcited by 9
  12. 2025A Simple yet Effective Layout Token in Large Language Models for Document Understandingcited by 9
  13. 2023A Graphical Approach to Document Layout Analysiscited by 8
  14. 2023DocXChain: A Powerful Open-Source Toolchain for Document Parsing and Beyondcited by 8
  15. 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrievalcited by 8
  16. 2023Comprehensive Overview of Named Entity Recognition: Models, Domain-Specific Applications and Challengescited by 6
  17. 2024A Hybrid Approach for Document Layout Analysis in Document imagescited by 6
  18. 2024Deep Learning based Key Information Extraction from Business Documents: Systematic Literature Reviewcited by 6
  19. 2025Problem Solved? Information Extraction Design Space for Layout-Rich Documents using LLMscited by 6
  20. 2022Do BERTs Learn to Use Browser User Interface? Exploring Multi-Step Tasks with Unified Vision-and-Language BERTscited by 5
  21. 2023Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents via Semantic-Oriented Hierarchical Graphscited by 5
  22. 2024XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parsercited by 5
  23. 2024ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Datacited by 5
  24. 2022Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answeringcited by 4
  25. 2024Is Cognition Consistent with Perception? Assessing and Mitigating Multimodal Knowledge Conflicts in Document Understandingcited by 4
  26. 2024SynFinTabs: A Dataset of Synthetic Financial Tables for Information and Table Extractioncited by 4
  27. 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
  28. 2023A Multi-Modal Multilingual Benchmark for Document Image Classificationcited by 3
  29. 2024Unveiling the Deficiencies of Pre-trained Text-and-Layout Models in Real-world Visually-rich Document Information Extractioncited by 3
  30. 2024DocMamba: Efficient Document Pre-training with State Space Modelcited by 3
  31. 2024See then Tell: Enhancing Key Information Extraction with Vision Groundingcited by 3
  32. 2025LED Benchmark: Diagnosing Structural Layout Errors for Document Layout Analysiscited by 3
  33. 2026Revise: A Framework for Revising OCRed text in Practical Information Systems with Data Contamination Strategycited by 3
  34. 2024Can AI Models Appreciate Document Aesthetics? An Exploration of Legibility and Layout Quality in Relation to Prediction Confidencecited by 2
  35. 2025FlexDoc: Parameterized Sampling for Diverse Multilingual Synthetic Documents for Training Document Understanding Modelscited by 2
  36. 2023Structure Diagram Recognition in Financial Announcementscited by 1
  37. 2023GlobalDoc: A Cross-Modal Vision-Language Framework for Real-World Document Image Retrieval and Classificationcited by 1
  38. 2023Polar-Doc: One-Stage Document Dewarping with Multi-Scope Constraints under Polar Representationcited by 1

50 most cited of 61 All 61 (JSON)