mlsanityData to 7 Oct 2026

A Multi-Modal Multilingual Benchmark for Document Image Classification

arXiv 2310.16356 ↗First posted 25 Oct 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Document image classification is different from plain-text document classification and consists of classifying a document by understanding the content and structure of documents such as forms, emails, and other such documents. We show that the only existing dataset for this task (Lewis et al., 2006) has several limitations and we introduce two newly curated multilingual datasets WIKI-DOC and MULTIEURLEX-DOC that overcome these limitations. We further undertake a comprehensive study of popular visually-rich document understanding or Document AI models in previously untested setting in document image classification such as 1) multi-label classification, and 2) zero-shot cross-lingual transfer setup. Experimental results show limitations of multilingual Document AI models on cross-lingual transfer across typologically distant languages. Our datasets and findings open the door for future research into improving Document AI models.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 25 Oct 2023.

Builds on

27 of 44 references.

References · 27

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  5. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  6. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  7. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
  8. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
  9. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  10. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  11. 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
  12. 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
15 more
  1. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  2. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
  3. 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
  4. 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
  5. 2022LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understandingcited by 107
  6. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  7. 2021StructuralLM: Structural Pre-training for Form Understandingcited by 91
  8. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 89
  9. 2021LaTr: Layout-Aware Transformer for Scene-Text VQAcited by 72
  10. 2021Towards Robust Visual Information Extraction in Real World: New Dataset and Novel Solutioncited by 64
  11. 2021Document AI: Benchmarks, Models and Applicationscited by 61
  12. 2022MixGen: A New Multi-Modal Data Augmentationcited by 61
  13. 2023DocFormerv2: Local Features for Document Understandingcited by 46
  14. 2023An Exploration of Encoder-Decoder Approaches to Multi-Label Classification for Legal and Biomedical Textcited by 23
  15. 2023Are Layout-Infused Language Models Robust to Layout Distribution Shifts? A Case Study with Scientific Documentscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.

  1. 2024VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understandingcited by 8
  2. 2024DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Modelscited by 3
  3. 2026Document Classification Pattern Recognition via Information Fusion: A Systematic Review of Multimodal and Multiview Representation Approachescited by 1