mlsanityData to 7 Oct 2026

DocAtlas: Multilingual Document Understanding Across 80+ Languages

arXiv 2605.12623 ↗First posted 12 May 2026cs.CL cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multilingual document understanding remains limited for low-resource languages due to scarce training data and model-based annotation pipelines that perpetuate existing biases. We introduce DocAtlas, a framework that constructs high-fidelity OCR datasets and benchmarks covering 82 languages and 9 evaluation tasks. Our dual pipelines, differential rendering of native DOCX documents and synthetic LaTeX-based generation for right-to-left scripts produce precise structural annotations in a unified DocTag format encoding layout, text, and component types, without learned models for core annotation. Evaluating 16 state-of-the-art models reveals persistent gaps in low-resource scripts. We show that Direct Preference Optimization (DPO) using rendering-derived ground truth as positive signal achieves stable multilingual adaptation, improving both in-domain (+1.9%) and out-of-domain (+1.8%) accuracy without measurable base-language degradation, where supervised fine-tuning degrades out-of-domain performance by up to 21%. Our best variant, DocAtlas-DeepSeek, improves +1.7% over the strongest baseline. Code is available at https://github.com/ahmedheakl/DocAtlas .

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

26 of 38 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  4. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
  5. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  6. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  7. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  8. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  9. 2016FastText.zip: Compressing text classification modelscited by 331
  10. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
  11. 2019Image-based table recognition: data, model, and evaluationcited by 233
  12. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
14 more
  1. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  2. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
  3. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
  4. 2021LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysiscited by 58
  5. 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 58
  6. 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
  7. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
  8. 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
  9. 2022PP-StructureV2: A Stronger Document Analysis Systemcited by 18
  10. 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
  11. 2025KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understandingcited by 14
  12. 2025How to Teach Large Multimodal Models New Skillscited by 10
  13. 2023WordScape: a Pipeline to extract multilingual, visually rich Documents with Layout Annotations from Web Crawl Datacited by 7
  14. 2025Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchucited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MORE: A Multilingual Document Parsing Benchmark and Evaluation
  2. 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understanding
  3. 2025Docopilot: Improving Multimodal Models for Document-Level Understanding
  4. 2025MosaicDoc: A Large-Scale Bilingual Benchmark for Visually Rich Document Understanding
  5. 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing
  6. 2026DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth
  7. 2025DocPTBench: Benchmarking End-to-End Photographed Document Parsing and Translation
  8. 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models