DocAtlas: Multilingual Document Understanding Across 80+ Languages
Not on the map. Why?
Abstract (arXiv)
Multilingual document understanding remains limited for low-resource languages due to scarce training data and model-based annotation pipelines that perpetuate existing biases. We introduce DocAtlas, a framework that constructs high-fidelity OCR datasets and benchmarks covering 82 languages and 9 evaluation tasks. Our dual pipelines, differential rendering of native DOCX documents and synthetic LaTeX-based generation for right-to-left scripts produce precise structural annotations in a unified DocTag format encoding layout, text, and component types, without learned models for core annotation. Evaluating 16 state-of-the-art models reveals persistent gaps in low-resource scripts. We show that Direct Preference Optimization (DPO) using rendering-derived ground truth as positive signal achieves stable multilingual adaptation, improving both in-domain (+1.9%) and out-of-domain (+1.8%) accuracy without measurable base-language degradation, where supervised fine-tuning degrades out-of-domain performance by up to 21%. Our best variant, DocAtlas-DeepSeek, improves +1.7% over the strongest baseline. Code is available at https://github.com/ahmedheakl/DocAtlas .
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
26 of 38 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
- 2016FastText.zip: Compressing text classification modelscited by 331
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
14 more
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2021LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysiscited by 58
- 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 58
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2022PP-StructureV2: A Stronger Document Analysis Systemcited by 18
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
- 2025KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understandingcited by 14
- 2025How to Teach Large Multimodal Models New Skillscited by 10
- 2023WordScape: a Pipeline to extract multilingual, visually rich Documents with Layout Annotations from Web Crawl Datacited by 7
- 2025Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchucited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluation
- 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understanding
- 2025Docopilot: Improving Multimodal Models for Document-Level Understanding
- 2025MosaicDoc: A Large-Scale Bilingual Benchmark for Visually Rich Document Understanding
- 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing
- 2026DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth
- 2025DocPTBench: Benchmarking End-to-End Photographed Document Parsing and Translation
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models