mlsanityData to 7 Oct 2026

dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Model

arXiv 2512.02498 ↗First posted 2 Dec 2025cs.CVcited by 44

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Document Layout Parsing serves as a critical gateway for Artificial Intelligence (AI) to access and interpret the world's vast stores of structured knowledge. This process,which encompasses layout detection, text recognition, and relational understanding, is particularly crucial for empowering next-generation Vision-Language Models. Current methods, however, rely on fragmented, multi-stage pipelines that suffer from error propagation and fail to leverage the synergies of joint training. In this paper, we introduce dots_ocr, a single Vision-Language Model that, for the first time, demonstrates the advantages of jointly learning three core tasks within a unified, end-to-end framework. This is made possible by a highly scalable data engine that synthesizes a vast multilingual corpus, empowering the model to deliver robust performance across a wide array of tasks, encompassing diverse languages, layouts, and domains. The efficacy of our unified paradigm is validated by state-of-the-art performance on the comprehensive OmniDocBench. Furthermore, to catalyze research in global document intelligence, we introduce XDocParse, a challenging new benchmark spanning 126 languages. On this benchmark, dots_ocr achieves state-of-the-art performance, delivering an approximately 10% relative improvement and demonstrating strong multilingual capability.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 53 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

35 of 53 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar
  2. 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models17 Jun

Other references · 33

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2019Towards VQA Models That Can Readcited by 1,696
  6. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  7. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  8. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
  9. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  10. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
  11. 2025Seed1.5-VL Technical Reportcited by 367
  12. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
21 more
  1. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  2. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
  3. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
  4. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  5. 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
  6. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
  7. 2025PaddleOCR 3.0 Technical Reportcited by 136
  8. 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
  9. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
  10. 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
  11. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
  12. 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
  13. 2020TableNet: Deep Learning model for end-to-end Table detection and Tabular data extraction from Scanned Document Imagescited by 69
  14. 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 58
  15. 2021SPTS: Single-Point Text Spottingcited by 45
  16. 2023Vision Grid Transformer for Document Layout Analysiscited by 45
  17. 2023M6Doc: A Large-Scale Multi-Format, Multi-Type, Multi-Layout, Multi-Language, Multi-Annotation Category Dataset for Modern Document Layout Analysiscited by 44
  18. 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
  19. 2023An In-depth Look at Gemini's Language Abilitiescited by 28
  20. 2023Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Predictioncited by 23
  21. 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 40.

44 papers.

Sort:

By area:

  1. 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scalecited by 26
  2. 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCRcited by 22
  3. 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 20
  4. 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
  5. 2026FireRed-OCR Technical Reportcited by 12
  6. 2026Multimodal OCR: Parse Anything from Documentscited by 12
  7. 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 10
  8. 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 9
  9. 2025Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCRcited by 7
  10. 2026MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decodingcited by 7
  11. 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Trainingcited by 7
  12. 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 6
32 more
  1. 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decodingcited by 5
  2. 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrievalcited by 5
  3. 2026OvisOCR2 Technical Reportcited by 5
  4. 2025Benchmarking Document Parsers on Mathematical Formula Extraction from PDFscited by 4
  5. 2026MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translationcited by 4
  6. 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 4
  7. 2026Infinity-Parser2 Technical Reportcited by 4
  8. 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AIcited by 4
  9. 2025Uni-Parser Technical Reportcited by 3
  10. 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoningcited by 3
  11. 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extractioncited by 2
  12. 2026Mecellem Models: Turkish Models Trained from Scratch and Continually Pre-trained for the Legal Domaincited by 2
  13. 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
  14. 2026LingDT-VL-OCR: Structure-Aware Document-Level Parsing with Fine-Grained Visual Referencecited by 1
  15. 2026SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asiacited by 1
  16. 2026Beyond String Matching: Semantic Evaluation of PDF Table Extractioncited by 1
  17. 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignmentcited by 1
  18. 2026InstructTable: Improving Table Structure Recognition Through Instructionscited by 1
  19. 2026The Character Error Vector: Decomposable errors for page-level OCR evaluationcited by 1
  20. 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarkscited by 1
  21. 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Expertscited by 1
  22. 2026DocAtlas: Multilingual Document Understanding Across 80+ Languagescited by 0
  23. 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
  24. 2026RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documentscited by 0
  25. 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extractioncited by 0
  26. 2026CAPRA: Scaling Feedback on Software Architecture Deliverables with a Multi-Agent LLM Systemcited by 0
  27. 2026HPD-Parsing: Hierarchical Parallel Document Parsingcited by 0
  28. 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documentscited by 0
  29. 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
  30. 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decodingcited by 0
  31. 2026From PDF to Evidence: Structure-Aware Retrieval for Clinical Practice Guidelinescited by 0
  32. 2026Xiaomi-OCR-0 Technical Reportcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligence
  2. 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysis
  3. 2025MonkeyOCR v1.5 Technical Report: Unlocking Robust Document Parsing for Complex Patterns
  4. 2026LayoutLite: Token-Level Implicit Layout Analysis for Efficient Document OCR
  5. 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
  6. 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
  7. 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understanding
  8. 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing