dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Model
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
Document Layout Parsing serves as a critical gateway for Artificial Intelligence (AI) to access and interpret the world's vast stores of structured knowledge. This process,which encompasses layout detection, text recognition, and relational understanding, is particularly crucial for empowering next-generation Vision-Language Models. Current methods, however, rely on fragmented, multi-stage pipelines that suffer from error propagation and fail to leverage the synergies of joint training. In this paper, we introduce dots_ocr, a single Vision-Language Model that, for the first time, demonstrates the advantages of jointly learning three core tasks within a unified, end-to-end framework. This is made possible by a highly scalable data engine that synthesizes a vast multilingual corpus, empowering the model to deliver robust performance across a wide array of tasks, encompassing diverse languages, layouts, and domains. The efficacy of our unified paradigm is validated by state-of-the-art performance on the comprehensive OmniDocBench. Furthermore, to catalyze research in global document intelligence, we introduce XDocParse, a challenging new benchmark spanning 126 languages. On this benchmark, dots_ocr achieves state-of-the-art performance, delivering an approximately 10% relative improvement and demonstrating strong multilingual capability.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 53 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
35 of 53 references.
Closest ancestors · 2
Same direction, newest first
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models17 Jun
Other references · 33
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2019Towards VQA Models That Can Readcited by 1,696
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
- 2025Seed1.5-VL Technical Reportcited by 367
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
21 more
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2025PaddleOCR 3.0 Technical Reportcited by 136
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2020TableNet: Deep Learning model for end-to-end Table detection and Tabular data extraction from Scanned Document Imagescited by 69
- 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 58
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2023Vision Grid Transformer for Document Layout Analysiscited by 45
- 2023M6Doc: A Large-Scale Multi-Format, Multi-Type, Multi-Layout, Multi-Language, Multi-Annotation Category Dataset for Modern Document Layout Analysiscited by 44
- 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
- 2023An In-depth Look at Gemini's Language Abilitiescited by 28
- 2023Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Predictioncited by 23
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
Built on by
Citing papers per year: 2025: 4; 2026: 40.
44 papers.
Sort:
By area:
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scalecited by 26
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCRcited by 22
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 20
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2026FireRed-OCR Technical Reportcited by 12
- 2026Multimodal OCR: Parse Anything from Documentscited by 12
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 10
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 9
- 2025Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCRcited by 7
- 2026MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decodingcited by 7
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Trainingcited by 7
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 6
32 more
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decodingcited by 5
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrievalcited by 5
- 2026OvisOCR2 Technical Reportcited by 5
- 2025Benchmarking Document Parsers on Mathematical Formula Extraction from PDFscited by 4
- 2026MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translationcited by 4
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 4
- 2026Infinity-Parser2 Technical Reportcited by 4
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AIcited by 4
- 2025Uni-Parser Technical Reportcited by 3
- 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoningcited by 3
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extractioncited by 2
- 2026Mecellem Models: Turkish Models Trained from Scratch and Continually Pre-trained for the Legal Domaincited by 2
- 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
- 2026LingDT-VL-OCR: Structure-Aware Document-Level Parsing with Fine-Grained Visual Referencecited by 1
- 2026SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asiacited by 1
- 2026Beyond String Matching: Semantic Evaluation of PDF Table Extractioncited by 1
- 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignmentcited by 1
- 2026InstructTable: Improving Table Structure Recognition Through Instructionscited by 1
- 2026The Character Error Vector: Decomposable errors for page-level OCR evaluationcited by 1
- 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarkscited by 1
- 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Expertscited by 1
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languagescited by 0
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
- 2026RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documentscited by 0
- 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extractioncited by 0
- 2026CAPRA: Scaling Feedback on Software Architecture Deliverables with a Multi-Agent LLM Systemcited by 0
- 2026HPD-Parsing: Hierarchical Parallel Document Parsingcited by 0
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documentscited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decodingcited by 0
- 2026From PDF to Evidence: Structure-Aware Retrieval for Clinical Practice Guidelinescited by 0
- 2026Xiaomi-OCR-0 Technical Reportcited by 0
- 2026Xiaomi-OCR-0 Technical Report28 Sep 2026
- 2026From PDF to Evidence: Structure-Aware Retrieval for Clinical Practice Guidelines27 Sep 2026
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding22 Sep 2026
- 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts21 Sep 2026
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing17 Sep 2026
- 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarks24 Aug 2026
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents13 Aug 2026
- 2026HPD-Parsing: Hierarchical Parallel Document Parsing21 Jul 2026
- 2026OvisOCR2 Technical Report15 Jul 2026
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI13 Jul 2026
- 2026Infinity-Parser2 Technical Report8 Jul 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
32 more
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoning23 Jun 2026
- 2026CAPRA: Scaling Feedback on Software Architecture Deliverables with a Multi-Agent LLM System17 Jun 2026
- 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction8 Jun 2026
- 2026RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents5 Jun 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languages12 May 2026
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval20 Apr 2026
- 2026The Character Error Vector: Decomposable errors for page-level OCR evaluation7 Apr 2026
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scale6 Apr 2026
- 2026InstructTable: Improving Table Structure Recognition Through Instructions3 Apr 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios30 Mar 2026
- 2026MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation25 Mar 2026
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training25 Mar 2026
- 2026TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment24 Mar 2026
- 2026MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decoding23 Mar 2026
- 2026Beyond String Matching: Semantic Evaluation of PDF Table Extraction19 Mar 2026
- 2026SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asia16 Mar 2026
- 2026Multimodal OCR: Parse Anything from Documents13 Mar 2026
- 2026LingDT-VL-OCR: Structure-Aware Document-Level Parsing with Fine-Grained Visual Reference11 Mar 2026
- 2026FireRed-OCR Technical Report2 Mar 2026
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decoding13 Feb 2026
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting5 Feb 2026
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Search4 Feb 2026
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Models29 Jan 2026
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding28 Jan 2026
- 2026Mecellem Models: Turkish Models Trained from Scratch and Continually Pre-trained for the Legal Domain22 Jan 2026
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR20 Jan 2026
- 2025Uni-Parser Technical Report17 Dec 2025
- 2025Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCR11 Dec 2025
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extraction11 Dec 2025
- 2025Benchmarking Document Parsers on Mathematical Formula Extraction from PDFs10 Dec 2025
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCRcited by 22
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 10
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Trainingcited by 7
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decodingcited by 5
- 2026Infinity-Parser2 Technical Reportcited by 4
- 2026Xiaomi-OCR-0 Technical Reportcited by 0
- 2026Xiaomi-OCR-0 Technical Report28 Sep 2026
- 2026Infinity-Parser2 Technical Report8 Jul 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training25 Mar 2026
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decoding13 Feb 2026
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Models29 Jan 2026
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR20 Jan 2026
- 2026MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decodingcited by 7
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 6
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrievalcited by 5
- 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoningcited by 3
- 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarkscited by 1
- 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarks24 Aug 2026
- 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoning23 Jun 2026
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval20 Apr 2026
- 2026MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decoding23 Mar 2026
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Search4 Feb 2026
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scalecited by 26
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 20
- 2026FireRed-OCR Technical Reportcited by 12
- 2026Multimodal OCR: Parse Anything from Documentscited by 12
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 9
- 2025Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCRcited by 7
- 2026OvisOCR2 Technical Reportcited by 5
- 2025Benchmarking Document Parsers on Mathematical Formula Extraction from PDFscited by 4
- 2026MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translationcited by 4
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 4
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AIcited by 4
- 2025Uni-Parser Technical Reportcited by 3
12 most cited of 28 All 28 (JSON)
- 2026From PDF to Evidence: Structure-Aware Retrieval for Clinical Practice Guidelines27 Sep 2026
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing17 Sep 2026
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents13 Aug 2026
- 2026OvisOCR2 Technical Report15 Jul 2026
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI13 Jul 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction8 Jun 2026
- 2026RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents5 Jun 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026DocAtlas: Multilingual Document Understanding Across 80+ Languages12 May 2026
- 2026The Character Error Vector: Decomposable errors for page-level OCR evaluation7 Apr 2026
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scale6 Apr 2026
12 newest of 28 All 28 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligence
- 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysis
- 2025MonkeyOCR v1.5 Technical Report: Unlocking Robust Document Parsing for Complex Patterns
- 2026LayoutLite: Token-Level Implicit Layout Analysis for Efficient Document OCR
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
- 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understanding
- 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing