MonkeyOCR v1.5 Technical Report: Unlocking Robust Document Parsing for Complex Patterns
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
Document parsing is a core task in document intelligence, supporting applications such as information extraction, retrieval-augmented generation, and automated document analysis. However, real-world documents often feature complex layouts with multi-level tables, embedded images or formulas, and cross-page structures, which remain challenging for existing OCR systems. We introduce MonkeyOCR v1.5, a unified vision-language framework that enhances both layout understanding and content recognition through a two-stage pipeline. The first stage employs a large multimodal model to jointly predict layout and reading order, leveraging visual information to ensure sequential consistency. The second stage performs localized recognition of text, formulas, and tables within detected regions, maintaining high visual fidelity while reducing error propagation. To address complex table structures, we propose a visual consistency-based reinforcement learning scheme that evaluates recognition quality via render-and-compare alignment, improving structural accuracy without manual annotations. Additionally, two specialized modules, Image-Decoupled Table Parsing and Type-Guided Table Merging, are introduced to enable reliable parsing of tables containing embedded images and reconstruction of tables crossing pages or columns. Comprehensive experiments on OmniDocBench v1.5 demonstrate that MonkeyOCR v1.5 achieves state-of-the-art performance, outperforming PPOCR-VL and MinerU 2.5 while showing exceptional robustness in visually complex document scenarios. A trial link can be found at https://github.com/Yuliang-Liu/MonkeyOCR .
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 26 of its 34 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
26 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2019Image-based table recognition: data, model, and evaluationcited by 237
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 174
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
- 2025PaddleOCR 3.0 Technical Reportcited by 143
13 more
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 125
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
- 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 114
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 80
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
- 2020Tabular Transformers for Modeling Multivariate Time Seriescited by 77
- 2025olmOCR 2: Unit Test Rewards for Document OCRcited by 47
- 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 42
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Modelscited by 36
- 2025POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversioncited by 34
- 2021PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Table Image Recognition to Latexcited by 10
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 57
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 22
- 2026FireRed-OCR Technical Reportcited by 13
- 2026AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generationcited by 5
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 5
- 2026Beyond the Grid: Layout-Informed Multi-Vector Retrieval with Parsed Visual Document Representationscited by 4
- 2026Visual-ERM: Reward Modeling for Visual Equivalencecited by 3
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 2
- 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
- 2026Parser-Oriented Structural Refinement for a Stable Layout Interface in Document Parsingcited by 0
- 2026DocPO: Advancing Document Policy Optimization via Tailored Step-Aware Rewardscited by 0
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documentscited by 0
1 more
- 2026DocClaw: A Unified Agentic System for Intelligent Document Processing19 Aug 2026
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents13 Aug 2026
- 2026DocPO: Advancing Document Policy Optimization via Tailored Step-Aware Rewards1 Aug 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing24 May 2026
- 2026Parser-Oriented Structural Refinement for a Stable Layout Interface in Document Parsing3 Apr 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios30 Mar 2026
- 2026Visual-ERM: Reward Modeling for Visual Equivalence13 Mar 2026
- 2026FireRed-OCR Technical Report2 Mar 2026
- 2026Beyond the Grid: Layout-Informed Multi-Vector Retrieval with Parsed Visual Document Representations2 Mar 2026
- 2026AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generation27 Feb 2026
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting5 Feb 2026
- 2026Visual-ERM: Reward Modeling for Visual Equivalencecited by 3
- 2026Visual-ERM: Reward Modeling for Visual Equivalence13 Mar 2026
- 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 57
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 22
- 2026FireRed-OCR Technical Reportcited by 13
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 5
- 2026Beyond the Grid: Layout-Informed Multi-Vector Retrieval with Parsed Visual Document Representationscited by 4
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 2
- 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
- 2026Parser-Oriented Structural Refinement for a Stable Layout Interface in Document Parsingcited by 0
- 2026DocPO: Advancing Document Policy Optimization via Tailored Step-Aware Rewardscited by 0
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documentscited by 0
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents13 Aug 2026
- 2026DocPO: Advancing Document Policy Optimization via Tailored Step-Aware Rewards1 Aug 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing24 May 2026
- 2026Parser-Oriented Structural Refinement for a Stable Layout Interface in Document Parsing3 Apr 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios30 Mar 2026
- 2026FireRed-OCR Technical Report2 Mar 2026
- 2026Beyond the Grid: Layout-Informed Multi-Vector Retrieval with Parsed Visual Document Representations2 Mar 2026
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting5 Feb 2026
- 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsing29 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Model
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
- 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligence
- 2026From Diagnosis to Correction: Benchmarking and Improving Real-World Table Parsing
- 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysis
- 2026DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth