Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting
Not on the map. Why?
Abstract (arXiv)
Document parsing has garnered widespread attention as vision-language models (VLMs) advance OCR capabilities. However, the field remains fragmented across dozens of specialized models with varying strengths, forcing users to navigate complex model selection and limiting system scalability. Moreover, existing two-stage approaches depend on axis-aligned bounding boxes for layout detection, failing to handle distorted or photographed documents effectively. To this end, we present Dolphin-v2, a two-stage document image parsing model that substantially improves upon the original Dolphin. In the first stage, Dolphin-v2 jointly performs document type classification (digital-born versus photographed) alongside layout analysis. For digital-born documents, it conducts finer-grained element detection with reading order prediction. In the second stage, we employ a hybrid parsing strategy: photographed documents are parsed holistically as complete pages to handle geometric distortions, while digital-born documents undergo element-wise parallel parsing guided by the detected layout anchors, enabling efficient content extraction. Compared with the original Dolphin, Dolphin-v2 introduces several crucial enhancements: (1) robust parsing of photographed documents via holistic page-level understanding, (2) finer-grained element detection (21 categories) with semantic attribute extraction such as author information and document metadata, and (3) code block recognition with indentation preservation, which existing systems typically lack. Comprehensive evaluations are conducted on DocPTBench, OmniDocBench, and our self-constructed RealDoc-160 benchmark. The results demonstrate substantial improvements: +14.78 points overall on the challenging OmniDocBench and 91% error reduction on photographed documents, while maintaining efficient inference through parallel processing.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 66 of its 78 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
66 of 78 references.
References · 66
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
38 more
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2021OCR-free Document Understanding Transformercited by 400
- 2025Kimi-VL Technical Reportcited by 381
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
- 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 167
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2025PaddleOCR 3.0 Technical Reportcited by 136
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
- 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 84
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
- 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
- 2025POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversioncited by 34
- 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
- 2024TextHawk: Exploring Efficient Fine-Grained Perception of Multimodal Large Language Modelscited by 27
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 20.
20 papers.
Sort:
By area:
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 13
- 2026ABot-OCR Technical Reportcited by 3
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wildcited by 2
- 2026P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scalingcited by 2
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 1
- 2026Transmittance-Guided Structure-Texture Decomposition for Nighttime Image Dehazingcited by 0
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Predictioncited by 0
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagerycited by 0
- 2026Feature Perturbation Pool-based Fusion Network for Unified Multi-Class Industrial Defect Detectioncited by 0
- 2026Lightweight Real-Time Rendering Parameter Optimization via XGBoost-Driven Lookup Tablescited by 0
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitationcited by 0
- 2026A Systematic Investigation of RL-Jailbreaking in LLMscited by 0
8 more
- 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognitioncited by 0
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spottingcited by 0
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
- 2026HPD-Parsing: Hierarchical Parallel Document Parsingcited by 0
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detectioncited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
- 2026Xiaomi-OCR-0 Technical Reportcited by 0
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligencecited by 0
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Xiaomi-OCR-0 Technical Report28 Sep 2026
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing17 Sep 2026
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026HPD-Parsing: Hierarchical Parallel Document Parsing21 Jul 2026
- 2026P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scaling23 Jun 2026
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild22 Jun 2026
- 2026ABot-OCR Technical Report27 May 2026
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing24 May 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting18 May 2026
- 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognition16 May 2026
8 more
- 2026A Systematic Investigation of RL-Jailbreaking in LLMs7 May 2026
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitation28 Apr 2026
- 2026Lightweight Real-Time Rendering Parameter Optimization via XGBoost-Driven Lookup Tables28 Apr 2026
- 2026Feature Perturbation Pool-based Fusion Network for Unified Multi-Class Industrial Defect Detection21 Apr 2026
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagery21 Apr 2026
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents13 Apr 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
- 2026Transmittance-Guided Structure-Texture Decomposition for Nighttime Image Dehazing31 Mar 2026
- 2026ABot-OCR Technical Reportcited by 3
- 2026P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scalingcited by 2
- 2026Xiaomi-OCR-0 Technical Reportcited by 0
- 2026Xiaomi-OCR-0 Technical Report28 Sep 2026
- 2026P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scaling23 Jun 2026
- 2026ABot-OCR Technical Report27 May 2026
- 2026HPD-Parsing: Hierarchical Parallel Document Parsingcited by 0
- 2026HPD-Parsing: Hierarchical Parallel Document Parsing21 Jul 2026
- 2026A Systematic Investigation of RL-Jailbreaking in LLMscited by 0
- 2026A Systematic Investigation of RL-Jailbreaking in LLMs7 May 2026
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wildcited by 2
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 1
- 2026Transmittance-Guided Structure-Texture Decomposition for Nighttime Image Dehazingcited by 0
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Predictioncited by 0
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagerycited by 0
- 2026Feature Perturbation Pool-based Fusion Network for Unified Multi-Class Industrial Defect Detectioncited by 0
- 2026Lightweight Real-Time Rendering Parameter Optimization via XGBoost-Driven Lookup Tablescited by 0
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitationcited by 0
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spottingcited by 0
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detectioncited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing17 Sep 2026
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild22 Jun 2026
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing24 May 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting18 May 2026
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitation28 Apr 2026
- 2026Lightweight Real-Time Rendering Parameter Optimization via XGBoost-Driven Lookup Tables28 Apr 2026
- 2026Feature Perturbation Pool-based Fusion Network for Unified Multi-Class Industrial Defect Detection21 Apr 2026
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagery21 Apr 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training
- 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligence
- 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence
- 2026Lightweight and Production-Ready PDF Visual Element Parsing
- 2026DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth