mlsanityData to 7 Oct 2026

Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting

arXiv 2602.05384 ↗First posted 5 Feb 2026cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

Document parsing has garnered widespread attention as vision-language models (VLMs) advance OCR capabilities. However, the field remains fragmented across dozens of specialized models with varying strengths, forcing users to navigate complex model selection and limiting system scalability. Moreover, existing two-stage approaches depend on axis-aligned bounding boxes for layout detection, failing to handle distorted or photographed documents effectively. To this end, we present Dolphin-v2, a two-stage document image parsing model that substantially improves upon the original Dolphin. In the first stage, Dolphin-v2 jointly performs document type classification (digital-born versus photographed) alongside layout analysis. For digital-born documents, it conducts finer-grained element detection with reading order prediction. In the second stage, we employ a hybrid parsing strategy: photographed documents are parsed holistically as complete pages to handle geometric distortions, while digital-born documents undergo element-wise parallel parsing guided by the detected layout anchors, enabling efficient content extraction. Compared with the original Dolphin, Dolphin-v2 introduces several crucial enhancements: (1) robust parsing of photographed documents via holistic page-level understanding, (2) finer-grained element detection (21 categories) with semantic attribute extraction such as author information and document metadata, and (3) code block recognition with indentation preservation, which existing systems typically lack. Comprehensive evaluations are conducted on DocPTBench, OmniDocBench, and our self-constructed RealDoc-160 benchmark. The results demonstrate substantial improvements: +14.78 points overall on the challenging OmniDocBench and 91% error reduction on photographed documents, while maintaining efficient inference through parallel processing.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 66 of its 78 references that are in the map. First posted on arXiv 5 Feb 2026.

Builds on

66 of 78 references.

References · 66

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  9. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  10. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  11. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  12. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
38 more
  1. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  2. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  3. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  4. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  5. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
  6. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
  7. 2021OCR-free Document Understanding Transformercited by 400
  8. 2025Kimi-VL Technical Reportcited by 381
  9. 2025Seed1.5-VL Technical Reportcited by 367
  10. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
  11. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  12. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
  13. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
  14. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  15. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  16. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  17. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
  18. 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 167
  19. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
  20. 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
  21. 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
  22. 2025PaddleOCR 3.0 Technical Reportcited by 136
  23. 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
  24. 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
  25. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
  26. 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
  27. 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
  28. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 84
  29. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
  30. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
  31. 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
  32. 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
  33. 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
  34. 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversioncited by 51
  35. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
  36. 2025POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversioncited by 34
  37. 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
  38. 2024TextHawk: Exploring Efficient Fine-Grained Perception of Multimodal Large Language Modelscited by 27

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 20.

20 papers.

Sort:

By area:

  1. 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agentscited by 13
  2. 2026ABot-OCR Technical Reportcited by 3
  3. 2026RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wildcited by 2
  4. 2026P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scalingcited by 2
  5. 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 1
  6. 2026Transmittance-Guided Structure-Texture Decomposition for Nighttime Image Dehazingcited by 0
  7. 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Predictioncited by 0
  8. 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagerycited by 0
  9. 2026Feature Perturbation Pool-based Fusion Network for Unified Multi-Class Industrial Defect Detectioncited by 0
  10. 2026Lightweight Real-Time Rendering Parameter Optimization via XGBoost-Driven Lookup Tablescited by 0
  11. 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitationcited by 0
  12. 2026A Systematic Investigation of RL-Jailbreaking in LLMscited by 0
8 more
  1. 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognitioncited by 0
  2. 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spottingcited by 0
  3. 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
  4. 2026HPD-Parsing: Hierarchical Parallel Document Parsingcited by 0
  5. 2026Rank-Consistent Set Reasoning for Co-Salient Object Detectioncited by 0
  6. 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
  7. 2026Xiaomi-OCR-0 Technical Reportcited by 0
  8. 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligencecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training
  2. 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligence
  3. 2026TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
  4. 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing
  5. 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction
  6. 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence
  7. 2026Lightweight and Production-Ready PDF Visual Element Parsing
  8. 2026DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth