mlsanityData to 7 Oct 2026

Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processing

arXiv 2603.24326 ↗First posted 25 Mar 2026cs.CV cs.AI cs.IRcited by 3

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Document parsing is a fine-grained task where image resolution significantly impacts performance. While advanced research leveraging vision-language models benefits from high-resolution input to boost model performance, this often leads to a quadratic increase in the number of vision tokens and significantly raises computational costs. We attribute this inefficiency to substantial visual regions redundancy in document images, like background. To tackle this, we propose PaddleOCR-VL, a novel coarse-to-fine architecture that focuses on semantically relevant regions while suppressing redundant ones, thereby improving both efficiency and performance. Specifically, we introduce a lightweight Valid Region Focus Module (VRFM) which leverages localization and contextual relationship prediction capabilities to identify valid vision tokens. Subsequently, we design and train a compact yet powerful 0.9B vision-language model (PaddleOCR-VL-0.9B) to perform detailed recognition, guided by VRFM outputs to avoid direct processing of the entire large image. Extensive experiments demonstrate that PaddleOCR-VL achieves state-of-the-art performance in both page-level parsing and element-level recognition. It significantly outperforms existing solutions, exhibits strong competitiveness against top-tier VLMs, and delivers fast inference while utilizing substantially fewer vision tokens and parameters, highlighting the effectiveness of targeted coarse-to-fine parsing for accurate and efficient document understanding. The source code and models are publicly available at https://github.com/PaddlePaddle/PaddleOCR.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 42 of its 59 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

42 of 59 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
  2. 2025POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion1 Sep
  3. 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model18 Aug
  4. 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models25 Feb
  5. 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming27 Jun

Other references · 37

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  9. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  11. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  12. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
25 more
  1. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  2. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 338
  3. 2019PlotQA: Reasoning over Scientific Plotscited by 317
  4. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  5. 2019Image-based table recognition: data, model, and evaluationcited by 233
  6. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
  7. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  8. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  9. 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
  10. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
  11. 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 157
  12. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
  13. 2025PaddleOCR 3.0 Technical Reportcited by 136
  14. 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
  15. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
  16. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
  17. 2022Syntax-Aware Network for Handwritten Mathematical Expression Recognitioncited by 68
  18. 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 41
  19. 2024OneChart: Purify the Chart Structural Extraction via One Auxiliary Tokencited by 39
  20. 2024Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matchingcited by 39
  21. 2023Optimized Table Tokenization for Table Structure Recognitioncited by 34
  22. 2024Relation DETR: Exploring Explicit Position Relation Prior for Object Detectioncited by 27
  23. 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
  24. 2024MathWriting: A Dataset For Handwritten Mathematical Expression Recognitioncited by 20
  25. 2017Beagle: Automated Extraction and Interpretation of Visualizations from the Webcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model
  2. 2026PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training
  3. 2026FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing
  4. 2025Index-Preserving Lightweight Token Pruning for Efficient Document Understanding in Vision-Language Models
  5. 2025A Token-level Text Image Foundation Model for Document Understanding
  6. 2026Efficient Document Parsing via Parallel Token Prediction
  7. 2026MURE: Hierarchical Multi-Resolution Encoding via Vision-Language Models for Visual Document Retrieval
  8. 2025DOCR-Inspector: Fine-Grained and Automated Evaluation of Document Parsing with VLM