Boosting Document Parsing Efficiency and Performance with Coarse-to-Fine Visual Processing
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
Document parsing is a fine-grained task where image resolution significantly impacts performance. While advanced research leveraging vision-language models benefits from high-resolution input to boost model performance, this often leads to a quadratic increase in the number of vision tokens and significantly raises computational costs. We attribute this inefficiency to substantial visual regions redundancy in document images, like background. To tackle this, we propose PaddleOCR-VL, a novel coarse-to-fine architecture that focuses on semantically relevant regions while suppressing redundant ones, thereby improving both efficiency and performance. Specifically, we introduce a lightweight Valid Region Focus Module (VRFM) which leverages localization and contextual relationship prediction capabilities to identify valid vision tokens. Subsequently, we design and train a compact yet powerful 0.9B vision-language model (PaddleOCR-VL-0.9B) to perform detailed recognition, guided by VRFM outputs to avoid direct processing of the entire large image. Extensive experiments demonstrate that PaddleOCR-VL achieves state-of-the-art performance in both page-level parsing and element-level recognition. It significantly outperforms existing solutions, exhibits strong competitiveness against top-tier VLMs, and delivers fast inference while utilizing substantially fewer vision tokens and parameters, highlighting the effectiveness of targeted coarse-to-fine parsing for accurate and efficient document understanding. The source code and models are publicly available at https://github.com/PaddlePaddle/PaddleOCR.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 42 of its 59 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
42 of 59 references.
Closest ancestors · 5
Same direction, newest first
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
- 2025POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion1 Sep
- 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model18 Aug
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models25 Feb
- 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming27 Jun
Other references · 37
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
25 more
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 338
- 2019PlotQA: Reasoning over Scientific Plotscited by 317
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 157
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2025PaddleOCR 3.0 Technical Reportcited by 136
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2022Syntax-Aware Network for Handwritten Mathematical Expression Recognitioncited by 68
- 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 41
- 2024OneChart: Purify the Chart Structural Extraction via One Auxiliary Tokencited by 39
- 2024Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matchingcited by 39
- 2023Optimized Table Tokenization for Table Structure Recognitioncited by 34
- 2024Relation DETR: Exploring Explicit Position Relation Prior for Object Detectioncited by 27
- 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
- 2024MathWriting: A Dataset For Handwritten Mathematical Expression Recognitioncited by 20
- 2017Beagle: Automated Extraction and Interpretation of Visualizations from the Webcited by 19
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model
- 2026PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training
- 2026FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing
- 2025Index-Preserving Lightweight Token Pruning for Efficient Document Understanding in Vision-Language Models
- 2025A Token-level Text Image Foundation Model for Document Understanding
- 2026Efficient Document Parsing via Parallel Token Prediction
- 2026MURE: Hierarchical Multi-Resolution Encoding via Vision-Language Models for Visual Document Retrieval
- 2025DOCR-Inspector: Fine-Grained and Automated Evaluation of Document Parsing with VLM