mlsanityData to 14 Oct 2026

PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks

arXiv 2603.24373 ↗First posted 25 Mar 2026cs.CVcited by 9

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

The advent of "OCR 2.0" and large-scale vision-language models (VLMs) has set new benchmarks in text recognition. However, these unified architectures often come with significant computational demands, challenges in precise text localization within complex layouts, and a propensity for textual hallucinations. Revisiting the prevailing notion that model scale is the sole path to high accuracy, this paper introduces PP-OCRv5, a meticulously optimized, lightweight OCR system with merely 5 million parameters. We demonstrate that PP-OCRv5 achieves performance competitive with many billion-parameter VLMs on standard OCR benchmarks, while offering superior localization precision and reduced hallucinations. The cornerstone of our success lies not in architectural expansion but in a data-centric investigation. We systematically dissect the role of training data by quantifying three critical dimensions: data difficulty, data accuracy, and data diversity. Our extensive experiments reveal that with a sufficient volume of high-quality, accurately labeled, and diverse data, the performance ceiling for traditional, efficient two-stage OCR pipelines is far higher than commonly assumed. This work provides compelling evidence for the viability of lightweight, specialized models in the large-model era and offers practical insights into data curation for OCR. The source code and models are publicly available at https://github.com/PaddlePaddle/PaddleOCR.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 29 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

22 of 29 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning31 Dec
  2. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models13 May

Other references · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
  6. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
  7. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  8. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  9. 2021OCR-free Document Understanding Transformercited by 407
  10. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  11. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
  12. 2019Real-time Scene Text Detection with Differentiable Binarizationcited by 214
8 more
  1. 2023Data-centric Artificial Intelligence: A Surveycited by 203
  2. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  3. 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 151
  4. 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
  5. 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
  6. 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
  7. 2020GTC: Guided Training of CTC Towards Efficient and Accurate Scene Text Recognitioncited by 52
  8. 2021PP-LCNet: A Lightweight CPU Convolutional Neural Networkcited by 27

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Where Vision Becomes Text: Locating the OCR Routing Bottleneck in Vision-Language Models
  2. 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR
  3. 2025Benchmarking Vision-Language Models on Optical Character Recognition in Dynamic Video Environments
  4. 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
  5. 2026From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists
  6. 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model
  7. 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better
  8. 2026Scaling State-Space Models from Lines to Paragraphs: An Ablation of Mamba-based OCR