mlsanityData to 14 Oct 2026

HunyuanOCR Technical Report

arXiv 2511.19575 ↗First posted 24 Nov 2025cs.CV cs.AIcited by 20

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

This paper presents HunyuanOCR, a commercial-grade, open-source, and lightweight (1B parameters) Vision-Language Model (VLM) dedicated to OCR tasks. The architecture comprises a Native Vision Transformer (ViT) and a lightweight LLM connected via an MLP adapter. HunyuanOCR demonstrates superior performance, outperforming commercial APIs, traditional pipelines, and larger models (e.g., Qwen3-VL-4B). Specifically, it surpasses current public solutions in perception tasks (Text Spotting, Parsing) and excels in semantic tasks (IE, Text Image Translation), securing first place in the ICDAR 2025 DIMT Challenge (Small Model Track). Furthermore, it achieves state-of-the-art (SOTA) results on OCRBench among VLMs with fewer than 3B parameters. HunyuanOCR achieves breakthroughs in three key aspects: 1) Unifying Versatility and Efficiency: We implement comprehensive support for core capabilities including spotting, parsing, IE, VQA, and translation within a lightweight framework. This addresses the limitations of narrow "OCR expert models" and inefficient "General VLMs". 2) Streamlined End-to-End Architecture: Adopting a pure end-to-end paradigm eliminates dependencies on pre-processing modules (e.g., layout analysis). This fundamentally resolves error propagation common in traditional pipelines and simplifies system deployment. 3) Data-Driven and RL Strategies: We confirm the critical role of high-quality data and, for the first time in the industry, demonstrate that Reinforcement Learning (RL) strategies yield significant performance gains in OCR tasks. HunyuanOCR is officially open-sourced on HuggingFace. We also provide a high-performance deployment solution based on vLLM, placing its production efficiency in the top tier. We hope this model will advance frontier research and provide a solid foundation for industrial applications.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 58 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

40 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model16 Oct
  2. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
  3. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models13 May

Other references · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  10. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  11. 2023A Survey on Multimodal Large Language Modelscited by 909
  12. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
25 more
  1. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
  2. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
  3. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
  4. 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
  5. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
  6. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
  7. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
  8. 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
  9. 2025PaddleOCR 3.0 Technical Reportcited by 143
  10. 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
  11. 2018Scene Text Detection and Recognition: The Deep Learning Eracited by 114
  12. 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 100
  13. 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
  14. 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
  15. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
  16. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
  17. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
  18. 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
  19. 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
  20. 2023StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-trainingcited by 39
  21. 2025Capabilities of GPT-5 on Multimodal Medical Reasoningcited by 36
  22. 2025Mitigating Object Hallucinations via Sentence-Level Early Interventioncited by 28
  23. 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
  24. 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyondcited by 11
  25. 2025Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 20.

20 papers.

Sort:

By area:

  1. 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 12
  2. 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoningcited by 11
  3. 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 7
  4. 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decodingcited by 6
  5. 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 5
  6. 2026OvisOCR2 Technical Reportcited by 5
  7. 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settingscited by 4
  8. 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AIcited by 4
  9. 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methodscited by 2
  10. 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
  11. 2026MORE: A Multilingual Document Parsing Benchmark and Evaluationcited by 2
  12. 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Modelscited by 1
8 more
  1. 2026Rethinking Genomic Modeling Through Optical Character Recognitioncited by 0
  2. 2026Texo: Formula Recognition within 20M Parameterscited by 0
  3. 2026AGCD: Agent-Guided Cross-Modal Decoding for Weather Forecastingcited by 0
  4. 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCRcited by 0
  5. 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstructioncited by 0
  6. 2026How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbationscited by 0
  7. 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spottingcited by 0
  8. 2026DarKnight: Retrieval-Guided Agentic Framework for Breaking Dark Web CAPTCHA Gatescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better
  2. 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Tasks
  3. 2025Benchmarking Vision-Language Models on Optical Character Recognition in Dynamic Video Environments
  4. 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
  5. 2026AtlasOCR: Building the First Open-Source Darija OCR Model with Vision Language Models
  6. 2025DIMT25@ICDAR2025: HW-TSC's End-to-End Document Image Machine Translation System Leveraging Large Vision-Language Model
  7. 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks
  8. 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language