HunyuanOCR Technical Report
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
This paper presents HunyuanOCR, a commercial-grade, open-source, and lightweight (1B parameters) Vision-Language Model (VLM) dedicated to OCR tasks. The architecture comprises a Native Vision Transformer (ViT) and a lightweight LLM connected via an MLP adapter. HunyuanOCR demonstrates superior performance, outperforming commercial APIs, traditional pipelines, and larger models (e.g., Qwen3-VL-4B). Specifically, it surpasses current public solutions in perception tasks (Text Spotting, Parsing) and excels in semantic tasks (IE, Text Image Translation), securing first place in the ICDAR 2025 DIMT Challenge (Small Model Track). Furthermore, it achieves state-of-the-art (SOTA) results on OCRBench among VLMs with fewer than 3B parameters. HunyuanOCR achieves breakthroughs in three key aspects: 1) Unifying Versatility and Efficiency: We implement comprehensive support for core capabilities including spotting, parsing, IE, VQA, and translation within a lightweight framework. This addresses the limitations of narrow "OCR expert models" and inefficient "General VLMs". 2) Streamlined End-to-End Architecture: Adopting a pure end-to-end paradigm eliminates dependencies on pre-processing modules (e.g., layout analysis). This fundamentally resolves error propagation common in traditional pipelines and simplifies system deployment. 3) Data-Driven and RL Strategies: We confirm the critical role of high-quality data and, for the first time in the industry, demonstrate that Reinforcement Learning (RL) strategies yield significant performance gains in OCR tasks. HunyuanOCR is officially open-sourced on HuggingFace. We also provide a high-performance deployment solution based on vLLM, placing its production efficiency in the top tier. We hope this model will advance frontier research and provide a solid foundation for industrial applications.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 58 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
40 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model16 Oct
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models13 May
Other references · 37
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
25 more
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2025PaddleOCR 3.0 Technical Reportcited by 143
- 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
- 2018Scene Text Detection and Recognition: The Deep Learning Eracited by 114
- 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 100
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
- 2023StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-trainingcited by 39
- 2025Capabilities of GPT-5 on Multimodal Medical Reasoningcited by 36
- 2025Mitigating Object Hallucinations via Sentence-Level Early Interventioncited by 28
- 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyondcited by 11
- 2025Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMscited by 9
Built on by
Citing papers per year: 2026: 20.
20 papers.
Sort:
By area:
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 12
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoningcited by 11
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 7
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decodingcited by 6
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 5
- 2026OvisOCR2 Technical Reportcited by 5
- 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settingscited by 4
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AIcited by 4
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methodscited by 2
- 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluationcited by 2
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Modelscited by 1
8 more
- 2026Rethinking Genomic Modeling Through Optical Character Recognitioncited by 0
- 2026Texo: Formula Recognition within 20M Parameterscited by 0
- 2026AGCD: Agent-Guided Cross-Modal Decoding for Weather Forecastingcited by 0
- 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCRcited by 0
- 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstructioncited by 0
- 2026How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbationscited by 0
- 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spottingcited by 0
- 2026DarKnight: Retrieval-Guided Agentic Framework for Breaking Dark Web CAPTCHA Gatescited by 0
- 2026DarKnight: Retrieval-Guided Agentic Framework for Breaking Dark Web CAPTCHA Gates14 Oct 2026
- 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spotting7 Sep 2026
- 2026OvisOCR2 Technical Report15 Jul 2026
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI13 Jul 2026
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluation3 Jul 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations24 Jun 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings8 May 2026
- 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction26 Apr 2026
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios30 Mar 2026
8 more
- 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCR20 Mar 2026
- 2026AGCD: Agent-Guided Cross-Modal Decoding for Weather Forecasting16 Mar 2026
- 2026Texo: Formula Recognition within 20M Parameters19 Feb 2026
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decoding13 Feb 2026
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Search4 Feb 2026
- 2026Rethinking Genomic Modeling Through Optical Character Recognition2 Feb 2026
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Models29 Jan 2026
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning7 Jan 2026
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoningcited by 11
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 7
- 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCRcited by 0
- 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstructioncited by 0
- 2026How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbationscited by 0
- 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spottingcited by 0
- 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spotting7 Sep 2026
- 2026How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations24 Jun 2026
- 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction26 Apr 2026
- 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCR20 Mar 2026
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Search4 Feb 2026
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning7 Jan 2026
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 12
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decodingcited by 6
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Modelscited by 1
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decoding13 Feb 2026
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Models29 Jan 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarioscited by 5
- 2026OvisOCR2 Technical Reportcited by 5
- 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settingscited by 4
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AIcited by 4
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methodscited by 2
- 2026StrucTab: A Structured Optimization Framework for Table Parsingcited by 2
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluationcited by 2
- 2026Rethinking Genomic Modeling Through Optical Character Recognitioncited by 0
- 2026Texo: Formula Recognition within 20M Parameterscited by 0
- 2026OvisOCR2 Technical Report15 Jul 2026
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI13 Jul 2026
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluation3 Jul 2026
- 2026StrucTab: A Structured Optimization Framework for Table Parsing29 Jun 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026How Far Is Document Parsing from Solved? PureDocBench: A Source-Traceable Benchmark across Clean, Degraded, and Real-World Settings8 May 2026
- 2026MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios30 Mar 2026
- 2026Texo: Formula Recognition within 20M Parameters19 Feb 2026
- 2026Rethinking Genomic Modeling Through Optical Character Recognition2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better
- 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Tasks
- 2025Benchmarking Vision-Language Models on Optical Character Recognition in Dynamic Video Environments
- 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
- 2026AtlasOCR: Building the First Open-Source Darija OCR Model with Vision Language Models
- 2025DIMT25@ICDAR2025: HW-TSC's End-to-End Document Image Machine Translation System Leveraging Large Vision-Language Model
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language