HPD-Parsing: Hierarchical Parallel Document Parsing
On the map: Efficient LLM inference and serving → Speculative decoding
Abstract (arXiv)
Efficient teamwork typically combines global coordination with parallel execution, a principle not yet fully reflected in unified Vision-Language Model (VLM)-based document parsers. Existing unified parsers process an entire page jointly but generate its output through a single token-by-token autoregressive trajectory, creating a sequential bottleneck that grows with document length. Such full-page sequential generation overlooks a key property of document parsing: layout must be analyzed globally, whereas block content can be parsed in parallel. Based on this observation, we introduce HPD-Parsing, which replaces full-page autoregressive generation with a Hierarchical Parallel Decoding paradigm. A main layout branch organizes the overall document structure and dynamically assigns block-level content decoding to concurrent branches, while progressive multi-token prediction (P-MTP) further reduces the decoding steps within each branch. Experiments on public benchmarks show that HPD-Parsing achieves 4,752 tokens per second, delivering 2.62× the throughput of the fastest existing document parsing model and 3.06× that of the vanilla autoregressive baseline, while maintaining competitive parsing accuracy. These results establish hierarchical parallel decoding as an effective alternative to full-page autoregressive generation, opening a new direction for efficient unified document parsing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Speculative decoding, one of 12 directions in Efficient LLM inference and serving. Builds on 33 of its 35 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
33 of 35 references.
References · 33
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025OpenAI GPT-5 System Cardcited by 910
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2025Ovis2.5 Technical Reportcited by 103
- 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 84
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
21 more
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
- 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 54
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
- 2025POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversioncited by 34
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scalecited by 26
- 2025Ocean-OCR: Towards General OCR Application via a Vision-Language Modelcited by 24
- 2026GLM-OCR Technical Reportcited by 24
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCRcited by 22
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 20
- 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligencecited by 20
- 2026PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Trainingcited by 20
- 2025Logics-Parsing Technical Reportcited by 16
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameterscited by 12
- 2026FireRed-OCR Technical Reportcited by 12
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyondcited by 11
- 2026OCRVerse: Towards Holistic OCR in End-to-End Vision-Language Modelscited by 10
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 9
- 2026Unlimited OCR Workscited by 8
- 2026P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scalingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Efficient Document Parsing via Parallel Token Prediction
- 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decoding
- 2026PaDoc: Layout-Grounded Parallel Decoding for Document Parsing
- 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training
- 2025A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Models
- 2025AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing
- 2026Breaking the Autoregressive Chain: Hyper-Parallel Decoding for Efficient LLM-Based Attribute Value Extraction