MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decoding
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
Abstract (arXiv)
Optical character recognition (OCR) has evolved from line-level transcription to structured document parsing, requiring models to recover long-form sequences containing layout, tables, and formulas. Despite recent advances in vision-language models, most existing systems rely on autoregressive decoding, which introduces sequential latency and amplifies error propagation in long documents. In this work, we revisit document OCR from an inverse rendering perspective, arguing that left-to-right causal generation is an artifact of serialization rather than an intrinsic property of the task. Motivated by this insight, we propose MinerU-Diffusion, a unified diffusion-based framework that replaces autoregressive sequential decoding with parallel diffusion denoising under visual conditioning. MinerU-Diffusion employs a block-wise diffusion decoder and an uncertainty-driven curriculum learning strategy to enable stable training and efficient long-sequence inference. Extensive experiments demonstrate that MinerU-Diffusion consistently improves robustness while achieving up to 3.2x faster decoding compared to autoregressive baselines. Evaluations on the proposed Semantic Shuffle benchmark further confirm its reduced dependence on linguistic priors and stronger visual OCR capability.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 44 of its 59 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
44 of 59 references.
Closest ancestors · 1
Same direction, newest first
Other references · 43
- 2023GPT-4 Technical Reportcited by 18,396
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024Qwen2 Technical Reportcited by 2,120
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Large Language Diffusion Modelscited by 912
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
31 more
- 2025Seed1.5-VL Technical Reportcited by 373
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Samplingcited by 208
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 178
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
- 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
- 2025dKV-Cache: The Cache for Diffusion Language Modelscited by 143
- 2025PaddleOCR 3.0 Technical Reportcited by 143
- 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
- 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generationcited by 129
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 125
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
- 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
- 2025Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Modelscited by 88
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
- 2025FlashDLM: Accelerating Diffusion Language Model Inference via Efficient KV Caching and Guided Diffusioncited by 77
- 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 63
- 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
- 2025LLaDA-MoE: A Sparse MoE Diffusion Language Modelcited by 57
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2025Diffusion Language Models are Super Data Learnerscited by 48
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 47
- 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 42
- 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understandingcited by 13
- 2025Native Visual Understanding: Resolving Resolution Dilemmas in Vision-Language Modelscited by 11
- 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planningcited by 5
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Taskscited by 3
- 2026DODO: Discrete OCR Diffusion Modelscited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scalecited by 27
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognitioncited by 0
- 2026Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I modelscited by 0
- 2026CMIP-Forge: An Agentic System that Retrieves, Computes, and Self-Reviews Climate Sciencecited by 0
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decodingcited by 0
- 2026DDVR-Net: Degradation-Aware Decoupling and Visibility-Guided Restoration for Historical Document Recognitioncited by 0
- 2026DDVR-Net: Degradation-Aware Decoupling and Visibility-Guided Restoration for Historical Document Recognition12 Oct 2026
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding22 Sep 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026CMIP-Forge: An Agentic System that Retrieves, Computes, and Self-Reviews Climate Science10 Jun 2026
- 2026Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models4 Jun 2026
- 2026Prefix-Adaptive Block Diffusion for Efficient Document Recognition16 May 2026
- 2026MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scale6 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Models
- 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancement
- 2025Unified Diffusion Transformer for High-fidelity Text-Aware Image Restoration
- 2026FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing
- 2026High-Fidelity Text-to-Image Generation from Pre-Trained Vision-Language Models via Distribution-Conditioned Diffusion Decoding
- 2025Training-Free Diffusion Priors for Text-to-Image Generation via Optimization-based Visual Inversion
- 2025Text-Aware Image Restoration with Diffusion Models
- 2023Controlled and Conditional Text to Image Generation with Diffusion Prior