mlsanityData to 14 Oct 2026

MinerU-Diffusion: Rethinking Document OCR as Inverse Rendering via Diffusion Decoding

arXiv 2603.22458 ↗First posted 23 Mar 2026cs.CVcited by 8

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

Abstract (arXiv)

Optical character recognition (OCR) has evolved from line-level transcription to structured document parsing, requiring models to recover long-form sequences containing layout, tables, and formulas. Despite recent advances in vision-language models, most existing systems rely on autoregressive decoding, which introduces sequential latency and amplifies error propagation in long documents. In this work, we revisit document OCR from an inverse rendering perspective, arguing that left-to-right causal generation is an artifact of serialization rather than an intrinsic property of the task. Motivated by this insight, we propose MinerU-Diffusion, a unified diffusion-based framework that replaces autoregressive sequential decoding with parallel diffusion denoising under visual conditioning. MinerU-Diffusion employs a block-wise diffusion decoder and an uncertainty-driven curriculum learning strategy to enable stable training and efficient long-sequence inference. Extensive experiments demonstrate that MinerU-Diffusion consistently improves robustness while achieving up to 3.2x faster decoding compared to autoregressive baselines. Evaluations on the proposed Semantic Shuffle benchmark further confirm its reduced dependence on linguistic priors and stronger visual OCR capability.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 44 of its 59 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

44 of 59 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Mercury: Ultra-Fast Language Models Based on Diffusion17 Jun

Other references · 43

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2024Qwen2 Technical Reportcited by 2,120
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  9. 2025Large Language Diffusion Modelscited by 912
  10. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
  11. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
  12. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
31 more
  1. 2025Seed1.5-VL Technical Reportcited by 373
  2. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
  3. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  4. 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Samplingcited by 208
  5. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
  6. 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 178
  7. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
  8. 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
  9. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
  10. 2025dKV-Cache: The Cache for Diffusion Language Modelscited by 143
  11. 2025PaddleOCR 3.0 Technical Reportcited by 143
  12. 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
  13. 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generationcited by 129
  14. 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 125
  15. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
  16. 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
  17. 2025Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Modelscited by 88
  18. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
  19. 2025FlashDLM: Accelerating Diffusion Language Model Inference via Efficient KV Caching and Guided Diffusioncited by 77
  20. 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 63
  21. 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
  22. 2025LLaDA-MoE: A Sparse MoE Diffusion Language Modelcited by 57
  23. 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
  24. 2025Diffusion Language Models are Super Data Learnerscited by 48
  25. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 47
  26. 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 42
  27. 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understandingcited by 13
  28. 2025Native Visual Understanding: Resolving Resolution Dilemmas in Vision-Language Modelscited by 11
  29. 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planningcited by 5
  30. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Taskscited by 3
  31. 2026DODO: Discrete OCR Diffusion Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Models
  2. 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancement
  3. 2025Unified Diffusion Transformer for High-fidelity Text-Aware Image Restoration
  4. 2026FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing
  5. 2026High-Fidelity Text-to-Image Generation from Pre-Trained Vision-Language Models via Distribution-Conditioned Diffusion Decoding
  6. 2025Training-Free Diffusion Priors for Text-to-Image Generation via Optimization-based Visual Inversion
  7. 2025Text-Aware Image Restoration with Diffusion Models
  8. 2023Controlled and Conditional Text to Image Generation with Diffusion Prior