mlsanityData to 7 Oct 2026

DODO: Discrete OCR Diffusion Models

arXiv 2602.16872 ↗First posted 18 Feb 2026cs.CVcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Optical Character Recognition (OCR) is a fundamental task for digitizing information, serving as a critical bridge between visual data and textual understanding. While modern Vision-Language Models (VLM) have achieved high accuracy in this domain, they predominantly rely on autoregressive decoding, which becomes computationally expensive and slow for long documents as it requires a sequential forward pass for every generated token. We identify a key opportunity to overcome this bottleneck: unlike open-ended generation, OCR is a highly deterministic task where the visual input strictly dictates a unique output sequence, theoretically enabling efficient, parallel decoding via diffusion models. However, we show that existing masked diffusion models fail to harness this potential; those introduce structural instabilities that are benign in flexible tasks, like captioning, but catastrophic for the rigid, exact-match requirements of OCR. To bridge this gap, we introduce DODO, the first VLM to utilize block discrete diffusion and unlock its speedup potential for OCR. By decomposing generation into blocks, DODO mitigates the synchronization errors of global diffusion. Empirically, our method achieves near state-of-the-art accuracy while enabling up to 5x faster inference compared to autoregressive baselines.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 36 of its 46 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

36 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning22 May

Other references · 35

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  8. 2015VQA: Visual Question Answeringcited by 2,489
  9. 2019Towards VQA Models That Can Readcited by 1,696
  10. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  11. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  12. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
23 more
  1. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  2. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  3. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  4. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
  5. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  6. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
  7. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  8. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  9. 2023A Reparameterized Discrete Diffusion Model for Text Generationcited by 152
  10. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
  11. 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 128
  12. 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
  13. 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
  14. 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
  15. 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
  16. 2025Plan for Speed: Dilated Scheduling for Masked Diffusion Language Modelscited by 34
  17. 2024Question Aware Vision Transformer for Multimodal Reasoningcited by 32
  18. 2024DocVLM: Make Your VLM an Efficient Readercited by 27
  19. 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
  20. 2023Towards Models that Can See and Readcited by 15
  21. 2025Parallel Sampling from Masked Diffusion Models via Conditional Independence Testingcited by 13
  22. 2023DREAM: Diffusion Rectification and Estimation-Adaptive Modelscited by 12
  23. 2024VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understandingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Models
  2. 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR
  3. 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancement
  4. 2026Where Vision Becomes Text: Locating the OCR Routing Bottleneck in Vision-Language Models
  5. 2025Benchmarking Vision-Language Models on Optical Character Recognition in Dynamic Video Environments
  6. 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
  7. 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model
  8. 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks