DODO: Discrete OCR Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Optical Character Recognition (OCR) is a fundamental task for digitizing information, serving as a critical bridge between visual data and textual understanding. While modern Vision-Language Models (VLM) have achieved high accuracy in this domain, they predominantly rely on autoregressive decoding, which becomes computationally expensive and slow for long documents as it requires a sequential forward pass for every generated token. We identify a key opportunity to overcome this bottleneck: unlike open-ended generation, OCR is a highly deterministic task where the visual input strictly dictates a unique output sequence, theoretically enabling efficient, parallel decoding via diffusion models. However, we show that existing masked diffusion models fail to harness this potential; those introduce structural instabilities that are benign in flexible tasks, like captioning, but catastrophic for the rigid, exact-match requirements of OCR. To bridge this gap, we introduce DODO, the first VLM to utilize block discrete diffusion and unlock its speedup potential for OCR. By decomposing generation into blocks, DODO mitigates the synchronization errors of global diffusion. Empirically, our method achieves near state-of-the-art accuracy while enabling up to 5x faster inference compared to autoregressive baselines.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 36 of its 46 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
36 of 46 references.
Closest ancestors · 1
Same direction, newest first
Other references · 35
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2015VQA: Visual Question Answeringcited by 2,489
- 2019Towards VQA Models That Can Readcited by 1,696
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
23 more
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2023A Reparameterized Discrete Diffusion Model for Text Generationcited by 152
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 128
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
- 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
- 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
- 2025Plan for Speed: Dilated Scheduling for Masked Diffusion Language Modelscited by 34
- 2024Question Aware Vision Transformer for Multimodal Reasoningcited by 32
- 2024DocVLM: Make Your VLM an Efficient Readercited by 27
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2023Towards Models that Can See and Readcited by 15
- 2025Parallel Sampling from Masked Diffusion Models via Conditional Independence Testingcited by 13
- 2023DREAM: Diffusion Rectification and Estimation-Adaptive Modelscited by 12
- 2024VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understandingcited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023DECDM: Document Enhancement using Cycle-Consistent Diffusion Models
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR
- 2024NAF-DPM: A Nonlinear Activation-Free Diffusion Probabilistic Model for Document Enhancement
- 2026Where Vision Becomes Text: Locating the OCR Routing Bottleneck in Vision-Language Models
- 2025Benchmarking Vision-Language Models on Optical Character Recognition in Dynamic Video Environments
- 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
- 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks