mlsanityData to 7 Oct 2026

Real5-OmniDocBench: A Full-Scale Physical Reconstruction Benchmark for Robust Document Parsing in the Wild

arXiv 2603.04205 ↗First posted 4 Mar 2026cs.CVcited by 11

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

While Vision-Language Models (VLMs) achieve near-perfect scores on digital document benchmarks like OmniDocBench, their performance in the unpredictable physical world remains largely unknown due to the lack of controlled yet realistic evaluations. We introduce Real5-OmniDocBench, the first benchmark that performs a full-scale, one-to-one physical reconstruction of the entire OmniDocBench v1.5 (1,355 images) across five critical real-world scenarios: Scanning, Warping, Screen-Photography, Illumination, and Skew. Unlike prior benchmark that either lack digital correspondence or employ partial sampling, our complete ground-truth mapping enables, for the first time, rigorous factor-wise attribution of performance degradation-allowing us to pinpoint whether failures stem from geometric distortions, optical artifacts, or model limitations. Our benchmark establishes a challenging new standard for the community, demonstrating that the 'reality gap' in document parsing is far from closed, and provides a diagnostic tool to guide the development of truly resilient document intelligence.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 12 of its 19 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

12 of 19 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025DocPTBench: Benchmarking End-to-End Photographed Document Parsing and Translation23 Nov
  2. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model16 Oct
  3. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
  4. 2025WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?16 May
  5. 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models25 Feb
  6. 2025Ocean-OCR: Towards General OCR Application via a Vision-Language Model26 Jan

Other references · 6

  1. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 254
  2. 2019Image-based table recognition: data, model, and evaluationcited by 233
  3. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
  4. 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 54
  5. 2024Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matchingcited by 39
  6. 2024DocRes: A Generalist Model Toward Unifying Document Image Restoration Taskscited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training
  2. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
  3. 2026ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction
  4. 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing
  5. 2026Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models
  6. 2026HSD: Training-Free Acceleration for Document Parsing Vision-Language Models with Hierarchical Speculative Decoding
  7. 2026FastOCR: Dynamic Visual Fixation via KV Cache Pruning for Efficient Document Parsing
  8. 2026Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction