mlsanityData to 7 Oct 2026

Lightweight and Production-Ready PDF Visual Element Parsing

arXiv 2604.23276 ↗First posted 25 Apr 2026cs.CV cs.AI cs.CLcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

PDF documents contain critical visual elements such as figures, tables, and forms whose accurate extraction is essential for document understanding and multimodal retrieval-augmented generation (RAG). Existing PDF parsers often miss complex visuals, extract non-informative artifacts (e.g., watermarks, logos), produce fragmented elements, and fail to reliably associate captions with their corresponding elements, which degrades downstream retrieval and question answering. We present a lightweight and production level PDF parsing framework that can accurately detect visual elements and associates captions using a combination of spatial heuristics, layout analysis, and semantic similarity. On popular benchmark datasets and internal product data, the proposed solution achieves ≥96% visual element detection accuracy and 93% caption association accuracy. When used as a preprocessing step for multimodal RAG, it significantly outperforms state-of-the-art parsers and large vision-language models on both internal data and the MMDocRAG benchmark, while reducing latency by over 2×. We have deployed the proposed system in challenging production environment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 25 references that are in the map. First posted on arXiv 25 Apr 2026.

Builds on

13 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answering22 May

Other references · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  4. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  5. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  6. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
  7. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
  8. 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
  9. 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
  10. 2019Logo-2K+: A Large-Scale Logo Dataset for Scalable Logo Classificationcited by 22
  11. 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answeringcited by 7
  12. 2023Multimodal Multi-Hop Question Answering Through a Conversation Between Tools and Efficiently Finetuned Large Language Modelscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
  2. 2025Vision-Guided Chunking Is All You Need: Enhancing RAG with Multimodal Document Understanding
  3. 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting
  4. 2025DOCR-Inspector: Fine-Grained and Automated Evaluation of Document Parsing with VLM
  5. 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
  6. 2025Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
  7. 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence
  8. 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming