Lightweight and Production-Ready PDF Visual Element Parsing
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
PDF documents contain critical visual elements such as figures, tables, and forms whose accurate extraction is essential for document understanding and multimodal retrieval-augmented generation (RAG). Existing PDF parsers often miss complex visuals, extract non-informative artifacts (e.g., watermarks, logos), produce fragmented elements, and fail to reliably associate captions with their corresponding elements, which degrades downstream retrieval and question answering. We present a lightweight and production level PDF parsing framework that can accurately detect visual elements and associates captions using a combination of spatial heuristics, layout analysis, and semantic similarity. On popular benchmark datasets and internal product data, the proposed solution achieves ≥96% visual element detection accuracy and 93% caption association accuracy. When used as a preprocessing step for multimodal RAG, it significantly outperforms state-of-the-art parsers and large vision-language models on both internal data and the MMDocRAG benchmark, while reducing latency by over 2×. We have deployed the proposed system in challenging production environment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 25 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
13 of 25 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
- 2019Logo-2K+: A Large-Scale Logo Dataset for Scalable Logo Classificationcited by 22
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answeringcited by 7
- 2023Multimodal Multi-Hop Question Answering Through a Conversation Between Tools and Efficiently Finetuned Large Language Modelscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
- 2025Vision-Guided Chunking Is All You Need: Enhancing RAG with Multimodal Document Understanding
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Prompting
- 2025DOCR-Inspector: Fine-Grained and Automated Evaluation of Document Parsing with VLM
- 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
- 2025Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
- 2026NovaLAD: A Fast, CPU-Optimized Document Extraction Pipeline for Generative AI and Data Intelligence
- 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming