mlsanityData to 14 Oct 2026

VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents

arXiv 2607.24748 ↗First posted 21 May 2026cs.IR cs.AI cs.CLcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

also in 1 more
Abstract (arXiv)

Visually-rich documents such as reports, slides, and manuals often distribute the evidence needed to answer a question across multiple pages, mixing text with layout cues, tables, charts, and figures. This work studies multimodal retrieval-augmented generation for question answering over such visually-rich long documents, where retrieval must select evidence pages that include both textual and visual signals. We present VLD-RAG, an agentic multimodal RAG framework for multi-page evidence retrieval and cross-page reasoning over long documents. VLD-RAG builds a page-preserving multimodal index that stores parsed text, page-level metadata, and dense visual representations, and uses a hybrid retrieval strategy that combines keyword-based sparse search with dense semantic queries to identify candidate sources and evidence pages. A verifier-guided agent workflow coordinates a Retrieval Agent, Answer Agent, and Validation Agent to broaden evidence coverage, detect missing citations, and refine retrieval requests when needed. We evaluate retrieval with Top-1 and Top-5 evidence-page accuracy and generation with generalized accuracy, and show that VLD-RAG improves both evidence-page retrieval and end-task question answering on visually-rich long-document benchmarks, including LongDocURL and MMLongBench-Doc, outperforming previous vision-based retrieval baselines. These findings highlight that coordinated agent verification and multimodal hybrid retrieval are crucial for reliable grounding when correct answers depend on evidence scattered across pages.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 25 of its 35 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

25 of 35 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025VisRAG2.0: Mitigating Visual Hallucinations via Evidence-Guided Multi-Image Reasoning in Visual Retrieval-Augmented Generation10 Oct
  2. 2025VDocRAG: Retrieval-Augmented Generation over Visually-Rich Documents14 Apr
  3. 2025Retrieval-Augmented Perception: High-Resolution Image Perception Meets Visual RAG3 Mar
  4. 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents25 Feb
  5. 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation14 Dec
  6. 2024OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation3 Dec
  7. 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understanding7 Nov
  8. 2024Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent5 Nov
  9. 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents14 Oct
  10. 2024MRAG-Bench: Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models10 Oct
  11. 2024SK-VQA: Synthetic Knowledge Generation at Scale for Training Context-Augmented Multimodal LLMs28 Jun

Other references · 14

  1. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  2. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
  3. 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 114
  4. 2024LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locatingcited by 72
  5. 2025MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understandingcited by 67
  6. 2025KARMA: Leveraging Multi-Agent LLMs for Automated Knowledge Graph Enrichmentcited by 27
  7. 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understandingcited by 25
  8. 2024GRAM: Global Reasoning for Multi-Page VQAcited by 23
  9. 2025MoLoRAG: Bootstrapping Document Understanding via Multi-modal Logic-aware Retrievalcited by 17
  10. 2025Knowledge-based Visual Question Answer with Multimodal Processing, Retrieval and Filteringcited by 17
  11. 2025FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domaincited by 16
  12. 2024CART: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modelingcited by 5
2 more
  1. 2025URaG: Unified Retrieval and Generation in Multimodal LLMs for Efficient Long Document Understandingcited by 5
  2. 2025Taming the Untamed: Graph-Based Knowledge Retrieval and Reasoning for MLLMs to Conquer the Unknowncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hierarchical Evidence-Driven Reasoning for Long Document Understanding
  2. 2026VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval
  3. 2026TechRAG: Evidence-Gated Multimodal Agentic RAG for Technical Literature Reasoning
  4. 2026Navigating Sparse Evidence: Agentic Visual RAG via Explicit Context Selection and Consolidation
  5. 2025HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation
  6. 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understanding
  7. 2026Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA
  8. 2025LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understanding