DocLens : A Tool-Augmented Multi-Agent Framework for Long Visual Document Understanding
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
also in 1 more
Abstract (arXiv)
Comprehending long visual documents, where information is distributed across extensive pages of text and visual elements, is a critical but challenging task for modern Vision-Language Models (VLMs). Existing approaches falter on a fundamental challenge: evidence localization. They struggle to retrieve relevant pages and overlook fine-grained details within visual elements, leading to limited performance and model hallucination. To address this, we propose DocLens, a tool-augmented multi-agent framework that effectively ``zooms in'' on evidence like a lens. It first navigates from the full document to specific visual elements on relevant pages, then employs a sampling-adjudication mechanism to generate a single, reliable answer. Paired with Gemini-2.5-Pro, DocLens achieves state-of-the-art performance on MMLongBench-Doc and FinRAGBench-V, surpassing even human experts. The framework's superiority is particularly evident on vision-centric and unanswerable queries, demonstrating the power of its enhanced localization capabilities.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 50 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
36 of 50 references.
Closest ancestors · 4
Same direction, newest first
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
- 2025Visual Document Understanding and Reasoning: A Multi-Agent Collaboration Framework with Agent-Wise Adaptive Test-Time Scaling5 Aug
- 2024LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating24 Dec
- 2024ColPali: Efficient Document Retrieval with Vision Language Models27 Jun
Other references · 32
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2025Seed1.5-VL Technical Reportcited by 373
20 more
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
- 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 245
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
- 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Readingcited by 133
- 2025A Comprehensive Survey on Long Context Language Modelingcited by 117
- 2025MiMo-VL Technical Reportcited by 115
- 2023PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Trainingcited by 111
- 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understandingcited by 111
- 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 104
- 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
- 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
- 2025MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understandingcited by 67
- 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agentscited by 66
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
- 2024DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systemscited by 37
- 2025Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answeringcited by 36
- 2024VISA: Retrieval Augmented Generation with Visual Source Attributioncited by 28
- 2025SimpleDoc: Multi-Modal Document Understanding with Dual-Cue Page Retrieval and Iterative Refinementcited by 28
- 2025FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domaincited by 16
- 2025A Deep Dive into Retrieval-Augmented Generation for Code Completion: Experience on WeChatcited by 5
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026DocDancer: Towards Agentic Document-Grounded Information Seekingcited by 12
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrievalcited by 8
- 2026AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generationcited by 5
- 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligencecited by 5
- 2026InterveneBench: Benchmarking LLMs for Intervention Reasoning and Causal Study Design in Real Social Systemscited by 3
- 2026MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QAcited by 2
- 2026From Attribution to Abstention: Training-Free Attention-Based Auditing for Clinical Summarizationcited by 1
- 2026Exploring Information Seeking Agent Consolidationcited by 0
- 2026AutothinkRAG: Complexity-Aware Control of Retrieval-Augmented Reasoning for Image-Text Interactioncited by 0
- 2026HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answeringcited by 0
- 2026DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understandingcited by 0
- 2026DocAtlas: Long-Document Understanding as Mutable-State Interactioncited by 0
3 more
- 2026Locating Failure in Multi-Page Visually Rich Document Understanding: An Empirical Attributioncited by 0
- 2026BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprintscited by 0
- 2026It Takes Workflows to Evolve Better Workflowscited by 0
- 2026It Takes Workflows to Evolve Better Workflows1 Oct 2026
- 2026BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprints7 Sep 2026
- 2026Locating Failure in Multi-Page Visually Rich Document Understanding: An Empirical Attribution8 Aug 2026
- 2026DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding7 Aug 2026
- 2026HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answering31 Jul 2026
- 2026DocAtlas: Long-Document Understanding as Mutable-State Interaction21 Jul 2026
- 2026MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA4 Jun 2026
- 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence13 May 2026
- 2026InterveneBench: Benchmarking LLMs for Intervention Reasoning and Causal Study Design in Real Social Systems16 Mar 2026
- 2026AutothinkRAG: Complexity-Aware Control of Retrieval-Augmented Reasoning for Image-Text Interaction5 Mar 2026
- 2026AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generation27 Feb 2026
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval23 Feb 2026
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrievalcited by 8
- 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligencecited by 5
- 2026MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QAcited by 2
- 2026Exploring Information Seeking Agent Consolidationcited by 0
- 2026HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answeringcited by 0
- 2026DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understandingcited by 0
- 2026DocAtlas: Long-Document Understanding as Mutable-State Interactioncited by 0
- 2026Locating Failure in Multi-Page Visually Rich Document Understanding: An Empirical Attributioncited by 0
- 2026BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprintscited by 0
- 2026It Takes Workflows to Evolve Better Workflowscited by 0
- 2026It Takes Workflows to Evolve Better Workflows1 Oct 2026
- 2026BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprints7 Sep 2026
- 2026Locating Failure in Multi-Page Visually Rich Document Understanding: An Empirical Attribution8 Aug 2026
- 2026DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding7 Aug 2026
- 2026HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answering31 Jul 2026
- 2026DocAtlas: Long-Document Understanding as Mutable-State Interaction21 Jul 2026
- 2026MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA4 Jun 2026
- 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence13 May 2026
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval23 Feb 2026
- 2026Exploring Information Seeking Agent Consolidation31 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understanding
- 2026InSight-doc: Agentic Visual Perception for Long-Document Understanding
- 2026Query-Driven Multimodal Information Extraction from Long Documents
- 2026Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA
- 2026VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents
- 2026VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval
- 2026VISOR: Agentic Visual Retrieval-Augmented Generation via Iterative Search and Over-horizon Reasoning
- 2026SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding