AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
The expansion of retrieval-augmented generation (RAG) into multimodal domains has intensified the challenge for processing complex visual documents, such as financial reports. While page-level chunking and retrieval is a natural starting point, it creates a critical bottleneck: delivering entire pages to the generator introduces excessive extraneous context. This not only overloads the generator's attention mechanism but also dilutes the most salient evidence. Moreover, compressing these information-rich pages into a limited visual token budget further increases the risk of hallucinations. To address this, we introduce AgenticOCR, a dynamic parsing paradigm that transforms optical character recognition (OCR) from a static, full-text process into a query-driven, on-demand extraction system. By autonomously analyzing document layout in a "thinking with images" manner, AgenticOCR identifies and selectively recognizes regions of interest. This approach performs on-demand decompression of visual tokens precisely where needed, effectively decoupling retrieval granularity from rigid page-level chunking. AgenticOCR has the potential to serve as the "third building block" of the visual document RAG stack, operating alongside and enhancing standard Embedding and Reranking modules. Experimental results demonstrate that AgenticOCR improves both the efficiency and accuracy of visual RAG systems, achieving expert-level performance in long document understanding. Code and models are available at https://github.com/OpenDataLab/AgenticOCR.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 41 of its 49 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
41 of 49 references.
Closest ancestors · 11
Same direction, newest first
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarios13 Jan
- 2025MonkeyOCR v1.5 Technical Report: Unlocking Robust Document Parsing for Complex Patterns13 Nov
- 2025RegionRAG: Region-level Retrieval-Augmented Generation for Visual Document Understanding31 Oct
- 2025VisRAG2.0: Mitigating Visual Hallucinations via Evidence-Guided Multi-Image Reasoning in Visual Retrieval-Augmented Generation10 Oct
- 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learning28 May
- 2025VDocRAG: Retrieval-Augmented Generation over Visually-Rich Documents14 Apr
- 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents25 Feb
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations10 Dec
- 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understanding7 Nov
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction28 Oct
- 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents14 Oct
Other references · 30
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2024ColPali: Efficient Document Retrieval with Vision Language Modelscited by 190
- 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
18 more
- 2025Thyme: Think Beyond Imagescited by 160
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 84
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
- 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
- 2025MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understandingcited by 66
- 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 54
- 2025SimpleDoc: Multi-Modal Document Understanding with Dual-Cue Page Retrieval and Iterative Refinementcited by 27
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 22
- 2025FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domaincited by 16
- 2025DocLens : A Tool-Augmented Multi-Agent Framework for Long Visual Document Understandingcited by 15
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 13
- 2025Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilitiescited by 11
- 2025RARE: Retrieval-Augmented Reasoning Modelingcited by 11
- 2026DocDancer: Towards Agentic Document-Grounded Information Seekingcited by 11
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligencecited by 5
- 2026MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QAcited by 2
- 2026Benchmarking Complex Multimodal Document Processing Pipelines: A Unified Evaluation Framework for Enterprise AIcited by 0
- 2026DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understandingcited by 0
- 2026Question-Guided Evidence Acquisition for Multimodal Visual Question Answeringcited by 0
- 2026Question-Guided Evidence Acquisition for Multimodal Visual Question Answering20 Aug 2026
- 2026DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding7 Aug 2026
- 2026MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA14 Jun 2026
- 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence13 May 2026
- 2026Benchmarking Complex Multimodal Document Processing Pipelines: A Unified Evaluation Framework for Enterprise AI29 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents
- 2026VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval
- 2025Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding
- 2026Navigating Sparse Evidence: Agentic Visual RAG via Explicit Context Selection and Consolidation
- 2024OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation
- 2025Beyond Patch Aggregation: 3-Pass Pyramid Indexing for Vision-Enhanced Document Retrieval
- 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
- 2026VISOR: Agentic Visual Retrieval-Augmented Generation via Iterative Search and Over-horizon Reasoning