Document Intelligence in the Era of Large Language Models: A Survey
Not on the map. Why?
Abstract (arXiv)
Document AI (DAI) has emerged as a vital application area, and is significantly transformed by the advent of large language models (LLMs). While earlier approaches relied on encoder-decoder architectures, decoder-only LLMs have revolutionized DAI, bringing remarkable advancements in understanding and generation. This survey provides a comprehensive overview of DAI's evolution, highlighting current research attempts and future prospects of LLMs in this field. We explore key advancements and challenges in multimodal, multilingual, and retrieval-augmented DAI, while also suggesting future research directions, including agent-based approaches and document-specific foundation models. This paper aims to provide a structured analysis of the state-of-the-art in DAI and its implications for both academic and practical applications.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 194 of its 281 references that are in the map. First posted on arXiv 15 Oct 2025.
Builds on
194 of 281 references.
References · 194
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
38 more
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2019Towards VQA Models That Can Readcited by 1,718
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
- 2017The NarrativeQA Reading Comprehension Challengecited by 597
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
- 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 262
- 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 256
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
- 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 245
- 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
- 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
- 2017Challenges in Data-to-Document Generationcited by 226
50 most cited of 194 All 194 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026CC-OCR V2: Fine-Grained Attribution of LMM Failures in Real-World Visual Document Understandingcited by 3
- 2026IDP Accelerator: Agentic Document Intelligence from Extraction to Compliance Validationcited by 1
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligencecited by 1
- 2026PubMed-OCR: PMC Open Access OCR Annotationscited by 0
- 2026FigmaTrace: Capturing Creative Nuances in Human Figma Design Workflowscited by 0
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026FigmaTrace: Capturing Creative Nuances in Human Figma Design Workflows20 Aug 2026
- 2026CC-OCR V2: Fine-Grained Attribution of LMM Failures in Real-World Visual Document Understanding5 May 2026
- 2026IDP Accelerator: Agentic Document Intelligence from Extraction to Compliance Validation26 Feb 2026
- 2026PubMed-OCR: PMC Open Access OCR Annotations16 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding
- 2026DocClaw: A Unified Agentic System for Intelligent Document Processing
- 2025Model-Document Protocol for AI Search
- 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understanding
- 2025An agentic system with reinforcement-learned subsystem improvements for parsing form-like documents
- 2024Large Multimodal Agents: A Survey
- 2024Exploring AI Text Generation, Retrieval-Augmented Generation, and Detection Technologies: a Comprehensive Overview
- 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrieval