mlsanityData to 14 Oct 2026

Document Intelligence in the Era of Large Language Models: A Survey

arXiv 2510.13366 ↗First posted 15 Oct 2025cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Document AI (DAI) has emerged as a vital application area, and is significantly transformed by the advent of large language models (LLMs). While earlier approaches relied on encoder-decoder architectures, decoder-only LLMs have revolutionized DAI, bringing remarkable advancements in understanding and generation. This survey provides a comprehensive overview of DAI's evolution, highlighting current research attempts and future prospects of LLMs in this field. We explore key advancements and challenges in multimodal, multilingual, and retrieval-augmented DAI, while also suggesting future research directions, including agent-based approaches and document-specific foundation models. This paper aims to provide a structured analysis of the state-of-the-art in DAI and its implications for both academic and practical applications.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 194 of its 281 references that are in the map. First posted on arXiv 15 Oct 2025.

Builds on

194 of 281 references.

References · 194

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  8. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  9. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  11. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  12. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
38 more
  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  3. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
  4. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  6. 2019Towards VQA Models That Can Readcited by 1,718
  7. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  8. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  9. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  10. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  11. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  12. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  13. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  14. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
  15. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  16. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  17. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  18. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  19. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
  20. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  21. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  22. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  23. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  24. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
  25. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  26. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  27. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
  28. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  29. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
  30. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
  31. 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 262
  32. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 256
  33. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  34. 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
  35. 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 245
  36. 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
  37. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  38. 2017Challenges in Data-to-Document Generationcited by 226

50 most cited of 194 All 194 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding
  2. 2026DocClaw: A Unified Agentic System for Intelligent Document Processing
  3. 2025Model-Document Protocol for AI Search
  4. 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understanding
  5. 2025An agentic system with reinforcement-learned subsystem improvements for parsing form-like documents
  6. 2024Large Multimodal Agents: A Survey
  7. 2024Exploring AI Text Generation, Retrieval-Augmented Generation, and Detection Technologies: a Comprehensive Overview
  8. 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrieval