Hybrid OCR-LLM Framework for Enterprise-Scale Document Information Extraction Under Copy-heavy Task
Not on the map. Why?
Abstract (arXiv)
Information extraction from copy-heavy documents, characterized by massive volumes of structurally similar content, represents a critical yet understudied challenge in enterprise document processing. We present a systematic framework that strategically combines OCR engines with Large Language Models (LLMs) to optimize the accuracy-efficiency trade-off inherent in repetitive document extraction tasks. Unlike existing approaches that pursue universal solutions, our method exploits document-specific characteristics through intelligent strategy selection. We implement and evaluate 25 configurations across three extraction paradigms (direct, replacement, and table-based) on identity documents spanning four formats (PNG, DOCX, XLSX, PDF). Through table-based extraction methods, our adaptive framework delivers outstanding results: F1=1.0 accuracy with 0.97s latency for structured documents, and F1=0.997 accuracy with 0.6 s for challenging image inputs when integrated with PaddleOCR, all while maintaining sub-second processing speeds. The 54 times performance improvement compared with multimodal methods over naive approaches, coupled with format-aware routing, enables processing of heterogeneous document streams at production scale. Beyond the specific application to identity extraction, this work establishes a general principle: the repetitive nature of copy-heavy tasks can be transformed from a computational burden into an optimization opportunity through structure-aware method selection.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 11 Oct 2025.
Builds on
29 of 43 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
- 2023Prompt Cache: Modular Attention Reuse for Low-Latency Inferencecited by 268
- 2021DocFormer: End-to-End Transformer for Document Understandingcited by 256
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
17 more
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 116
- 2023Batch Prompting: Efficient Inference with Large Language Model APIscited by 85
- 2022FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extractioncited by 64
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2022Self-Prompting Large Language Models for Zero-Shot Open-Domain QAcited by 39
- 2024BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batchingcited by 32
- 2017A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniquescited by 12
- 2020Cross-Domain Learning for Classifying Propaganda in Online Contentscited by 5
- 2021Making Document-Level Information Extraction Right for the Right Reasonscited by 2
- 2022Data-Efficient Information Extraction from Form-Like Documentscited by 2
- 2024Assessing the quality of information extractioncited by 2
- 2016Document Retrieval on Repetitive String Collectionscited by 1
- 2017Document Listing on Repetitive Collections with Guaranteed Performancecited by 1
- 2019Fast, Small, and Simple Document Listing on Repetitive Text Collectionscited by 1
- 2023End-to-End Document Classification and Key Information Extraction using Assignment Optimizationcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Operationalizing Document AI: A Microservice Architecture for OCR and LLM Pipelines in Productioncited by 1
- 2026Structured Data Extraction from Real Estate Documents using Clustering, Classification, and Large Language Modelscited by 0
- 2026IDP AutoOpt: Agent-Driven Optimization of Document Processing Pipeline Configurationscited by 0
- 2026Closing Cost-Quality Gap in Document VLMs: Difficulty-Aware Data Curation and Quality-Adjusted Deployment Economicscited by 0
- 2026Beyond Accuracy: Robustness, Cost, and Governance Trade-offs for Vision-Language Models in Templated Document Extractioncited by 0
- 2026Beyond Accuracy: Robustness, Cost, and Governance Trade-offs for Vision-Language Models in Templated Document Extraction14 Sep 2026
- 2026Closing Cost-Quality Gap in Document VLMs: Difficulty-Aware Data Curation and Quality-Adjusted Deployment Economics1 Sep 2026
- 2026IDP AutoOpt: Agent-Driven Optimization of Document Processing Pipeline Configurations13 Jul 2026
- 2026Structured Data Extraction from Real Estate Documents using Clustering, Classification, and Large Language Models7 Jul 2026
- 2026Operationalizing Document AI: A Microservice Architecture for OCR and LLM Pipelines in Production12 May 2026