Evaluation of Deep Convolutional Nets for Document Image Classification and Retrieval
Not on the map. Why?
Cited by 23 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
This paper presents a new state-of-the-art for document image classification and retrieval, using features learned by deep convolutional neural networks (CNNs). In object and scene analysis, deep neural nets are capable of learning a hierarchical chain of abstraction from pixel inputs to concise and descriptive representations. The current work explores this capacity in the realm of document analysis, and confirms that this representation strategy is superior to a variety of popular hand-crafted alternatives. Experiments also show that (i) features extracted from CNNs are robust to compression, (ii) CNNs trained on non-document images transfer well to document analysis tasks, and (iii) enforcing region-specific feature-learning is unnecessary given sufficient training data. This work also makes available a new labelled subset of the IIT-CDIP collection, containing 400,000 document images across 16 categories, useful for training new CNNs for document analysis.
Key facts. Cited by 212 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 35; 2023: 46; 2024: 45; 2025: 29; 2026: 29.
212 papers.
Sort:
By area:
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2021OCR-free Document Understanding Transformercited by 400
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 272
- 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
38 more
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2022LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understandingcited by 107
- 2021BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documentscited by 104
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
- 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 98
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2021StructuralLM: Structural Pre-training for Form Understandingcited by 91
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2022Unified Pretraining Framework for Document Understandingcited by 85
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
- 2022End-to-end Document Recognition and Understanding with Dessurtcited by 73
- 2022ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understandingcited by 67
- 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 65
- 2021Document AI: Benchmarks, Models and Applicationscited by 61
- 2021LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysiscited by 58
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2023DocFormerv2: Local Features for Document Understandingcited by 46
- 2023Vision Grid Transformer for Document Layout Analysiscited by 45
- 2021MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understandingcited by 44
- 2023StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-trainingcited by 39
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2022VRDU: A Benchmark for Visually-rich Document Understandingcited by 35
- 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimmingcited by 35
- 2024InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructionscited by 27
- 2024LayoutLLM: Large Language Model Instruction Tuning for Visually Rich Document Understandingcited by 24
- 2022Multimodal Pre-training Based on Graph Attention Network for Document Understandingcited by 23
- 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understandingcited by 23
- 2023CCpdf: Building a High Quality Corpus for Visually Rich Documents from Web Crawl Datacited by 21
- 2024Deep Learning based Visually Rich Document Content Understanding: A Surveycited by 21
- 2022Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understandingcited by 20
- 2025Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligencecited by 20
- 2025Marten: Visual Question Answering with Mask Generation for Multi-modal Document Understandingcited by 20
- 2022V-Doc : Visual questions answers with Documentscited by 19
- 2021Current Status and Performance Analysis of Table Recognition in Document Images with Deep Neural Networkscited by 18
- 2022A Survey of Historical Document Image Datasetscited by 18
50 most cited of 212 All 212 (JSON)
- 2026Unapologetically Distributed: A Call for Decentralized Document Analysis30 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding22 Sep 2026
- 2026Mind the Gaps: A Curated Benchmark for Form Field Detection20 Sep 2026
- 2026Beyond Accuracy: Robustness, Cost, and Governance Trade-offs for Vision-Language Models in Templated Document Extraction14 Sep 2026
- 2026When Superpixels Fail on Documents: A Study of Segmentation for LIME Explanations7 Sep 2026
- 2026Jina-OCR-v1: Efficient Document Parsing with Speculative Decoding and Dense Verifiable Rewards2 Sep 2026
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flow3 Aug 2026
- 2026Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction3 Aug 2026
- 2026Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms23 Jul 2026
- 2026Eddy-VL 1.9B: Structural Pruning and Layered Distillation for Edge-Deployable Multimodal Embedding15 Jul 2026
- 2026Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap30 Jun 2026
38 more
- 2026DocHRL: A Hierarchical Reinforcement Learning Framework for Cost-Optimised Document Classification24 Jun 2026
- 2026The CIFAR Synthetic Evidence Corpus for Detecting AI-Generated Evidence6 Jun 2026
- 2026Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis1 Jun 2026
- 2026Page image classifier fine-tuned on century-spanning archives of scanned documents for further content-specific processing25 May 2026
- 2026MADP: A Multi-Agent Pipeline for Sustainable Document Processing with Human-in-the-Loop16 May 2026
- 2026Benchmarking OCR Pipelines with Adaptive Enhancement for Multi-Domain Retail Bill Digitization28 Apr 2026
- 2026Shard the Gradient, Scale the Model: Serverless Federated Aggregation via Gradient Partitioning23 Apr 2026
- 2026Revise: A Framework for Revising OCRed text in Practical Information Systems with Data Contamination Strategy9 Apr 2026
- 2026Adaptive Radial Projection on Fourier Magnitude Spectrum for Document Image Skew Estimation6 Mar 2026
- 2026RobustVisRAG: Causality-Aware Vision-Based Retrieval-Augmented Generation under Visual Degradations25 Feb 2026
- 2026Evaluating the Impact of Data Anonymization on Image Retrieval23 Feb 2026
- 2026PA-Attack: Guiding Gray-Box Attacks on LVLM Vision Encoders with Prototypes and Attention23 Feb 2026
- 2026DocSplit: A Comprehensive Benchmark Dataset and Evaluation Approach for Document Packet Recognition and Splitting17 Feb 2026
- 2026BLUEPRINT Rebuilding a Legacy: Multimodal Retrieval for Complex Engineering Drawings and Documents12 Feb 2026
- 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoom1 Feb 2026
- 2026GutenOCR: A Grounded Vision-Language Front-End for Documents20 Jan 2026
- 2026PubMed-OCR: PMC Open Access OCR Annotations16 Jan 2026
- 2025IndicDLP: A Foundational Dataset for Multi-Lingual and Multi-Domain Document Layout Parsing23 Dec 2025
- 2025Towards Natural Language-Based Document Image Retrieval: New Dataset and Benchmark23 Dec 2025
- 2025Toward Real-world Text Image Forgery Localization: Structured and Interpretable Data Synthesis16 Nov 2025
- 2025IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMs6 Nov 2025
- 2025Seeing Straight: Document Orientation Detection for Efficient OCR6 Nov 2025
- 2025Cross-Lingual SynthDocs: A Large-Scale Synthetic Corpus for Any to Arabic OCR and Document Understanding1 Nov 2025
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025MuSLR: Multimodal Symbolic Logical Reasoning30 Sep 2025
- 2025SynDoc: A Hybrid Discriminative-Generative Framework for Enhancing Synthetic Domain-Adaptive Document Key Information Extraction27 Sep 2025
- 2025CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition24 Sep 2025
- 2025SCORE: A Semantic Evaluation Framework for Generative Document Parsing16 Sep 2025
- 2025DocVCE: Diffusion-based Visual Counterfactual Explanations for Document Image Classification6 Aug 2025
- 2025DP-DocLDM: Differentially Private Document Image Generation using Latent Diffusion Models6 Aug 2025
- 2025A Survey on MLLM-based Visually Rich Document Understanding: Methods, Challenges, and Emerging Trends14 Jul 2025
- 2025DocPolarBERT: A Pre-trained Model for Document Understanding with Relative Polar Coordinate Encoding of Layout Structures11 Jul 2025
- 2025FormGym: Doing Paperwork with Agents17 Jun 2025
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigm5 Jun 2025
- 2025CHAOS: Chart Analysis with Outlier Samples22 May 2025
- 2025Information Extraction from Visually Rich Documents using LLM-based Organization of Documents into Independent Textual Segments18 May 2025
- 2025A Multimodal Pipeline for Clinical Data Extraction: Applying Vision-Language Models to Scans of Transfusion Reaction Reports28 Apr 2025
50 newest of 212 All 212 (JSON)
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimmingcited by 35
- 2025Marten: Visual Question Answering with Mask Generation for Multi-modal Document Understandingcited by 20
- 2022Bi-VLDoc: Bidirectional Vision-Language Modeling for Visually-Rich Document Understandingcited by 18
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2025A Token-level Text Image Foundation Model for Document Understandingcited by 13
- 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoomcited by 9
- 2025Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Reviewcited by 8
- 2024TRINS: Towards Multimodal Language Models that Can Readcited by 7
12 most cited of 23 All 23 (JSON)
- 2026Beyond Accuracy: Robustness, Cost, and Governance Trade-offs for Vision-Language Models in Templated Document Extraction14 Sep 2026
- 2026Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction3 Aug 2026
- 2026RobustVisRAG: Causality-Aware Vision-Based Retrieval-Augmented Generation under Visual Degradations25 Feb 2026
- 2026PA-Attack: Guiding Gray-Box Attacks on LVLM Vision Encoders with Prototypes and Attention23 Feb 2026
- 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoom1 Feb 2026
- 2025IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMs6 Nov 2025
- 2025A Multimodal Pipeline for Clinical Data Extraction: Applying Vision-Language Models to Scans of Transfusion Reaction Reports28 Apr 2025
- 2025Relation-Rich Visual Document Generator for Visual Information Extraction14 Apr 2025
- 2025Marten: Visual Question Answering with Mask Generation for Multi-modal Document Understanding18 Mar 2025
- 2025A Token-level Text Image Foundation Model for Document Understanding4 Mar 2025
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models25 Feb 2025
- 2025Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review23 Feb 2025
12 newest of 23 All 23 (JSON)
- 2024Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exitingcited by 2
- 2026Jina-OCR-v1: Efficient Document Parsing with Speculative Decoding and Dense Verifiable Rewardscited by 0
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decodingcited by 0
- 2026Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding22 Sep 2026
- 2026Jina-OCR-v1: Efficient Document Parsing with Speculative Decoding and Dense Verifiable Rewards2 Sep 2026
- 2024Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exiting21 May 2024
- 2025MuSLR: Multimodal Symbolic Logical Reasoningcited by 7
- 2025MuSLR: Multimodal Symbolic Logical Reasoning30 Sep 2025
- 2024Machine Unlearning for Document Classificationcited by 4
- 2024Machine Unlearning for Document Classification29 Apr 2024
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2021OCR-free Document Understanding Transformercited by 400
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 272
- 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2022LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understandingcited by 107
12 most cited of 180 All 180 (JSON)
- 2026Unapologetically Distributed: A Call for Decentralized Document Analysis30 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026Mind the Gaps: A Curated Benchmark for Form Field Detection20 Sep 2026
- 2026When Superpixels Fail on Documents: A Study of Segmentation for LIME Explanations7 Sep 2026
- 2026Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms23 Jul 2026
- 2026Eddy-VL 1.9B: Structural Pruning and Layered Distillation for Edge-Deployable Multimodal Embedding15 Jul 2026
- 2026Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap30 Jun 2026
- 2026DocHRL: A Hierarchical Reinforcement Learning Framework for Cost-Optimised Document Classification24 Jun 2026
- 2026The CIFAR Synthetic Evidence Corpus for Detecting AI-Generated Evidence6 Jun 2026
- 2026Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis1 Jun 2026
- 2026Page image classifier fine-tuned on century-spanning archives of scanned documents for further content-specific processing25 May 2026
- 2026Benchmarking OCR Pipelines with Adaptive Enhancement for Multi-Domain Retail Bill Digitization28 Apr 2026
12 newest of 180 All 180 (JSON)