Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence
Not on the map. Why?
Abstract (arXiv)
The advancement of Document Intelligence (DI) demands large-scale, high-quality training data, yet manual annotation remains a critical bottleneck. While data generation methods are evolving rapidly, existing surveys are constrained by fragmented focuses on single modalities or specific tasks, lacking a unified perspective aligned with real-world workflows. To fill this gap, this survey establishes the first comprehensive technical map for data generation in DI. Data generation is redefined as supervisory signal production, and a novel taxonomy is introduced based on the "availability of data and labels." This framework organizes methodologies into four resource-centric paradigms: Data Augmentation, Data Generation from Scratch, Automated Data Annotation, and Self-Supervised Signal Construction. Furthermore, a multi-level evaluation framework is established to integrate intrinsic quality and extrinsic utility, compiling performance gains across diverse DI benchmarks. Guided by this unified structure, the methodological landscape is dissected to reveal critical challenges such as fidelity gaps and frontiers including co-evolutionary ecosystems. Ultimately, by systematizing this fragmented field, data generation is positioned as the central engine for next-generation DI.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 142 of its 201 references that are in the map. First posted on arXiv 18 Jan 2026.
Builds on
142 of 201 references.
References · 142
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
38 more
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2019PlotQA: Reasoning over Scientific Plotscited by 317
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 314
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 272
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
- 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
- 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 149
- 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
- 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 144
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
- 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
- 2023ChartBench: A Benchmark for Complex Visual Reasoning in Chartscited by 116
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
- 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
- 2023Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performancecited by 102
- 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
- 2017Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networkcited by 92
- 2019Complicated Table Structure Recognitioncited by 91
- 2021Variational Transformer Networks for Layout Generationcited by 88
50 most cited of 142 All 142 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Modelscited by 2
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 1
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligencecited by 0
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding23 Aug 2026
- 2026UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models9 Aug 2026