mlsanityData to 7 Oct 2026

Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence

arXiv 2601.12318 ↗First posted 18 Jan 2026cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

The advancement of Document Intelligence (DI) demands large-scale, high-quality training data, yet manual annotation remains a critical bottleneck. While data generation methods are evolving rapidly, existing surveys are constrained by fragmented focuses on single modalities or specific tasks, lacking a unified perspective aligned with real-world workflows. To fill this gap, this survey establishes the first comprehensive technical map for data generation in DI. Data generation is redefined as supervisory signal production, and a novel taxonomy is introduced based on the "availability of data and labels." This framework organizes methodologies into four resource-centric paradigms: Data Augmentation, Data Generation from Scratch, Automated Data Annotation, and Self-Supervised Signal Construction. Furthermore, a multi-level evaluation framework is established to integrate intrinsic quality and extrinsic utility, compiling performance gains across diverse DI benchmarks. Guided by this unified structure, the methodological landscape is dissected to reveal critical challenges such as fidelity gaps and frontiers including co-evolutionary ecosystems. Ultimately, by systematizing this fragmented field, data generation is positioned as the central engine for next-generation DI.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 142 of its 201 references that are in the map. First posted on arXiv 18 Jan 2026.

Builds on

142 of 201 references.

References · 142

  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  2. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  5. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  6. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  7. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  8. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  9. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  10. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
  11. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  12. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
38 more
  1. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
  2. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
  3. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  4. 2019PlotQA: Reasoning over Scientific Plotscited by 317
  5. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 314
  6. 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 272
  7. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
  8. 2019Image-based table recognition: data, model, and evaluationcited by 233
  9. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  10. 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
  11. 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
  12. 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
  13. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  14. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
  15. 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
  16. 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 149
  17. 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
  18. 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 144
  19. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
  20. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
  21. 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
  22. 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
  23. 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
  24. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
  25. 2023ChartBench: A Benchmark for Complex Visual Reasoning in Chartscited by 116
  26. 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
  27. 2021A Survey on Data Augmentation for Text Classificationcited by 111
  28. 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
  29. 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
  30. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  31. 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
  32. 2023Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performancecited by 102
  33. 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
  34. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
  35. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
  36. 2017Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networkcited by 92
  37. 2019Complicated Table Structure Recognitioncited by 91
  38. 2021Variational Transformer Networks for Layout Generationcited by 88

50 most cited of 142 All 142 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.