mlsanityData to 7 Oct 2026

UnSupDLA: Towards Unsupervised Document Layout Analysis

arXiv 2406.06236 ↗First posted 10 Jun 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Document layout analysis is a key area in document research, involving techniques like text mining and visual analysis. Despite various methods developed to tackle layout analysis, a critical but frequently overlooked problem is the scarcity of labeled data needed for analyses. With the rise of internet use, an overwhelming number of documents are now available online, making the process of accurately labeling them for research purposes increasingly challenging and labor-intensive. Moreover, the diversity of documents online presents a unique set of challenges in maintaining the quality and consistency of these labels, further complicating document layout analysis in the digital era. To address this, we employ a vision-based approach for analyzing document layouts designed to train a network without labels. Instead, we focus on pre-training, initially generating simple object masks from the unlabeled document images. These masks are then used to train a detector, enhancing object detection and segmentation performance. The model's effectiveness is further amplified through several unsupervised training iterations, continuously refining its performance. This approach significantly advances document layout analysis, particularly precision and efficiency, without labels.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 58 of its 90 references that are in the map. First posted on arXiv 10 Jun 2024.

Builds on

58 of 90 references.

References · 58

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2017Mask R-CNNcited by 7,259
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  10. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  12. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
38 more
  1. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  2. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  3. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
  4. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  5. 2021OCR-free Document Understanding Transformercited by 400
  6. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  7. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  8. 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
  9. 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
  10. 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
  11. 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
  12. 2021You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detectioncited by 170
  13. 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
  14. 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
  15. 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
  16. 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
  17. 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
  18. 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
  19. 2017Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networkcited by 92
  20. 2022Unified Pretraining Framework for Document Understandingcited by 85
  21. 2021Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layoutscited by 82
  22. 2022Object discovery and representation networkscited by 80
  23. 2021DETReg: Unsupervised Pretraining with Region Priors for Object Detectioncited by 76
  24. 2022End-to-end Document Recognition and Understanding with Dessurtcited by 73
  25. 2020Self-EMD: Self-Supervised Object Detection without ImageNetcited by 70
  26. 2021LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysiscited by 58
  27. 2023Vision Grid Transformer for Document Layout Analysiscited by 45
  28. 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
  29. 2021VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relationscited by 40
  30. 2022Content and Style Aware Generation of Text-line Images for Handwriting Recognitioncited by 35
  31. 2020A Large Dataset of Historical Japanese Documents with Complex Layoutscited by 24
  32. 2020CDeC-Net: Composite Deformable Cascade Network for Table Detection in Document Imagescited by 22
  33. 2023Object Detection with Transformers: A Reviewcited by 22
  34. 2021DocSynth: A Layout Guided Approach for Controllable Document Image Synthesiscited by 17
  35. 2022Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networkscited by 17
  36. 2021Guided Table Structure Recognition through Anchor Optimizationcited by 15
  37. 2017Real-Time Document Image Classification using Deep CNN and Extreme Learning Machinescited by 14
  38. 2023SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentationcited by 13

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.