UnSupDLA: Towards Unsupervised Document Layout Analysis
Not on the map. Why?
Abstract (arXiv)
Document layout analysis is a key area in document research, involving techniques like text mining and visual analysis. Despite various methods developed to tackle layout analysis, a critical but frequently overlooked problem is the scarcity of labeled data needed for analyses. With the rise of internet use, an overwhelming number of documents are now available online, making the process of accurately labeling them for research purposes increasingly challenging and labor-intensive. Moreover, the diversity of documents online presents a unique set of challenges in maintaining the quality and consistency of these labels, further complicating document layout analysis in the digital era. To address this, we employ a vision-based approach for analyzing document layouts designed to train a network without labels. Instead, we focus on pre-training, initially generating simple object masks from the unlabeled document images. These masks are then used to train a detector, enhancing object detection and segmentation performance. The model's effectiveness is further amplified through several unsupervised training iterations, continuously refining its performance. This approach significantly advances document layout analysis, particularly precision and efficiency, without labels.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 58 of its 90 references that are in the map. First posted on arXiv 10 Jun 2024.
Builds on
58 of 90 references.
References · 58
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Mask R-CNNcited by 7,259
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
38 more
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2021OCR-free Document Understanding Transformercited by 400
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
- 2021DocFormer: End-to-End Transformer for Document Understandingcited by 254
- 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
- 2021You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detectioncited by 170
- 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
- 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
- 2017Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networkcited by 92
- 2022Unified Pretraining Framework for Document Understandingcited by 85
- 2021Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layoutscited by 82
- 2022Object discovery and representation networkscited by 80
- 2021DETReg: Unsupervised Pretraining with Region Priors for Object Detectioncited by 76
- 2022End-to-end Document Recognition and Understanding with Dessurtcited by 73
- 2020Self-EMD: Self-Supervised Object Detection without ImageNetcited by 70
- 2021LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysiscited by 58
- 2023Vision Grid Transformer for Document Layout Analysiscited by 45
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2021VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relationscited by 40
- 2022Content and Style Aware Generation of Text-line Images for Handwriting Recognitioncited by 35
- 2020A Large Dataset of Historical Japanese Documents with Complex Layoutscited by 24
- 2020CDeC-Net: Composite Deformable Cascade Network for Table Detection in Document Imagescited by 22
- 2023Object Detection with Transformers: A Reviewcited by 22
- 2021DocSynth: A Layout Guided Approach for Controllable Document Image Synthesiscited by 17
- 2022Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networkscited by 17
- 2021Guided Table Structure Recognition through Anchor Optimizationcited by 15
- 2017Real-Time Document Image Classification using Deep CNN and Extreme Learning Machinescited by 14
- 2023SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentationcited by 13
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2024: 2.
2 papers.