HybriDLA: Hybrid Generation for Document Layout Analysis
Not on the map. Why?
Abstract (arXiv)
Conventional document layout analysis (DLA) traditionally depends on empirical priors or a fixed set of learnable queries executed in a single forward pass. While sufficient for early-generation documents with a small, predetermined number of regions, this paradigm struggles with contemporary documents, which exhibit diverse element counts and increasingly complex layouts. To address challenges posed by modern documents, we present HybriDLA, a novel generative framework that unifies diffusion and autoregressive decoding within a single layer. The diffusion component iteratively refines bounding-box hypotheses, whereas the autoregressive component injects semantic and contextual awareness, enabling precise region prediction even in highly varied layouts. To further enhance detection quality, we design a multi-scale feature-fusion encoder that captures both fine-grained and high-level visual cues. This architecture elevates performance to 83.5% mean Average Precision (mAP). Extensive experiments on the DocLayNet and M6Doc benchmarks demonstrate that HybriDLA sets a state-of-the-art performance, outperforming previous approaches. All data and models will be made publicly available at https://yufanchen96.github.io/projects/HybriDLA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 48 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
39 of 48 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
27 more
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2022A Unified Sequence Interface for Vision Taskscited by 152
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2022LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understandingcited by 107
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
- 2022ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understandingcited by 67
- 2022DAN: a Segmentation-free Document Attention Network for Handwritten Document Recognitioncited by 62
- 2023M6Doc: A Large-Scale Multi-Format, Multi-Type, Multi-Layout, Multi-Language, Multi-Annotation Category Dataset for Modern Document Layout Analysiscited by 44
- 2021VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relationscited by 40
- 2020A Large Dataset of Historical Japanese Documents with Complex Layoutscited by 24
- 2022DocSegTr: An Instance-Level End-to-End Document Image Segmentation Transformercited by 19
- 2022Bi-VLDoc: Bidirectional Vision-Language Modeling for Visually-Rich Document Understandingcited by 18
- 2023BaDLAD: A Large Multi-Domain Bengali Document Layout Analysis Datasetcited by 13
- 2024DLAFormer: An End-to-End Transformer For Document Layout Analysiscited by 11
- 2024DANIEL: A fast Document Attention Network for Information Extraction and Labelling of handwritten documentscited by 9
- 2024SAIL: Sample-Centric In-Context Learning for Document Information Extractioncited by 6
- 2023Line Graphics Digitization: A Step Towards Full Automationcited by 5
- 2024ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Datacited by 5
Built on by
Not cited yet.