HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structures
Not on the map. Why?
Abstract (arXiv)
The problem of document structure reconstruction refers to converting digital or scanned documents into corresponding semantic structures. Most existing works mainly focus on splitting the boundary of each element in a single document page, neglecting the reconstruction of semantic structure in multi-page documents. This paper introduces hierarchical reconstruction of document structures as a novel task suitable for NLP and CV fields. To better evaluate the system performance on the new task, we built a large-scale dataset named HRDoc, which consists of 2,500 multi-page documents with nearly 2 million semantic units. Every document in HRDoc has line-level annotations including categories and relations obtained from rule-based extractors and human annotators. Moreover, we proposed an encoder-decoder-based hierarchical document structure parsing system (DSPS) to tackle this problem. By adopting a multi-modal bidirectional encoder and a structure-aware GRU decoder with soft-mask operation, the DSPS model surpass the baseline method by a large margin. All scripts and datasets will be made publicly available at https://github.com/jfma-USTC/HRDoc.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 24 Mar 2023.
Builds on
14 of 31 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Mask R-CNNcited by 7,277
- 2016Layer Normalizationcited by 5,669
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 153
- 2021Document AI: Benchmarks, Models and Applicationscited by 62
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 5; 2026: 11.
23 papers.
Sort:
By area:
- 2024Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysiscited by 15
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
- 2024DLAFormer: An End-to-End Transformer For Document Layout Analysiscited by 11
- 2023DSG: An End-to-End Document Structure Generatorcited by 7
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answeringcited by 7
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6
- 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
- 2024DocMamba: Efficient Document Pre-training with State Space Modelcited by 3
- 2025UniHDSA: A Unified Relation Prediction Approach for Hierarchical Document Structure Analysiscited by 3
- 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answeringcited by 3
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extractioncited by 2
11 more
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 2
- 2023Count, Decode and Fetch: A New Approach to Handwritten Chinese Character Error Correctioncited by 1
- 2025AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorizationcited by 1
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 1
- 2025TextBite: A Historical Czech Document Dataset for Logical Page Segmentationcited by 0
- 2026PromptDLA: A Domain-aware Prompt Document Layout Analysis Framework with Descriptive Knowledge as a Cuecited by 0
- 2026M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Modelscited by 0
- 2026DOSA: A Tree-Guided, Self-Regressive Framework for Long Document Structure Analysiscited by 0
- 2026LongDocBench: Benchmarking TOC Hierarchy and Contextual Relationship Recovery in Long Documentscited by 0
- 2026Robust Hierarchical Structures for Agentic Document Analysiscited by 0
- 2026Heading Hierarchy Reconstruction for Complex and Long Documents with Level-Wise Multimodal Memorycited by 0
- 2026Heading Hierarchy Reconstruction for Complex and Long Documents with Level-Wise Multimodal Memory13 Oct 2026
- 2026Robust Hierarchical Structures for Agentic Document Analysis27 Sep 2026
- 2026LongDocBench: Benchmarking TOC Hierarchy and Contextual Relationship Recovery in Long Documents15 Aug 2026
- 2026DOSA: A Tree-Guided, Self-Regressive Framework for Long Document Structure Analysis11 Jul 2026
- 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering28 May 2026
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing24 May 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Models17 Apr 2026
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documents14 Apr 2026
- 2026PromptDLA: A Domain-aware Prompt Document Layout Analysis Framework with Descriptive Knowledge as a Cue10 Mar 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extraction11 Dec 2025
11 more
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization28 Mar 2025
- 2025TextBite: A Historical Czech Document Dataset for Logical Page Segmentation20 Mar 2025
- 2025UniHDSA: A Unified Relation Prediction Approach for Hierarchical Document Structure Analysis20 Mar 2025
- 2024DocMamba: Efficient Document Pre-training with State Space Model18 Sep 2024
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extraction8 Sep 2024
- 2024DLAFormer: An End-to-End Transformer For Document Layout Analysis20 May 2024
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answering19 Apr 2024
- 2024Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysis22 Jan 2024
- 2023DSG: An End-to-End Document Structure Generator13 Oct 2023
- 2023Count, Decode and Fetch: A New Approach to Handwritten Chinese Character Error Correction30 Jul 2023
- 2026Robust Hierarchical Structures for Agentic Document Analysis27 Sep 2026
- 2024Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysiscited by 15
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
- 2024DLAFormer: An End-to-End Transformer For Document Layout Analysiscited by 11
- 2023DSG: An End-to-End Document Structure Generatorcited by 7
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answeringcited by 7
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6
- 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
- 2024DocMamba: Efficient Document Pre-training with State Space Modelcited by 3
- 2025UniHDSA: A Unified Relation Prediction Approach for Hierarchical Document Structure Analysiscited by 3
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extractioncited by 2
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 2
12 most cited of 19 All 19 (JSON)
- 2026LongDocBench: Benchmarking TOC Hierarchy and Contextual Relationship Recovery in Long Documents15 Aug 2026
- 2026DOSA: A Tree-Guided, Self-Regressive Framework for Long Document Structure Analysis11 Jul 2026
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing24 May 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documents14 Apr 2026
- 2026PromptDLA: A Domain-aware Prompt Document Layout Analysis Framework with Descriptive Knowledge as a Cue10 Mar 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2025PubTables-v2: A new large-scale dataset for full-page and multi-page table extraction11 Dec 2025
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025AnnoPage Dataset: Dataset of Non-Textual Elements in Documents with Fine-Grained Categorization28 Mar 2025
- 2025TextBite: A Historical Czech Document Dataset for Logical Page Segmentation20 Mar 2025
- 2025UniHDSA: A Unified Relation Prediction Approach for Hierarchical Document Structure Analysis20 Mar 2025
12 newest of 19 All 19 (JSON)