A Scalable Framework for Table of Contents Extraction from Complex ESG Annual Reports
Not on the map. Why?
Abstract (arXiv)
Table of contents (ToC) extraction centres on structuring documents in a hierarchical manner. In this paper, we propose a new dataset, ESGDoc, comprising 1,093 ESG annual reports from 563 companies spanning from 2001 to 2022. These reports pose significant challenges due to their diverse structures and extensive length. To address these challenges, we propose a new framework for Toc extraction, consisting of three steps: (1) Constructing an initial tree of text blocks based on reading order and font sizes; (2) Modelling each tree node (or text block) independently by considering its contextual information captured in node-centric subtree; (3) Modifying the original tree by taking appropriate action on each tree node (Keep, Delete, or Move). This construction-modelling-modification (CMM) process offers several benefits. It eliminates the need for pairwise modelling of section headings as in previous approaches, making document segmentation practically feasible. By incorporating structured information, each section heading can leverage both local and long-distance context relevant to itself. Experimental results show that our approach outperforms the previous state-of-the-art baseline with a fraction of running time. Our framework proves its scalability by effectively handling documents of any length.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 27 Oct 2023.
Builds on
20 of 28 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Graph Attention Networkscited by 8,854
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
8 more
- 2022XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understandingcited by 68
- 2022ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understandingcited by 67
- 2022FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extractioncited by 64
- 2021VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relationscited by 40
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
- 2023FormNetV2: Multimodal Graph Contrastive Learning for Form Document Information Extractioncited by 20
- 2022PP-StructureV2: A Stronger Document Analysis Systemcited by 18
- 2022Multimodal Tree Decoder for Table of Contents Extraction in Document Imagescited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.