LongDocBench: Benchmarking TOC Hierarchy and Contextual Relationship Recovery in Long Documents
Not on the map. Why?
Abstract (arXiv)
Parsing visual documents into machine-readable representations is fundamental to document intelligence. Existing benchmarks focus on page-level element recognition, reading order, formula recognition, and table structure. Long documents, however, also require document-level structure recovery. This includes reconstructing cross-page table-of-contents (TOC) hierarchies and identifying typed links from tables and figures to their captions, notes, and sources, often in one-to-many form. Because these structures are covered only partially or subsumed within broader parsing protocols, existing benchmarks cannot directly evaluate two key document-level tasks: Table-of-Contents Hierarchy Recovery and Contextual Relationship Recovery. To benchmark these two tasks, we introduce textscLongDocBench, comprising 85 real-world financial reports, textbooks, and academic papers spanning 2,582 pages, with up to 105 pages per document. It provides human-verified annotations for 3,937 heading nodes (mean node depth 3.55; maximum depth 9) and 3,258 contextual relationships annotated across 2,680 table and figure objects. We further evaluate both the downstream utility and recoverability of these structures. Long-document question-answering experiments show that human-verified TOC hierarchies and contextual relationships improve reasoning, with their combination providing complementary benefits. Meanwhile, representative document parsers remain limited on both recovery tasks despite strong page-level performance. To support further progress, we publicly release textscLongDocBench and its evaluation protocol and reproducible testbed for advancing document-level structure recovery in long documents.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
21 of 27 references.
References · 21
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
- 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 54
9 more
- 2026The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligencecited by 50
- 2023PDFTriage: Question Answering over Long, Structured Documentscited by 29
- 2023HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structurescited by 22
- 2026PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Trainingcited by 20
- 2024READoc: A Unified Benchmark for Realistic Document Structured Extractioncited by 15
- 2025HiChunk: Evaluating and Enhancing Retrieval-Augmented Generation with Hierarchical Chunkingcited by 9
- 2024Document Structure in Long Document Transformerscited by 5
- 2026LingDT-VL-OCR: Structure-Aware Document-Level Parsing with Fine-Grained Visual Referencecited by 1
- 2026MinerU-Popo: Universal Post-Processing Model for Structured Document Parsingcited by 1
Built on by
Not cited yet.