mlsanityData to 14 Oct 2026

FormStruct-Bench:A Hierarchical and Diagnostic Benchmark for Table-Form Document Structure Recognition

arXiv 2608.10396 ↗First posted 11 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Transforming table-form documents into machine-processable records requires recovering not only their visible content but also the multilevel structure that organizes it. However, existing benchmarks evaluate either holistic document outputs or conventional table grids, and their aggregate scores provide little insight into where structural failures occur. We introduce FormStruct-Bench, a hierarchical and diagnostic benchmark that evaluates table-form document structure recognition at both the document level and progressively finer component levels, allowing aggregate performance to be traced back to specific structural failure modes. To construct auditable ground truth at scale, we annotate 70 reusable templates and expand them into 7,000 verified instances through a provenance-preserving Director--Artist--Verifier pipeline; all 1,100 instances in the template-disjoint test set additionally receive human review. Our evaluation protocol uses five primary metrics and three structure-specific diagnostics across page, schema, and component levels, together with slices over difficulty, structural constraints, and visual degradation. Across 14 API-hosted and locally deployable systems plus two SFT variants, the best document-level score reaches 83.85%, whereas the best reported fine-grained structural score remains below 18%. These results reveal a pronounced gap between reading document content and recovering the hierarchy and regional organization required for reliable table-form understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

21 of 39 references.

References · 21

  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  2. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  3. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  4. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  5. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  6. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
  7. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
  8. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 256
  9. 2019Image-based table recognition: data, model, and evaluationcited by 237
  10. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 150
  11. 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 148
  12. 2021PubTables-1M: Towards comprehensive table extraction from unstructured documentscited by 126
9 more
  1. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  2. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 74
  3. 2022FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extractioncited by 64
  4. 2022GriTS: Grid table similarity metric for table structure recognitioncited by 28
  5. 2026PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Trainingcited by 21
  6. 2024Image2Struct: Benchmarking Structure Extraction for Vision-Language Modelscited by 19
  7. 2021Multi-Modal Association based Grouping for Form Structure Extractioncited by 6
  8. 2026VAREX: A Benchmark for Multi-Modal Structured Extraction from Documentscited by 4
  9. 2024SRFUND: A Multi-Granularity Hierarchical Structure Reconstruction Benchmark in Form Understandingcited by 2

Built on by

Not cited yet.