mlsanityData to 14 Oct 2026

μgat: Improving Single-Page Document Parsing by Providing Multi-Page Context

arXiv 2408.15646 ↗First posted 28 Aug 2024cs.CV cs.DLcited by 7

Not on the map. Why?

Abstract (arXiv)

Regesta are catalogs of summaries of other documents and, in some cases, are the only source of information about the content of such full-length documents. For this reason, they are of great interest to scholars in many social and humanities fields. In this work, we focus on Regesta Pontificum Romanum, a large collection of papal registers. Regesta are visually rich documents, where the layout is as important as the text content to convey the contained information through the structure, and are inherently multi-page documents. Among Digital Humanities techniques that can help scholars efficiently exploit regesta and other documental sources in the form of scanned documents, Document Parsing has emerged as a task to process document images and convert them into machine-readable structured representations, usually markup language. However, current models focus on scientific and business documents, and most of them consider only single-paged documents. To overcome this limitation, in this work, we propose μgat, an extension of the recently proposed Document parsing Nougat architecture, which can handle elements spanning over the single page limits. Specifically, we adapt Nougat to process a larger, multi-page context, consisting of the previous and the following page, while parsing the current page. Experimental results, both qualitative and quantitative, demonstrate the effectiveness of our proposed approach also in the case of the challenging Regesta Pontificum Romanorum.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 28 Aug 2024.

Builds on

33 of 39 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  7. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  8. 2022Galactica: A Large Language Model for Sciencecited by 744
  9. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  10. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  11. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  12. 2021OCR-free Document Understanding Transformercited by 407
21 more
  1. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
  2. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  3. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
  4. 2021DocFormer: End-to-End Transformer for Document Understandingcited by 256
  5. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
  6. 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 213
  7. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 153
  8. 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
  9. 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
  10. 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
  11. 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 105
  12. 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 96
  13. 2022End-to-end Document Recognition and Understanding with Dessurtcited by 73
  14. 2021LaTr: Layout-Aware Transformer for Scene-Text VQAcited by 72
  15. 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
  16. 2023DocFormerv2: Local Features for Document Understandingcited by 46
  17. 2024GRAM: Global Reasoning for Multi-Page VQAcited by 23
  18. 2023CCpdf: Building a High Quality Corpus for Visually Rich Documents from Web Crawl Datacited by 21
  19. 2023Beyond Document Page Classification: Design, Datasets, and Challengescited by 10
  20. 2024Multi-Page Document Visual Question Answering using Self-Attention Scoring Mechanismcited by 8
  21. 2024LOCR: Location-Guided Transformer for Optical Character Recognitioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.