mlsanityData to 7 Oct 2026

DeepCPCFG: Deep Learning and Context Free Grammars for End-to-End Information Extraction

arXiv 2103.05908 ↗First posted 10 Mar 2021cs.CL cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We address the challenge of extracting structured information from business documents without detailed annotations. We propose Deep Conditional Probabilistic Context Free Grammars (DeepCPCFG) to parse two-dimensional complex documents and use Recursive Neural Networks to create an end-to-end system for finding the most probable parse that represents the structured information to be extracted. This system is trained end-to-end with scanned documents as input and only relational-records as labels. The relational-records are extracted from existing databases avoiding the cost of annotating documents by hand. We apply this approach to extract information from scanned invoices achieving state-of-the-art results despite using no hand-annotations.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 48 references that are in the map. First posted on arXiv 10 Mar 2021.

Builds on

23 of 48 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  5. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  6. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  7. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  8. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  9. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
  10. 2019Image-based table recognition: data, model, and evaluationcited by 233
  11. 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
  12. 2018Chargrid: Towards Understanding 2D Documentscited by 100
11 more
  1. 2020PICK: Processing Key Information Extraction from Documents using Improved Graph Learning-Convolutional Networkscited by 70
  2. 2020Spatial Dependency Parsing for Semi-Structured Document Information Extractioncited by 65
  3. 2019BERTgrid: Contextualized Embedding for 2D Document Representation and Understandingcited by 63
  4. 2019Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Autoencoderscited by 60
  5. 2020Torch-Struct: Deep Structured Prediction Librarycited by 40
  6. 2017End-to-End Learning for Structured Prediction Energy Networkscited by 33
  7. 2020A Survey of Deep Learning Approaches for OCR and Document Understandingcited by 32
  8. 2020Kleister: A novel task for Information Extraction involving Long Documents with Complex Layoutcited by 27
  9. 2019CUTIE: Learning to Understand Documents with Convolutional Universal Text Information Extractorcited by 21
  10. 2019Tree-Transformer: A Transformer-Based Method for Correction of Tree-Structured Datacited by 20
  11. 2018Deep Structured Prediction with Nonlinear Output Transformationscited by 12

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2.

3 papers.