mlsanityData to 14 Oct 2026

VKIE: The Application of Key Information Extraction on Video Text

arXiv 2310.11650 ↗First posted 18 Oct 2023cs.IR cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Extracting structured information from videos is critical for numerous downstream applications in the industry. In this paper, we define a significant task of extracting hierarchical key information from visual texts on videos. To fulfill this task, we decouple it into four subtasks and introduce two implementation solutions called PipVKIE and UniVKIE. PipVKIE sequentially completes the four subtasks in continuous stages, while UniVKIE is improved by unifying all the subtasks into one backbone. Both PipVKIE and UniVKIE leverage multimodal information from vision, text, and coordinates for feature representation. Extensive experiments on one well-defined dataset demonstrate that our solutions can achieve remarkable performance and efficient inference speed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 18 Oct 2023.

Builds on

16 of 23 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2017Mask R-CNNcited by 7,277
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  7. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  8. 2016Neural Architectures for Named Entity Recognitioncited by 550
  9. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  10. 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
  11. 2021BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documentscited by 104
  12. 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
4 more
  1. 2018Rotation-Sensitive Regression for Oriented Scene Text Detectioncited by 88
  2. 2016Detecting Text in Natural Image with Connectionist Text Proposal Networkcited by 85
  3. 2020Multi-Task Learning for Dense Prediction Tasks: A Surveycited by 28
  4. 2017Do Convolutional Networks need to be Deep for Text Classification ?cited by 11

Built on by

Not cited yet.