ICDAR 2021 Competition on Document VisualQuestion Answering
Not on the map. Why?
Abstract (arXiv)
In this report we present results of the ICDAR 2021 edition of the Document Visual Question Challenges. This edition complements the previous tasks on Single Document VQA and Document Collection VQA with a newly introduced on Infographics VQA. Infographics VQA is based on a new dataset of more than 5,000 infographics images and 30,000 question-answer pairs. The winner methods have scored 0.6120 ANLS in Infographics VQA task, 0.7743 ANLSL in Document Collection VQA task and 0.8705 ANLS in Single Document VQA. We present a summary of the datasets used for each task, description of each of the submitted methods and the results and analysis of their performance. A summary of the progress made on Single Document VQA since the first edition of the DocVQA 2020 challenge is also presented.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 30 of its 41 references that are in the map. First posted on arXiv 10 Nov 2021.
Builds on
30 of 41 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2015VQA: Visual Question Answeringcited by 2,506
- 2019Towards VQA Models That Can Readcited by 1,718
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
18 more
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
- 2021InfographicVQAcited by 437
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
- 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 340
- 2019Scene Text Visual Question Answeringcited by 331
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
- 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 236
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2019StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understandingcited by 109
- 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
- 2019GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answeringcited by 78
- 2017Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challengecited by 76
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2019LEAF-QA: Locate, Encode & Attend for Figure Question Answeringcited by 54
- 2019ICDAR 2019 Competition on Scene Text Visual Question Answeringcited by 46
- 2021Document Collection Visual Question Answeringcited by 45
- 2020Document Visual Question Answering Challenge 2020cited by 20
- 2020Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCapscited by 18
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 4; 2024: 5; 2025: 2; 2026: 2.
19 papers.
Sort:
By area:
- 2021OCR-free Document Understanding Transformercited by 407
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
- 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 105
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2023Privacy-Aware Document Visual Question Answeringcited by 17
- 2022VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classificationcited by 14
- 2023RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logiccited by 8
- 2022On Web-based Visual Corpus Construction for Visual Document Understandingcited by 5
- 2023Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Modelscited by 4
- 2024TreeForm: End-to-end Annotation and Evaluation for Form Document Parsingcited by 3
- 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answeringcited by 3
- 2024Instruction Makes a Differencecited by 2
7 more
- 2024NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQAcited by 2
- 2024Federated Document Visual Question Answering: A Pilot Studycited by 1
- 2024DistilDoc: Knowledge Distillation for Visually-Rich Document Applicationscited by 1
- 2025KIEval: Evaluation Metric for Document Key Information Extractioncited by 1
- 2022One-Shot Doc Snippet Detection: Powering Search in Document Beyond Textcited by 0
- 2025Preserving Privacy Without Compromising Accuracy: Machine Unlearning for Handwritten Text Recognitioncited by 0
- 2026TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Examscited by 0
- 2026TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams15 Jul 2026
- 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering8 Jul 2026
- 2025Preserving Privacy Without Compromising Accuracy: Machine Unlearning for Handwritten Text Recognition11 Apr 2025
- 2025KIEval: Evaluation Metric for Document Key Information Extraction7 Mar 2025
- 2024NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA6 Nov 2024
- 2024DistilDoc: Knowledge Distillation for Visually-Rich Document Applications12 Jun 2024
- 2024Federated Document Visual Question Answering: A Pilot Study10 May 2024
- 2024TreeForm: End-to-end Annotation and Evaluation for Form Document Parsing7 Feb 2024
- 2024Instruction Makes a Difference1 Feb 2024
- 2023Privacy-Aware Document Visual Question Answering15 Dec 2023
- 2023RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logic3 Aug 2023
- 2023Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Models24 May 2023
7 more
- 2023Document Understanding Dataset and Evaluation (DUDE)15 May 2023
- 2022Hierarchical multimodal transformers for Multi-Page DocVQA7 Dec 2022
- 2022On Web-based Visual Corpus Construction for Visual Document Understanding7 Nov 2022
- 2022One-Shot Doc Snippet Detection: Powering Search in Document Beyond Text12 Sep 2022
- 2022VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classification24 May 2022
- 2022OCR-IDL: OCR Annotations for Industry Document Library Dataset25 Feb 2022
- 2021OCR-free Document Understanding Transformer30 Nov 2021
- 2021OCR-free Document Understanding Transformercited by 407
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
- 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 105
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2023Privacy-Aware Document Visual Question Answeringcited by 17
- 2022VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classificationcited by 14
- 2023RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logiccited by 8
- 2022On Web-based Visual Corpus Construction for Visual Document Understandingcited by 5
- 2023Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Modelscited by 4
- 2024TreeForm: End-to-end Annotation and Evaluation for Form Document Parsingcited by 3
- 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answeringcited by 3
- 2024Instruction Makes a Differencecited by 2
12 most cited of 16 All 16 (JSON)
- 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering8 Jul 2026
- 2025KIEval: Evaluation Metric for Document Key Information Extraction7 Mar 2025
- 2024NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA6 Nov 2024
- 2024Federated Document Visual Question Answering: A Pilot Study10 May 2024
- 2024TreeForm: End-to-end Annotation and Evaluation for Form Document Parsing7 Feb 2024
- 2024Instruction Makes a Difference1 Feb 2024
- 2023Privacy-Aware Document Visual Question Answering15 Dec 2023
- 2023RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logic3 Aug 2023
- 2023Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Models24 May 2023
- 2023Document Understanding Dataset and Evaluation (DUDE)15 May 2023
- 2022Hierarchical multimodal transformers for Multi-Page DocVQA7 Dec 2022
- 2022On Web-based Visual Corpus Construction for Visual Document Understanding7 Nov 2022
12 newest of 16 All 16 (JSON)