Document Collection Visual Question Answering
Not on the map. Why?
Abstract (arXiv)
Current tasks and methods in Document Understanding aims to process documents as single elements. However, documents are usually organized in collections (historical records, purchase invoices), that provide context useful for their interpretation. To address this problem, we introduce Document Collection Visual Question Answering (DocCVQA) a new dataset and related task, where questions are posed over a whole collection of document images and the goal is not only to provide the answer to the given question, but also to retrieve the set of documents that contain the information needed to infer the answer. Along with the dataset we propose a new evaluation metric and baselines which provide further insights to the new dataset and task.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Apr 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 7; 2024: 18; 2025: 12; 2026: 4.
45 papers.
Sort:
By area:
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
- 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 175
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
- 2024Benchmarking and Improving Detail Image Captioncited by 81
- 2024CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Expertscited by 56
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagramcited by 55
- 2024Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmarkcited by 53
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understandingcited by 25
- 2023u-LLaVA: Unifying Multi-Modal Tasks via Large Language Modelcited by 24
33 more
- 2023LANS: A Layout-Aware Neural Solver for Plane Geometry Problemcited by 23
- 2024GRAM: Global Reasoning for Multi-Page VQAcited by 23
- 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understandingcited by 23
- 2024MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuningcited by 22
- 2022Watching the News: Towards VideoQA Models that can Readcited by 20
- 2024Lyra: An Efficient and Speech-Centric Framework for Omni-Cognitioncited by 20
- 2021ICDAR 2021 Competition on Document VisualQuestion Answeringcited by 19
- 2024Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignmentcited by 19
- 2023Privacy-Aware Document Visual Question Answeringcited by 17
- 2024World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filteringcited by 14
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagramcited by 13
- 2023Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answeringcited by 10
- 2024ANLS* -- A Universal Document Processing Metric for Generative Large Language Modelscited by 10
- 2024JDocQA: Japanese Document Question Answering Dataset for Generative Language Modelscited by 9
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformercited by 8
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answeringcited by 7
- 2025Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognitioncited by 7
- 2025Vision-Speech Models: Teaching Speech Models to Converse about Imagescited by 4
- 2025Where is this coming from? Making groundedness count in the evaluation of Document VQA modelscited by 4
- 2024FILA: Fine-Grained Vision Language Modelscited by 3
- 2025NoTeS-Bank: Benchmarking Neural Transcription and Search for Scientific Notes Understandingcited by 3
- 2025Top-Down Compression: Revisit Efficient Vision Token Projection for Visual Instruction Tuningcited by 3
- 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generationcited by 3
- 2025SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understandingcited by 3
- 2024NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQAcited by 2
- 2025Enhancing Document VQA Models via Retrieval-Augmented Generationcited by 2
- 2025EncouRAGe: Evaluating RAG Local, Fast, and Reliablecited by 2
- 2025FPBench: A Comprehensive Benchmark of Multimodal Large Language Models for Fingerprint Analysiscited by 1
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Modelscited by 1
- 2025Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmarkcited by 0
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QAcited by 0
- 2026Do MLLMs Really Understand Low-Resource Khmer Documents? A Pilot Study on Khmer Document VQAcited by 0
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligencecited by 0
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026Do MLLMs Really Understand Low-Resource Khmer Documents? A Pilot Study on Khmer Document VQA8 Aug 2026
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA10 Feb 2026
- 2025FPBench: A Comprehensive Benchmark of Multimodal Large Language Models for Fingerprint Analysis19 Dec 2025
- 2025EncouRAGe: Evaluating RAG Local, Fast, and Reliable31 Oct 2025
- 2025SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understanding30 Oct 2025
- 2025Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark22 Oct 2025
- 2025Enhancing Document VQA Models via Retrieval-Augmented Generation26 Aug 2025
- 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generation4 Jun 2025
- 2025Top-Down Compression: Revisit Efficient Vision Token Projection for Visual Instruction Tuning17 May 2025
- 2025NoTeS-Bank: Benchmarking Neural Transcription and Search for Scientific Notes Understanding12 Apr 2025
33 more
- 2025Where is this coming from? Making groundedness count in the evaluation of Document VQA models24 Mar 2025
- 2025Vision-Speech Models: Teaching Speech Models to Converse about Images19 Mar 2025
- 2025Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognition16 Mar 2025
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documents15 Jan 2025
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer18 Dec 2024
- 2024Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition12 Dec 2024
- 2024FILA: Fine-Grained Vision Language Models11 Dec 2024
- 2024NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA6 Nov 2024
- 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding2 Nov 2024
- 2024World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering30 Sep 2024
- 2024Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark18 Jul 2024
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagram10 Jul 2024
- 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understanding6 Jul 2024
- 2024MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning25 Jun 2024
- 2024Benchmarking and Improving Detail Image Caption29 May 2024
- 2024Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment28 May 2024
- 2024CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts9 May 2024
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answering19 Apr 2024
- 2024JDocQA: Japanese Document Question Answering Dataset for Generative Language Models28 Mar 2024
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models27 Mar 2024
- 2024ANLS* -- A Universal Document Processing Metric for Generative Large Language Models6 Feb 2024
- 2024GRAM: Global Reasoning for Multi-Page VQA7 Jan 2024
- 2023Privacy-Aware Document Visual Question Answering15 Dec 2023
- 2023LANS: A Layout-Aware Neural Solver for Plane Geometry Problem25 Nov 2023
- 2023u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model9 Nov 2023
- 2023Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answering29 Jun 2023
- 2023Document Understanding Dataset and Evaluation (DUDE)15 May 2023
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagram22 Feb 2023
- 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images12 Jan 2023
- 2022Hierarchical multimodal transformers for Multi-Page DocVQA7 Dec 2022
- 2022Watching the News: Towards VideoQA Models that can Read10 Nov 2022
- 2022OCR-IDL: OCR Annotations for Industry Document Library Dataset25 Feb 2022
- 2021ICDAR 2021 Competition on Document VisualQuestion Answering10 Nov 2021
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
- 2024CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Expertscited by 56
- 2024Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmarkcited by 53
- 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understandingcited by 25
- 2023u-LLaVA: Unifying Multi-Modal Tasks via Large Language Modelcited by 24
- 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understandingcited by 23
- 2024MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuningcited by 22
- 2024Lyra: An Efficient and Speech-Centric Framework for Omni-Cognitioncited by 20
- 2024Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignmentcited by 19
- 2024World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filteringcited by 14
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformercited by 8
- 2025Vision-Speech Models: Teaching Speech Models to Converse about Imagescited by 4
12 most cited of 17 All 17 (JSON)
- 2026Do MLLMs Really Understand Low-Resource Khmer Documents? A Pilot Study on Khmer Document VQA8 Aug 2026
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2025FPBench: A Comprehensive Benchmark of Multimodal Large Language Models for Fingerprint Analysis19 Dec 2025
- 2025Enhancing Document VQA Models via Retrieval-Augmented Generation26 Aug 2025
- 2025Vision-Speech Models: Teaching Speech Models to Converse about Images19 Mar 2025
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer18 Dec 2024
- 2024Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition12 Dec 2024
- 2024FILA: Fine-Grained Vision Language Models11 Dec 2024
- 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding2 Nov 2024
- 2024World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering30 Sep 2024
- 2024Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark18 Jul 2024
- 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understanding6 Jul 2024
12 newest of 17 All 17 (JSON)
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagramcited by 55
- 2023LANS: A Layout-Aware Neural Solver for Plane Geometry Problemcited by 23
- 2024GRAM: Global Reasoning for Multi-Page VQAcited by 23
- 2022Watching the News: Towards VideoQA Models that can Readcited by 20
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagramcited by 13
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagram10 Jul 2024
- 2024GRAM: Global Reasoning for Multi-Page VQA7 Jan 2024
- 2023LANS: A Layout-Aware Neural Solver for Plane Geometry Problem25 Nov 2023
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagram22 Feb 2023
- 2022Watching the News: Towards VideoQA Models that can Read10 Nov 2022
- 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 175
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
- 2024Benchmarking and Improving Detail Image Captioncited by 81
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
- 2022OCR-IDL: OCR Annotations for Industry Document Library Datasetcited by 35
- 2021ICDAR 2021 Competition on Document VisualQuestion Answeringcited by 19
- 2023Privacy-Aware Document Visual Question Answeringcited by 17
- 2023Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answeringcited by 10
- 2024ANLS* -- A Universal Document Processing Metric for Generative Large Language Modelscited by 10
- 2024JDocQA: Japanese Document Question Answering Dataset for Generative Language Modelscited by 9
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answeringcited by 7
12 most cited of 18 All 18 (JSON)
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2025Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark22 Oct 2025
- 2025Top-Down Compression: Revisit Efficient Vision Token Projection for Visual Instruction Tuning17 May 2025
- 2025NoTeS-Bank: Benchmarking Neural Transcription and Search for Scientific Notes Understanding12 Apr 2025
- 2025Where is this coming from? Making groundedness count in the evaluation of Document VQA models24 Mar 2025
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documents15 Jan 2025
- 2024NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA6 Nov 2024
- 2024Benchmarking and Improving Detail Image Caption29 May 2024
- 2024PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answering19 Apr 2024
- 2024JDocQA: Japanese Document Question Answering Dataset for Generative Language Models28 Mar 2024
- 2024ANLS* -- A Universal Document Processing Metric for Generative Large Language Models6 Feb 2024
- 2023Privacy-Aware Document Visual Question Answering15 Dec 2023
12 newest of 18 All 18 (JSON)