Simple and Effective Multi-Paragraph Reading Comprehension
Not on the map. Why?
Cited by 20 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We consider the problem of adapting neural paragraph-level question answering models to the case where entire documents are given as input. Our proposed solution trains models to produce well calibrated confidence scores for their results on individual paragraphs. We sample multiple paragraphs from the documents during training, and use a shared-normalization training objective that encourages the model to produce globally correct output. We combine this method with a state-of-the-art pipeline for training models on document QA data. Experiments demonstrate strong performance on several document QA datasets. Overall, we are able to achieve a score of 71.3 F1 on the web portion of TriviaQA, a large improvement from the 56.7 F1 of the previous best system.
Key facts. Cited by 120 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 2; 2021: 42; 2022: 19; 2023: 18; 2024: 22; 2025: 13; 2026: 4.
120 papers.
Sort:
By area:
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2023Augmented Language Models: a Surveycited by 403
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 139
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 137
38 more
- 2021End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answeringcited by 133
- 2023Evaluating Open-Domain Question Answering in the Era of Large Language Modelscited by 111
- 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 105
- 2024Unveiling Encoder-Free Vision-Language Modelscited by 94
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
- 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizercited by 80
- 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Informationcited by 65
- 2021Poolingformer: Long Document Modeling with Pooling Attentioncited by 60
- 2024OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textcited by 59
- 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
- 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 45
- 2024LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillationcited by 45
- 2021UnitedQA: A Hybrid Approach for Open Domain Question Answeringcited by 42
- 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Foldingcited by 42
- 2021Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answeringcited by 41
- 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inferencecited by 40
- 2021Evidentiality-guided Generation for Knowledge-Intensive NLP Taskscited by 40
- 2021R2-D2: A Modular Baseline for Open-Domain Question Answeringcited by 37
- 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
- 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 28
- 2021Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answeringcited by 25
- 2021Introspective Distillation for Robust Question Answeringcited by 25
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
- 2022Modeling Multi-hop Question Answering as Single Sequence Predictioncited by 21
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?cited by 20
- 2021Factoring Statutory Reasoning as Language Understanding Challengescited by 20
- 2025Docopilot: Improving Multimodal Models for Document-Level Understandingcited by 19
- 2021Rethinking Search: Making Domain Experts out of Dilettantescited by 18
- 2025From Pixels to Words -- Towards Native Vision-Language Primitives at Scalecited by 18
- 2021UNIQORN: Unified Question Answering over RDF Knowledge Graphs and Natural Language Textcited by 17
- 2021Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matricescited by 17
- 2021DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehensioncited by 16
- 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Modelscited by 16
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2021ReadTwice: Reading Very Large Documents with Memoriescited by 14
50 most cited of 120 All 120 (JSON)
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scale27 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026LiCQA : A Lightweight Complex Question Answering System25 Feb 2026
- 2026LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Models28 Jan 2026
- 2025LocateAnything3D: Vision-Language 3D Detection with Chain-of-Sight25 Nov 2025
- 2025ARGenSeg: Image Segmentation with Autoregressive Image Generation Model23 Oct 2025
- 2025From Pixels to Words -- Towards Native Vision-Language Primitives at Scale16 Oct 2025
- 2025CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs14 Oct 2025
- 2025OmniBridge: Unified Multimodal Understanding, Generation, and Retrieval via Latent Space Alignment23 Sep 2025
- 2025Docopilot: Improving Multimodal Models for Document-Level Understanding19 Jul 2025
- 2025Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Models16 Jul 2025
- 2025CoMemo: LVLMs Need Image Context with Image Memory6 Jun 2025
38 more
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models14 Apr 2025
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar 2025
- 2025ARLED: Leveraging LED-based ARMAN Model for Abstractive Summarization of Persian Long Documents13 Mar 2025
- 2025PP-DocBee: Improving Multimodal Document Understanding Through a Bag of Tricks6 Mar 2025
- 2025RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm18 Feb 2025
- 2024HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding20 Dec 2024
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models12 Dec 2024
- 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Folding12 Dec 2024
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov 2024
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training10 Oct 2024
- 2024LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation28 Aug 2024
- 2024OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Context22 Jul 2024
- 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Models11 Jul 2024
- 2024The Art of Saying No: Contextual Noncompliance in Language Models2 Jul 2024
- 2024It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension24 Jun 2024
- 2024Unveiling Encoder-Free Vision-Language Models17 Jun 2024
- 2024OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text12 Jun 2024
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks12 Jun 2024
- 2024Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQL29 Apr 2024
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites25 Apr 2024
- 2024NL2KQL: From Natural Language to Kusto Query3 Apr 2024
- 2024JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning17 Mar 2024
- 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open World29 Feb 2024
- 2024Improving Video Corpus Moment Retrieval with Partial Relevance Enhancement21 Feb 2024
- 2024Event-aware Video Corpus Moment Retrieval21 Feb 2024
- 2024Unsupervised Learning of Graph from Recipes22 Jan 2024
- 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer18 Jan 2024
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks21 Dec 2023
- 2023Uncertainty Guided Global Memory Improves Multi-Hop Question Answering29 Nov 2023
- 2023Surpassing GPT-4 Medical Coding with a Two-Stage Approach22 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023A Lightweight Method to Generate Unanswerable Questions in English30 Oct 2023
- 2023Low-Resource Clickbait Spoiling for Indonesian via Question Answering12 Oct 2023
- 2023Word Embedding with Neural Probabilistic Prior21 Sep 2023
- 2023Performance Prediction for Multi-hop Questions12 Aug 2023
- 2023Answering Unseen Questions With Smaller Language Models Using Rationale Generation and Dense Retrieval9 Aug 2023
- 2023Single-Sentence Reader: A Novel Approach for Addressing Answer Position Bias8 Aug 2023
- 2023Teaching Smaller Language Models To Generalise To Unseen Compositional Questions2 Aug 2023
50 newest of 120 All 120 (JSON)
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 137
- 2024Unveiling Encoder-Free Vision-Language Modelscited by 94
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
- 2024LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillationcited by 45
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 28
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
- 2025Docopilot: Improving Multimodal Models for Document-Level Understandingcited by 19
- 2025From Pixels to Words -- Towards Native Vision-Language Primitives at Scalecited by 18
- 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Modelscited by 16
- 2025Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Modelscited by 13
12 most cited of 17 All 17 (JSON)
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scale27 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Models28 Jan 2026
- 2025From Pixels to Words -- Towards Native Vision-Language Primitives at Scale16 Oct 2025
- 2025OmniBridge: Unified Multimodal Understanding, Generation, and Retrieval via Latent Space Alignment23 Sep 2025
- 2025Docopilot: Improving Multimodal Models for Document-Level Understanding19 Jul 2025
- 2025Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Models16 Jul 2025
- 2025CoMemo: LVLMs Need Image Context with Image Memory6 Jun 2025
- 2024HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding20 Dec 2024
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models12 Dec 2024
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training10 Oct 2024
- 2024LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation28 Aug 2024
12 newest of 17 All 17 (JSON)
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2021End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answeringcited by 133
- 2021Evidentiality-guided Generation for Knowledge-Intensive NLP Taskscited by 40
- 2024JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuningcited by 2
- 2024JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning17 Mar 2024
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Models5 Aug 2022
- 2021Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks16 Dec 2021
- 2021End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering9 Jun 2021
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May 2020
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb 2020
- 2023Augmented Language Models: a Surveycited by 403
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 139
- 2025CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMscited by 14
- 2023Answering Unseen Questions With Smaller Language Models Using Rationale Generation and Dense Retrievalcited by 1
- 2025CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs14 Oct 2025
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar 2025
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov 2024
- 2023Answering Unseen Questions With Smaller Language Models Using Rationale Generation and Dense Retrieval9 Aug 2023
- 2023Augmented Language Models: a Survey15 Feb 2023
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
- 2023Evaluating Open-Domain Question Answering in the Era of Large Language Modelscited by 111
- 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 105
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
- 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizercited by 80
- 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Informationcited by 65
- 2021Poolingformer: Long Document Modeling with Pooling Attentioncited by 60
- 2024OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textcited by 59
- 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
12 most cited of 91 All 91 (JSON)
- 2026LiCQA : A Lightweight Complex Question Answering System25 Feb 2026
- 2025LocateAnything3D: Vision-Language 3D Detection with Chain-of-Sight25 Nov 2025
- 2025ARGenSeg: Image Segmentation with Autoregressive Image Generation Model23 Oct 2025
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models14 Apr 2025
- 2025ARLED: Leveraging LED-based ARMAN Model for Abstractive Summarization of Persian Long Documents13 Mar 2025
- 2025PP-DocBee: Improving Multimodal Document Understanding Through a Bag of Tricks6 Mar 2025
- 2025RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm18 Feb 2025
- 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Folding12 Dec 2024
- 2024OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Context22 Jul 2024
- 2024The Art of Saying No: Contextual Noncompliance in Language Models2 Jul 2024
- 2024It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension24 Jun 2024
- 2024OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text12 Jun 2024
12 newest of 91 All 91 (JSON)