NewsQA: A Machine Comprehension Dataset
Not on the map. Why?
Cited by 27 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present NewsQA, a challenging machine comprehension dataset of over 100,000 human-generated question-answer pairs. Crowdworkers supply questions and answers based on a set of over 10,000 news articles from CNN, with answers consisting of spans of text from the corresponding articles. We collect this dataset through a four-stage process designed to solicit exploratory questions that require reasoning. A thorough analysis confirms that NewsQA demands abilities beyond simple word matching and recognizing textual entailment. We measure human performance on the dataset and compare it to several strong neural models. The performance gap between humans and machines (0.198 in F1) indicates that significant progress can be made on NewsQA through future research. The dataset is freely available at https://datasets.maluuba.com/NewsQA.
Key facts. Cited by 330 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 76; 2022: 89; 2023: 64; 2024: 50; 2025: 31; 2026: 20.
330 papers.
Sort:
By area:
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 420
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
- 2023Do Large Language Models Know What They Don't Know?cited by 238
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
- 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
38 more
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
- 2023Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learningcited by 115
- 2021KLUE: Korean Language Understanding Evaluationcited by 113
- 2024DsDm: Model-Aware Dataset Selection with Datamodelscited by 103
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2025HalluLens: LLM Hallucination Benchmarkcited by 88
- 2022ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Promptscited by 85
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
- 2021FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Taskscited by 84
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answeringcited by 84
- 2023Learning to Filter Context for Retrieval-Augmented Generationcited by 82
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
- 2022GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspectivecited by 72
- 2022Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settingscited by 66
- 2024Instruction Pre-Training: Language Models are Supervised Multitask Learnerscited by 63
- 2021Few-Shot Question Answering by Pretraining Span Selectioncited by 62
- 2021What to Pre-Train on? Efficient Intermediate Task Selectioncited by 62
- 2023Large Language Models are Visual Reasoning Coordinatorscited by 58
- 2022UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Trainingcited by 57
- 2021Improving Factual Consistency of Abstractive Summarization via Question Answeringcited by 55
- 2021Comparing Test Sets with Item Response Theorycited by 55
- 2023InstructRetro: Instruction Tuning post Retrieval-Augmented Pretrainingcited by 53
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 53
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2021Knowing More About Questions Can Help: Improving Calibration in Question Answeringcited by 47
- 2022Read before Generate! Faithful Long Form Question Answering with Machine Readingcited by 47
- 2023Universal Information Extraction as Unified Semantic Matchingcited by 47
- 2021Keep it Simple: Unsupervised Simplification of Multi-Paragraph Textcited by 45
- 2024Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Modelscited by 44
- 2024Evaluating Copyright Takedown Methods for Language Modelscited by 42
- 2023Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answeringcited by 41
- 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inferencecited by 40
50 most cited of 330 All 330 (JSON)
- 2026Do Student LLMs Inherit OOD Robustness? Invariance-Weighted Distillation for Reliable Knowledge Transfer18 Sep 2026
- 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalist6 Sep 2026
- 2026HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts30 Aug 2026
- 2026W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases22 Aug 2026
- 2026Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiability31 Jul 2026
- 2026SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation26 Jun 2026
- 2026Magnifying What Matters: Attention-Guided Adaptive Rendering for Visual Text Comprehension11 Jun 2026
- 2026QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving4 Jun 2026
- 2026The Routing Plateau: Understanding the Accuracy Limits of LLM Routers27 May 2026
- 2026RAGe: A Retrieval-Augmented Generation Evaluation Framework23 May 2026
- 2026Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven10 May 2026
- 2026Towards Generation-Efficient Uncertainty Estimation in Large Language Models7 May 2026
38 more
- 2026Membership Inference Attacks for Retrieval Based In-Context Learning for Document Question Answering5 May 2026
- 2026PIIGuard: Mitigating PII Harvesting under Adversarial Sanitization4 May 2026
- 2026Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Tasks3 May 2026
- 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering6 Apr 2026
- 2026RealBirdID: Benchmarking Bird Species Identification in the Era of MLLMs27 Mar 2026
- 2026SHINE: A Scalable In-Context Hypernetwork for Mapping Context to LoRA in a Single Pass6 Feb 2026
- 2026Stop Rewarding Hallucinated Steps: Faithfulness-Aware Step-Level Reinforcement Learning for Small Reasoning Models5 Feb 2026
- 2026MisSpans: Fine-Grained False Span Identification in Cross-Domain Fake News8 Jan 2026
- 2025MEPIC: Memory Efficient Position Independent Caching for LLM Serving18 Dec 2025
- 2025SmartChunk Retrieval: Query-Aware Chunk Compression with Planning for Efficient Document RAG17 Dec 2025
- 2025Difficulty-Controllable Multiple-Choice Question Generation Using Large Language Models and Direct Preference Optimization22 Oct 2025
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors10 Oct 2025
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference8 Oct 2025
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering6 Oct 2025
- 2025Visual Self-Refinement for Autoregressive Models1 Oct 2025
- 2025Explainable Semantic Text Relations: A Question-Answering Framework for Comparing Document Content10 Sep 2025
- 2025Re3: Learning to Balance Relevance & Recency for Temporal Information Retrieval1 Sep 2025
- 2025Can Out-of-Distribution Evaluations Uncover Reliance on Shortcuts? A Case Study in Question Answering25 Aug 2025
- 2025Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective22 Aug 2025
- 2025HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark3 Aug 2025
- 2025Small Encoders Can Rival Large Decoders in Detecting Groundedness26 Jun 2025
- 2025Helpful Agent Meets Deceptive Judge: Understanding Vulnerabilities in Agentic Workflows3 Jun 2025
- 2025ImpRAG: Retrieval-Augmented Generation with Implicit Queries2 Jun 2025
- 2025ChatPD: An LLM-driven Paper-Dataset Networking System28 May 2025
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis27 May 2025
- 2025It's High Time: A Survey of Temporal Question Answering26 May 2025
- 2025EnronQA: Towards Personalized RAG over Private Documents1 May 2025
- 2025HalluLens: LLM Hallucination Benchmark24 Apr 2025
- 2025Certified Mitigation of Worst-Case LLM Copyright Infringement22 Apr 2025
- 2025Compass-V2 Technical Report22 Apr 2025
- 2025aiXamine: Simplified LLM Safety and Security21 Apr 2025
- 2025Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses16 Apr 2025
- 2025Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning23 Mar 2025
- 2025HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on Retrieval-Augmented Generation3 Mar 2025
- 2025ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation21 Feb 2025
- 2025Unveiling Environmental Impacts of Large Language Model Serving: A Functional Unit View16 Feb 2025
- 2025SelfElicit: Your Language Model Secretly Knows Where is the Relevant Evidence12 Feb 2025
- 2025ADePT: Adaptive Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning6 Jan 2025
50 newest of 330 All 330 (JSON)
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
- 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
- 2023Learning to Filter Context for Retrieval-Augmented Generationcited by 82
- 2023InstructRetro: Instruction Tuning post Retrieval-Augmented Pretrainingcited by 53
- 2024Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documentscited by 27
- 2024EfficientRAG: Efficient Retriever for Multi-Hop Question Answeringcited by 24
- 2024Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generationcited by 21
- 2024SFR-RAG: Towards Contextually Faithful LLMscited by 19
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysiscited by 17
12 most cited of 27 All 27 (JSON)
- 2026W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases22 Aug 2026
- 2026Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiability31 Jul 2026
- 2026SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation26 Jun 2026
- 2026QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving4 Jun 2026
- 2026RAGe: A Retrieval-Augmented Generation Evaluation Framework23 May 2026
- 2025MEPIC: Memory Efficient Position Independent Caching for LLM Serving18 Dec 2025
- 2025SmartChunk Retrieval: Query-Aware Chunk Compression with Planning for Efficient Document RAG17 Dec 2025
- 2025ImpRAG: Retrieval-Augmented Generation with Implicit Queries2 Jun 2025
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis27 May 2025
- 2025EnronQA: Towards Personalized RAG over Private Documents1 May 2025
- 2025HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on Retrieval-Augmented Generation3 Mar 2025
- 2025ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation21 Feb 2025
12 newest of 27 All 27 (JSON)
- 2023Large Language Models are Visual Reasoning Coordinatorscited by 58
- 2024PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awarenesscited by 9
- 2024RiTeK: A Dataset for Large Language Models Complex Reasoning over Textual Knowledge Graphs in Medicinecited by 6
- 2023Mind Reasoning Manners: Enhancing Type Perception for Generalized Zero-shot Logical Reasoning over Textcited by 2
- 2023Few-shot Unified Question Answering: Tuning Models or Prompts?cited by 2
- 2026Stop Rewarding Hallucinated Steps: Faithfulness-Aware Step-Level Reinforcement Learning for Small Reasoning Modelscited by 2
- 2026Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Taskscited by 1
- 2026Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Tasks3 May 2026
- 2026Stop Rewarding Hallucinated Steps: Faithfulness-Aware Step-Level Reinforcement Learning for Small Reasoning Models5 Feb 2026
- 2024RiTeK: A Dataset for Large Language Models Complex Reasoning over Textual Knowledge Graphs in Medicine17 Oct 2024
- 2024PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness9 Oct 2024
- 2023Large Language Models are Visual Reasoning Coordinators23 Oct 2023
- 2023Few-shot Unified Question Answering: Tuning Models or Prompts?23 May 2023
- 2023Mind Reasoning Manners: Enhancing Type Perception for Generalized Zero-shot Logical Reasoning over Text8 Jan 2023
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 29
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inferencecited by 15
- 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answeringcited by 13
- 2025Helpful Agent Meets Deceptive Judge: Understanding Vulnerabilities in Agentic Workflowscited by 6
- 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering6 Apr 2026
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference8 Oct 2025
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering6 Oct 2025
- 2025Helpful Agent Meets Deceptive Judge: Understanding Vulnerabilities in Agentic Workflows3 Jun 2025
- 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inferencecited by 40
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchorscited by 14
- 2024Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Modelscited by 9
- 2026Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Drivencited by 3
- 2026Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven10 May 2026
- 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors10 Oct 2025
- 2024Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models22 Sep 2024
- 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference25 May 2021
- 2024PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learningcited by 7
- 2025Compass-V2 Technical Reportcited by 2
- 2022Build a Robust QA System with Transformer-based Mixture of Expertscited by 0
- 2026HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Expertscited by 0
- 2026HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts30 Aug 2026
- 2025Compass-V2 Technical Report22 Apr 2025
- 2024PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning23 Feb 2024
- 2022Build a Robust QA System with Transformer-based Mixture of Experts20 Mar 2022
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 420
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
- 2023Do Large Language Models Know What They Don't Know?cited by 238
- 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
12 most cited of 278 All 278 (JSON)
- 2026Do Student LLMs Inherit OOD Robustness? Invariance-Weighted Distillation for Reliable Knowledge Transfer18 Sep 2026
- 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalist6 Sep 2026
- 2026The Routing Plateau: Understanding the Accuracy Limits of LLM Routers27 May 2026
- 2026Towards Generation-Efficient Uncertainty Estimation in Large Language Models7 May 2026
- 2026PIIGuard: Mitigating PII Harvesting under Adversarial Sanitization4 May 2026
- 2026RealBirdID: Benchmarking Bird Species Identification in the Era of MLLMs27 Mar 2026
- 2026SHINE: A Scalable In-Context Hypernetwork for Mapping Context to LoRA in a Single Pass6 Feb 2026
- 2026MisSpans: Fine-Grained False Span Identification in Cross-Domain Fake News8 Jan 2026
- 2025Visual Self-Refinement for Autoregressive Models1 Oct 2025
- 2025Explainable Semantic Text Relations: A Question-Answering Framework for Comparing Document Content10 Sep 2025
- 2025Re3: Learning to Balance Relevance & Recency for Temporal Information Retrieval1 Sep 2025
- 2025Can Out-of-Distribution Evaluations Uncover Reliance on Shortcuts? A Case Study in Question Answering25 Aug 2025
12 newest of 278 All 278 (JSON)