mlsanityData to 7 Oct 2026

ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collections

arXiv 2109.03438 ↗First posted 8 Sep 2021cs.CL cs.AIcited by 30

Not on the map. Why?

Abstract (arXiv)

In the last few years, open-domain question answering (ODQA) has advanced rapidly due to the development of deep learning techniques and the availability of large-scale QA datasets. However, the current datasets are essentially designed for synchronic document collections (e.g., Wikipedia). Temporal news collections such as long-term news archives spanning several decades, are rarely used in training the models despite they are quite valuable for our society. To foster the research in the field of ODQA on such historical collections, we present ArchivalQA, a large question answering dataset consisting of 532,444 question-answer pairs which is designed for temporal news QA. We divide our dataset into four subparts based on the question difficulty levels and the containment of temporal expressions, which we believe are useful for training and testing ODQA systems characterized by different strengths and abilities. The novel QA dataset-constructing framework that we introduce can be also applied to generate non-ambiguous questions of good quality over other types of temporal document collections.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 41 of its 79 references that are in the map. First posted on arXiv 8 Sep 2021.

Builds on

41 of 79 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  9. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  10. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  11. 2015Teaching Machines to Read and Comprehendcited by 1,039
  12. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
29 more
  1. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  2. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  3. 2018CoQA: A Conversational Question Answering Challengecited by 674
  4. 2017The NarrativeQA Reading Comprehension Challengecited by 590
  5. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  6. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  7. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  8. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
  9. 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
  10. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  11. 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
  12. 2015Exploring Models and Data for Image Question Answeringcited by 139
  13. 2021Question Answering Over Temporal Knowledge Graphscited by 99
  14. 2020Training Question Answering Models From Synthetic Datacited by 95
  15. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  16. 2020End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systemscited by 65
  17. 2016Deep Reinforcement Learning for Mention-Ranking Coreference Modelscited by 63
  18. 2019Unsupervised Question Answering by Cloze Translationcited by 59
  19. 2017Quasar: Datasets for Question Answering by Search and Readingcited by 50
  20. 2020A Survey on Machine Reading Comprehension Systemscited by 41
  21. 2020GenAug: Data Augmentation for Finetuning Text Generatorscited by 41
  22. 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
  23. 2018Improving Neural Question Generation using Answer Separationcited by 30
  24. 2018Learning to Ask Questions in Open-domain Conversational Systems with Typed Decoderscited by 26
  25. 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
  26. 2016Who did What: A Large-Scale Person-Centered Cloze Datasetcited by 24
  27. 2021Quiz-Style Question Generation for News Storiescited by 23
  28. 2017A Joint Model for Question Answering and Question Generationcited by 13
  29. 2018Domain Agnostic Real-Valued Specificity Predictioncited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 15; 2025: 8; 2026: 4.

30 papers.

Sort:

By area:

  1. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
  2. 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
  3. 2023Meta-Learning Online Adaptation of Language Modelscited by 43
  4. 2024Online Adaptation of Language Models with a Memory of Amortized Contextscited by 35
  5. 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 25
  6. 2024ArabicaQA: A Comprehensive Dataset for Arabic Question Answeringcited by 20
  7. 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questionscited by 14
  8. 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generationcited by 13
  9. 2025It's High Time: A Survey of Temporal Question Answeringcited by 12
  10. 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoningcited by 10
  11. 2024ChroniclingAmericaQA: A Large-scale Question Answering Dataset based on Historical American Newspaper Pagescited by 10
  12. 2025A Study into Investigating Temporal Robustness of LLMscited by 10
18 more
  1. 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
  2. 2025ASRank: Zero-Shot Re-Ranking with Answer Scent for Document Retrievalcited by 9
  3. 2023Unlocking Temporal Question Answering for Large Language Models with Tailor-Made Reasoning Logiccited by 7
  4. 2024Temporal Blind Spots in Large Language Modelscited by 7
  5. 2024TriviaHG: A Dataset for Automatic Hint Generation from Factoid Questionscited by 7
  6. 2024RoQLlama: A Lightweight Romanian Adapted Language Modelcited by 7
  7. 2024CMT: A Memory Compression Method for Continual Knowledge Learning of Large Language Modelscited by 6
  8. 2026Memory Bank Compression for Continual Adaptation of Large Language Modelscited by 4
  9. 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigmscited by 4
  10. 2024Continual Learning for Temporal-Sensitive Question Answeringcited by 3
  11. 2024Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Modelscited by 3
  12. 2025Evaluating Answer Reranking Strategies in Time-sensitive Question Answeringcited by 2
  13. 2024Does the Generator Mind its Contexts? An Analysis of Generative Model Faithfulness under Context Transfercited by 1
  14. 2024Detecting Temporal Ambiguity in Questionscited by 1
  15. 2024Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt Modelcited by 1
  16. 2025Evaluating List Construction and Temporal Understanding capabilities of Large Language Modelscited by 1
  17. 2026Evaluating Temporal Consistency in Multi-Turn Language Modelscited by 1
  18. 2026How often do Answers Change? Estimating Recency Requirements in Question Answeringcited by 0