mlsanityData to 14 Oct 2026

SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine

arXiv 1704.05179 ↗First posted 18 Apr 2017cs.CLcited by 225

Not on the map. Why?

Cited by 25 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We publicly release a new large-scale dataset, called SearchQA, for machine comprehension, or question-answering. Unlike recently released datasets, such as DeepMind CNN/DailyMail and SQuAD, the proposed SearchQA was constructed to reflect a full pipeline of general question-answering. That is, we start not from an existing article and generate a question-answer pair, but start from an existing question-answer pair, crawled from J! Archive, and augment it with text snippets retrieved by Google. Following this approach, we built SearchQA, which consists of more than 140k question-answer pairs with each pair having 49.6 snippets on average. Each question-answer-context tuple of the SearchQA comes with additional meta-data such as the snippet's URL, which we believe will be valuable resources for future research. We conduct human evaluation as well as test two baseline methods, one simple word selection and the other deep learning based, on the SearchQA. We show that there is a meaningful gap between the human and machine performances. This suggests that the proposed dataset could well serve as a benchmark for question-answering.

Key facts. Cited by 225 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Apr 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 47; 2022: 45; 2023: 25; 2024: 34; 2025: 23; 2026: 50.

225 papers.

Sort:

By area:

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2021MetaICL: Learning to Learn In Contextcited by 454
  3. 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
  4. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  5. 2024Generative Representational Instruction Tuningcited by 233
  6. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
  7. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 211
  8. 2021QuALITY: Question Answering with Long Input Texts, Yes!cited by 208
  9. 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
  10. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  11. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  12. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
38 more
  1. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 147
  2. 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
  3. 2023Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learningcited by 115
  4. 2022Task-aware Retrieval with Instructionscited by 107
  5. 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 107
  6. 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 100
  7. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 97
  8. 2025HalluLens: LLM Hallucination Benchmarkcited by 92
  9. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  10. 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 86
  11. 2021FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Taskscited by 85
  12. 2022ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Promptscited by 85
  13. 2022Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settingscited by 66
  14. 2021Few-Shot Question Answering by Pretraining Span Selectioncited by 62
  15. 2024DocFinQA: A Long-Context Financial Reasoning Datasetcited by 60
  16. 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 55
  17. 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
  18. 2021Knowing More About Questions Can Help: Improving Calibration in Question Answeringcited by 47
  19. 2022Read before Generate! Faithful Long Form Question Answering with Machine Readingcited by 47
  20. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
  21. 2024LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversitycited by 42
  22. 2024M-Longdoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning Frameworkcited by 36
  23. 2025KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Modelcited by 36
  24. 2023DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuningcited by 35
  25. 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
  26. 2021On the Efficacy of Adversarial Data Collection for Question Answering: Results from a Large-Scale Randomized Studycited by 31
  27. 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
  28. 2021MixQG: Neural Question Generation with Mixed Answer Typescited by 28
  29. 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievalscited by 28
  30. 2024Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documentscited by 27
  31. 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
  32. 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
  33. 2021Exploring Universal Intrinsic Task Subspace via Prompt Tuningcited by 25
  34. 2021It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Bookscited by 23
  35. 2022Exploring The Landscape of Distributional Robustness for Question Answering Modelscited by 23
  36. 2024Researchy Questions: A Dataset of Multi-Perspective, Decompositional Questions for LLM Web Agentscited by 23
  37. 2021ReasonBERT: Pre-trained to Reason with Distant Supervisioncited by 22
  38. 2022Hyperdecoders: Instance-specific decoders for multi-task NLPcited by 22

50 most cited of 225 All 225 (JSON)