mlsanityData to 7 Oct 2026

Harvesting Paragraph-Level Question-Answer Pairs from Wikipedia

arXiv 1805.05942 ↗First posted 15 May 2018cs.CLcited by 49

Not on the map. Why?

Abstract (arXiv)

We study the task of generating from Wikipedia articles question-answer pairs that cover content beyond a single sentence. We propose a neural network approach that incorporates coreference knowledge via a novel gating mechanism. Compared to models that only take into account sentence-level information (Heilman and Smith, 2010; Du et al., 2017; Zhou et al., 2017), we find that the linguistic knowledge introduced by the coreference representation aids question generation significantly, producing models that outperform the current state-of-the-art. We apply our system (composed of an answer span extraction system and the passage-level QG system) to the 10,000 top-ranking Wikipedia articles and create a corpus of over one million question-answer pairs. We also provide a qualitative analysis for this large-scale generated corpus from Wikipedia.

Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 16; 2022: 12; 2023: 9; 2024: 9; 2025: 2; 2026: 1.

49 papers.

Sort:

By area:

  1. 2023Controlled Text Generation with Natural Language Instructionscited by 87
  2. 2021Improving Question Answering Model Robustness with Synthetic Adversarial Data Generationcited by 77
  3. 2021Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistantscited by 31
  4. 2022Generative Language Models for Paragraph-Level Question Generationcited by 28
  5. 2021Quiz-Style Question Generation for News Storiescited by 23
  6. 2022HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarizationcited by 22
  7. 2022Improving Biomedical Information Retrieval with Neural Retrieverscited by 20
  8. 2021ChainCQG: Flow-Aware Conversational Question Generationcited by 19
  9. 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representationscited by 19
  10. 2022Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generationcited by 17
  11. 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Questioncited by 17
  12. 2023An Empirical Comparison of LM-based Question and Answer Generation Methodscited by 15
37 more
  1. 2021Improving Sequence-to-Sequence Pre-training via Sequence Span Rewritingcited by 13
  2. 2021Learning to Perturb Word Embeddings for Out-of-distribution QAcited by 13
  3. 2022Synthetic Question Value Estimation for Domain Adaptation of Question Answeringcited by 12
  4. 2023FOLLOWUPQG: Towards Information-Seeking Follow-up Question Generationcited by 12
  5. 2024Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answeringcited by 12
  6. 2023Exploring the Viability of Synthetic Query Generation for Relevance Predictioncited by 9
  7. 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challengescited by 9
  8. 2021Can Question Generation Debias Question Answering Models? A Case Study on Question-Context Lexical Overlapcited by 8
  9. 2023SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examplescited by 8
  10. 2023Evaluation of Question Generation Needs More Referencescited by 8
  11. 2021OneStop QAMaker: Extract Question-Answer Pairs from Text in a One-Stop Approachcited by 7
  12. 2021s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learningcited by 7
  13. 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answeringcited by 7
  14. 2022A Feasibility Study of Answer-Agnostic Question Generation for Educationcited by 6
  15. 2024A Survey on Neural Question Generation: Methods, Applications, and Prospectscited by 5
  16. 2021Asking Questions Like Educational Experts: Automatically Generating Question-Answer Pairs on Real-World Examination Datacited by 4
  17. 2022IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehensioncited by 4
  18. 2023Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inferencecited by 4
  19. 2021Generating Answer Candidates for Quizzes and Answer-Aware Question Generatorscited by 3
  20. 2022DialogQAE: N-to-N Question Answer Pair Extraction from Customer Service Chatlogcited by 3
  21. 2025MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sourcescited by 3
  22. 2021Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation Learningcited by 2
  23. 2022Pre-Trained Neural Language Models for Automatic Mobile App User Feedback Answer Generationcited by 2
  24. 2022An Empirical Study on Finding Spanscited by 2
  25. 2024FAQ-Gen: An automated system to generate domain-specific FAQs to aid content comprehensioncited by 2
  26. 2024Explicit Diversity Conditions for Effective Question Answer Generation with Large Language Modelscited by 2
  27. 2024Enhancing elusive clues in knowledge learning by contrasting attention of language modelscited by 2
  28. 2024ECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videoscited by 2
  29. 2021Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correctioncited by 1
  30. 2022Enhancing Pre-trained Models with Text Structure Knowledge for Question Generationcited by 1
  31. 2023UniPoll: A Unified Social Media Poll Generation Framework via Multi-Objective Optimizationcited by 1
  32. 2024Synergizing Machine Learning & Symbolic Methods: A Survey on Hybrid Approaches to Natural Language Processingcited by 1
  33. 2025From Answers to Questions: EQGBench for Evaluating LLMs' Educational Question Generationcited by 1
  34. 2021How Well Do You Know Your Audience? Toward Socially-aware Question Generationcited by 0
  35. 2021How to Build Robust FAQ Chatbot with Controllable Question Generator?cited by 0
  36. 2024DragonVerseQA: Open-Domain Long-Form Context-Aware Question-Answeringcited by 0
  37. 2026PAL: Personal Adaptive Learnercited by 0