mlsanityData to 14 Oct 2026

On the Evaluation of Answer-Agnostic Paragraph-level Multi-Question Generation

arXiv 2203.04464 ↗First posted 9 Mar 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

We study the task of predicting a set of salient questions from a given paragraph without any prior knowledge of the precise answer. We make two main contributions. First, we propose a new method to evaluate a set of predicted questions against the set of references by using the Hungarian algorithm to assign predicted questions to references before scoring the assigned pairs. We show that our proposed evaluation strategy has better theoretical and practical properties compared to prior methods because it can properly account for the coverage of references. Second, we compare different strategies to utilize a pre-trained seq2seq model to generate and select a set of questions related to a given paragraph. The code is available.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 60 references that are in the map. First posted on arXiv 9 Mar 2022.

Builds on

30 of 60 references.

References · 30

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  6. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
  7. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
  8. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  9. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
  10. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  11. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
  12. 2017Learning to Ask: Neural Question Generation for Reading Comprehensioncited by 186
18 more
  1. 2020Training Question Answering Models From Synthetic Datacited by 95
  2. 2017Neural Question Generation from Text: A Preliminary Studycited by 78
  3. 2020End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systemscited by 65
  4. 2017Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generationcited by 61
  5. 2018Towards a Better Metric for Evaluating Question Generation Systemscited by 52
  6. 2018One Size Does Not Fit All: Generating and Evaluating Variable Number of Keyphrasescited by 52
  7. 2017Question Answering and Question Generation as Dual Taskscited by 37
  8. 2017Machine Comprehension by Text-to-Text Neural Question Generationcited by 32
  9. 2018Learning to Ask Questions in Open-domain Conversational Systems with Typed Decoderscited by 26
  10. 2019Memory-Efficient Adaptive Optimizationcited by 19
  11. 2019Question-type Driven Question Generationcited by 16
  12. 2021What's The Latest? A Question-driven News Chatbotcited by 14
  13. 2017A Joint Model for Question Answering and Question Generationcited by 13
  14. 2020QURIOUS: Question Generation Pretraining for Text Generationcited by 12
  15. 2017Neural Models for Key Phrase Detection and Question Generationcited by 9
  16. 2017A Unified Query-based Generative Model for Question Generation and Question Answeringcited by 4
  17. 2020A Question Type Driven and Copy Loss Enhanced Frameworkfor Answer-Agnostic Neural Question Generationcited by 4
  18. 2020Evaluating for Diversity in Question Generation over Textcited by 1

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.

  1. 2022Multi-VQG: Generating Engaging Questions for Multiple Imagescited by 2