mlsanityData to 14 Oct 2026

A Practical Toolkit for Multilingual Question and Answer Generation

arXiv 2305.17416 ↗First posted 27 May 2023cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Generating questions along with associated answers from a text has applications in several domains, such as creating reading comprehension tests for students, or improving document search by providing auxiliary questions and answers based on the query. Training models for question and answer generation (QAG) is not straightforward due to the expected structured output (i.e. a list of question and answer pairs), as it requires more than generating a single sentence. This results in a small number of publicly accessible QAG models. In this paper, we introduce AutoQG, an online service for multilingual QAG, along with lmqg, an all-in-one Python package for model fine-tuning, generation, and evaluation. We also release QAG models in eight languages fine-tuned on a few variants of pre-trained encoder-decoder language models, which can be used online via AutoQG or locally via lmqg. With these resources, practitioners of any level can benefit from a toolkit that includes a web interface for end users, and easy-to-use code for developers who require custom models or fine-grained controls for generation.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 27 May 2023.

Builds on

27 of 35 references.

References · 27

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  7. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  8. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  9. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
  10. 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 337
  11. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  12. 2020The Effect of Natural Distribution Shift on Question Answering Modelscited by 104
15 more
  1. 2020Training Question Answering Models From Synthetic Datacited by 95
  2. 2021Improving Question Answering Model Robustness with Synthetic Adversarial Data Generationcited by 79
  3. 2019Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answeringcited by 63
  4. 2019Unsupervised Question Answering by Cloze Translationcited by 59
  5. 2020FQuAD: French Question Answering Datasetcited by 58
  6. 2019KorQuAD1.0: Korean QA Dataset for Machine Reading Comprehensioncited by 43
  7. 2021GermanQuAD and GermanDPR: Improving Non-English Question Answering and Passage Retrievalcited by 39
  8. 2019SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysiscited by 38
  9. 2019Automatic Spanish Translation of the SQuAD Dataset for Multilingual Question Answeringcited by 35
  10. 2022Generative Language Models for Paragraph-Level Question Generationcited by 28
  11. 2022Varifocal Question Generation for Fact-checkingcited by 27
  12. 2020SubjQA: A Dataset for Subjectivity and Review Comprehensioncited by 24
  13. 2021Asking It All: Generating Contextualized Questions for any Semantic Rolecited by 22
  14. 2023An Empirical Comparison of LM-based Question and Answer Generation Methodscited by 15
  15. 2022JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehensioncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 5; 2026: 2.

10 papers.