A Practical Toolkit for Multilingual Question and Answer Generation
Not on the map. Why?
Abstract (arXiv)
Generating questions along with associated answers from a text has applications in several domains, such as creating reading comprehension tests for students, or improving document search by providing auxiliary questions and answers based on the query. Training models for question and answer generation (QAG) is not straightforward due to the expected structured output (i.e. a list of question and answer pairs), as it requires more than generating a single sentence. This results in a small number of publicly accessible QAG models. In this paper, we introduce AutoQG, an online service for multilingual QAG, along with lmqg, an all-in-one Python package for model fine-tuning, generation, and evaluation. We also release QAG models in eight languages fine-tuned on a few variants of pre-trained encoder-decoder language models, which can be used online via AutoQG or locally via lmqg. With these resources, practitioners of any level can benefit from a toolkit that includes a web interface for end users, and easy-to-use code for developers who require custom models or fine-grained controls for generation.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 27 May 2023.
Builds on
27 of 35 references.
References · 27
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
- 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 337
- 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
- 2020The Effect of Natural Distribution Shift on Question Answering Modelscited by 104
15 more
- 2020Training Question Answering Models From Synthetic Datacited by 95
- 2021Improving Question Answering Model Robustness with Synthetic Adversarial Data Generationcited by 79
- 2019Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answeringcited by 63
- 2019Unsupervised Question Answering by Cloze Translationcited by 59
- 2020FQuAD: French Question Answering Datasetcited by 58
- 2019KorQuAD1.0: Korean QA Dataset for Machine Reading Comprehensioncited by 43
- 2021GermanQuAD and GermanDPR: Improving Non-English Question Answering and Passage Retrievalcited by 39
- 2019SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysiscited by 38
- 2019Automatic Spanish Translation of the SQuAD Dataset for Multilingual Question Answeringcited by 35
- 2022Generative Language Models for Paragraph-Level Question Generationcited by 28
- 2022Varifocal Question Generation for Fact-checkingcited by 27
- 2020SubjQA: A Dataset for Subjectivity and Review Comprehensioncited by 24
- 2021Asking It All: Generating Contextualized Questions for any Semantic Rolecited by 22
- 2023An Empirical Comparison of LM-based Question and Answer Generation Methodscited by 15
- 2022JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehensioncited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 5; 2026: 2.
10 papers.
- 2025Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes Fromcited by 4
- 2023PACuna: Automated Fine-Tuning of Language Models for Particle Acceleratorscited by 3
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2025HintEval: An Open-Source Python Toolkit for Hint Generation and Hint Evaluationcited by 3
- 2025Multi-Hop Question Generation via Dual-Perspective Keyword Guidancecited by 3
- 2024ISQA: Informative Factuality Feedback for Scientific Summarizationcited by 2
- 2026Beyond Factual QA: Mentorship-Oriented Question Answering over Long-Form Multilingual Contentcited by 1
- 2025FIQ: Fundamental Question Generation with the Integration of Question Embeddings for Video Question Answeringcited by 0
- 2025Foundational Question Generation for Video Question Answering via an Embedding-Integrated Approachcited by 0
- 2026Exploiting Intrinsic Duality for Multi-Hop Question Generationcited by 0
- 2026Exploiting Intrinsic Duality for Multi-Hop Question Generation1 Aug 2026
- 2026Beyond Factual QA: Mentorship-Oriented Question Answering over Long-Form Multilingual Content23 Jan 2026
- 2025Foundational Question Generation for Video Question Answering via an Embedding-Integrated Approach18 Nov 2025
- 2025FIQ: Fundamental Question Generation with the Integration of Question Embeddings for Video Question Answering17 Jul 2025
- 2025Multi-Hop Question Generation via Dual-Perspective Keyword Guidance21 May 2025
- 2025Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From15 Apr 2025
- 2025HintEval: An Open-Source Python Toolkit for Hint Generation and Hint Evaluation2 Feb 2025
- 2024ISQA: Informative Factuality Feedback for Scientific Summarization20 Apr 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023PACuna: Automated Fine-Tuning of Language Models for Particle Accelerators29 Oct 2023