GermanQuAD and GermanDPR: Improving Non-English Question Answering and Passage Retrieval
Not on the map. Why?
Abstract (arXiv)
A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question/answer pairs. To improve the reproducibility of the dataset creation approach and foster QA research on other languages, we summarize lessons learned and evaluate reformulation of question/answer pairs as a way to speed up the annotation process. An extractive QA model trained on GermanQuAD significantly outperforms multilingual models and also shows that machine-translated training data cannot fully substitute hand-annotated training data in the target language. Finally, we demonstrate the wide range of applications of GermanQuAD by adapting it to GermanDPR, a training dataset for dense passage retrieval (DPR), and train and evaluate the first non-English DPR model.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 12 of its 14 references that are in the map. First posted on arXiv 26 Apr 2021.
Builds on
12 of 14 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
- 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
- 2020German's Next Language Modelcited by 144
- 2020Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasetscited by 137
- 2020FQuAD: French Question Answering Datasetcited by 58
- 2019KorQuAD1.0: Korean QA Dataset for Machine Reading Comprehensioncited by 43
- 2019SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysiscited by 38
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 9; 2024: 11; 2025: 9; 2026: 3.
39 papers.
Sort:
By area:
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2021Semantic Answer Similarity for Evaluating Question Answering Modelscited by 47
- 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 33
- 2022Generative Language Models for Paragraph-Level Question Generationcited by 28
- 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddingscited by 20
- 2024A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPTcited by 19
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applicationscited by 12
- 2023A Practical Toolkit for Multilingual Question and Answer Generationcited by 10
- 2021A cost-benefit analysis of cross-lingual transfer methodscited by 7
- 2022JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehensioncited by 7
- 2023NorQuAD: Norwegian Question Answering Datasetcited by 7
- 2025MultiWikiQA: A Reading Comprehension Benchmark in 300+ Languagescited by 7
27 more
- 2021A Survey on non-English Question Answering Datasetcited by 5
- 2023Fine-tuning and aligning question answering models for complex information extraction taskscited by 5
- 2023On the Impact of Cross-Domain Data on German Language Modelscited by 5
- 2024TIGQA:An Expert Annotated Question Answering Dataset in Tigrinyacited by 5
- 2025New Encoders for German Trained from Scratch: Comparing ModernGBERT with Converted LLM2Vec Modelscited by 5
- 2022Pir'a: A Bilingual Portuguese-English Dataset for Question-Answering about the Oceancited by 4
- 2025Investigating Task Arithmetic for Zero-Shot Information Retrievalcited by 4
- 2023A System for Human-AI collaboration for Online Customer Supportcited by 3
- 2025ALoFTRAG: Automatic Local Fine Tuning for Retrieval Augmented Generationcited by 3
- 2025A Collection of Question Answering Datasets for Norwegiancited by 2
- 2025Evaluating Robustness of LLMs in Question Answering on Multilingual Noisy OCR Datacited by 2
- 2022Evaluation of Semantic Answer Similarity Metricscited by 1
- 2023AmQA: Amharic Question Answering Datasetcited by 1
- 2023German FinBERT: A German Pre-trained Language Modelcited by 1
- 2024OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Contextcited by 1
- 2023Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehensioncited by 0
- 2024Building Efficient and Effective OpenQA Systems for Low-Resource Languagescited by 0
- 2024Multilingual De-Duplication Strategies: Applying scalable similarity search with monolingual & multilingual embedding modelscited by 0
- 2024Unsupervised Text Representation Learning via Instruction-Tuning for Zero-Shot Dense Retrievalcited by 0
- 2024Link, Synthesize, Retrieve: Universal Document Linking for Zero-Shot Information Retrievalcited by 0
- 2024A Comparative Study of Text Retrieval Models on DaReCzechcited by 0
- 2025How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapterscited by 0
- 2025Arctic-Extract Technical Reportcited by 0
- 2025Gamayun's Path to Multilingual Mastery: Cost-Efficient Training of a 1.5B-Parameter LLMcited by 0
- 2026Learning Perturbations to Extrapolate Your LLMcited by 0
- 2026CroCo: Cross-Lingual Contrastive Preference Tuning on Self-Generationscited by 0
- 2026From Global Benchmarks to Local Evaluations: Benchmarking LLMs for the German Public Sectorcited by 0
- 2026From Global Benchmarks to Local Evaluations: Benchmarking LLMs for the German Public Sector18 Aug 2026
- 2026CroCo: Cross-Lingual Contrastive Preference Tuning on Self-Generations25 May 2026
- 2026Learning Perturbations to Extrapolate Your LLM13 May 2026
- 2025Gamayun's Path to Multilingual Mastery: Cost-Efficient Training of a 1.5B-Parameter LLM25 Dec 2025
- 2025Arctic-Extract Technical Report20 Nov 2025
- 2025MultiWikiQA: A Reading Comprehension Benchmark in 300+ Languages4 Sep 2025
- 2025New Encoders for German Trained from Scratch: Comparing ModernGBERT with Converted LLM2Vec Models19 May 2025
- 2025Investigating Task Arithmetic for Zero-Shot Information Retrieval1 May 2025
- 2025Evaluating Robustness of LLMs in Question Answering on Multilingual Noisy OCR Data24 Feb 2025
- 2025ALoFTRAG: Automatic Local Fine Tuning for Retrieval Augmented Generation21 Jan 2025
- 2025A Collection of Question Answering Datasets for Norwegian19 Jan 2025
- 2025How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters10 Jan 2025
27 more
- 2024A Comparative Study of Text Retrieval Models on DaReCzech19 Nov 2024
- 2024Link, Synthesize, Retrieve: Universal Document Linking for Zero-Shot Information Retrieval24 Oct 2024
- 2024Unsupervised Text Representation Learning via Instruction-Tuning for Zero-Shot Dense Retrieval24 Sep 2024
- 2024OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Context22 Jul 2024
- 2024Multilingual De-Duplication Strategies: Applying scalable similarity search with monolingual & multilingual embedding models19 Jun 2024
- 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks19 Jun 2024
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications19 May 2024
- 2024TIGQA:An Expert Annotated Question Answering Dataset in Tigrinya26 Apr 2024
- 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings26 Feb 2024
- 2024A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPT13 Jan 2024
- 2024Building Efficient and Effective OpenQA Systems for Low-Resource Languages7 Jan 2024
- 2023German FinBERT: A German Pre-trained Language Model15 Nov 2023
- 2023On the Impact of Cross-Domain Data on German Language Models11 Oct 2023
- 2023Fine-tuning and aligning question answering models for complex information extraction tasks26 Sep 2023
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants31 Aug 2023
- 2023A Practical Toolkit for Multilingual Question and Answer Generation27 May 2023
- 2023NorQuAD: Norwegian Question Answering Dataset3 May 2023
- 2023Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension16 Mar 2023
- 2023AmQA: Amharic Question Answering Dataset6 Mar 2023
- 2023A System for Human-AI collaboration for Online Customer Support28 Jan 2023
- 2022Generative Language Models for Paragraph-Level Question Generation8 Oct 2022
- 2022Evaluation of Semantic Answer Similarity Metrics25 Jun 2022
- 2022Pir'a: A Bilingual Portuguese-English Dataset for Question-Answering about the Ocean4 Feb 2022
- 2022JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension3 Feb 2022
- 2021A Survey on non-English Question Answering Dataset27 Dec 2021
- 2021Semantic Answer Similarity for Evaluating Question Answering Models13 Aug 2021
- 2021A cost-benefit analysis of cross-lingual transfer methods14 May 2021
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2021Semantic Answer Similarity for Evaluating Question Answering Modelscited by 47
- 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 33
- 2022Generative Language Models for Paragraph-Level Question Generationcited by 28
- 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddingscited by 20
- 2024A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPTcited by 19
- 2024Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applicationscited by 12
- 2023A Practical Toolkit for Multilingual Question and Answer Generationcited by 10
- 2021A cost-benefit analysis of cross-lingual transfer methodscited by 7
- 2022JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehensioncited by 7
- 2023NorQuAD: Norwegian Question Answering Datasetcited by 7
- 2025MultiWikiQA: A Reading Comprehension Benchmark in 300+ Languagescited by 7
12 most cited of 37 All 37 (JSON)
- 2026From Global Benchmarks to Local Evaluations: Benchmarking LLMs for the German Public Sector18 Aug 2026
- 2026Learning Perturbations to Extrapolate Your LLM13 May 2026
- 2025Gamayun's Path to Multilingual Mastery: Cost-Efficient Training of a 1.5B-Parameter LLM25 Dec 2025
- 2025Arctic-Extract Technical Report20 Nov 2025
- 2025MultiWikiQA: A Reading Comprehension Benchmark in 300+ Languages4 Sep 2025
- 2025New Encoders for German Trained from Scratch: Comparing ModernGBERT with Converted LLM2Vec Models19 May 2025
- 2025Investigating Task Arithmetic for Zero-Shot Information Retrieval1 May 2025
- 2025Evaluating Robustness of LLMs in Question Answering on Multilingual Noisy OCR Data24 Feb 2025
- 2025A Collection of Question Answering Datasets for Norwegian19 Jan 2025
- 2025How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters10 Jan 2025
- 2024A Comparative Study of Text Retrieval Models on DaReCzech19 Nov 2024
- 2024Link, Synthesize, Retrieve: Universal Document Linking for Zero-Shot Information Retrieval24 Oct 2024
12 newest of 37 All 37 (JSON)