mlsanityData to 7 Oct 2026

Cross-Lingual QA as a Stepping Stone for Monolingual Open QA in Icelandic

arXiv 2207.01918 ↗First posted 5 Jul 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

It can be challenging to build effective open question answering (open QA) systems for languages other than English, mainly due to a lack of labeled data for training. We present a data efficient method to bootstrap such a system for languages other than English. Our approach requires only limited QA resources in the given language, along with machine-translated data, and at least a bilingual language model. To evaluate our approach, we build such a system for the Icelandic language and evaluate performance over trivia style datasets. The corpora used for training are English in origin but machine translated into Icelandic. We train a bilingual Icelandic/English language model to embed English context and Icelandic questions following methodology introduced with DensePhrases (Lee et al., 2021). The resulting system is an open domain cross-lingual QA system between Icelandic and English. Finally, the system is adapted for Icelandic only open QA, demonstrating how it is possible to efficiently create an open QA system with limited access to curated datasets in the language of interest.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 5 Jul 2022.

Builds on

27 of 38 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  8. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  9. 2017Billion-scale similarity search with GPUscited by 2,477
  10. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  11. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  12. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
15 more
  1. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  2. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 486
  3. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  4. 2020Pretrained Transformers for Text Ranking: BERT and Beyondcited by 266
  5. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  6. 2019Synthetic QA Corpora Generation with Roundtrip Consistencycited by 143
  7. 2020XOR QA: Cross-lingual Open-Retrieval Question Answeringcited by 121
  8. 2020Learning Dense Representations of Phrases at Scalecited by 91
  9. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  10. 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
  11. 2020Bootstrapping a Crosslingual Semantic Parsercited by 13
  12. 2022A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Modelscited by 13
  13. 2020BERT Based Multilingual Machine Comprehension in English and Hindicited by 5
  14. 2019Multilingual Question Answering from Formatted Text applied to Conversational Agentscited by 4
  15. 2021Midheind's WMT 2021 submissioncited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025FoQA: A Faroese Question-Answering Datasetcited by 3