mlsanityData to 14 Oct 2026

DTW at Qur'an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domain

arXiv 2205.06025 ↗First posted 12 May 2022cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

The task of machine reading comprehension (MRC) is a useful benchmark to evaluate the natural language understanding of machines. It has gained popularity in the natural language processing (NLP) field mainly due to the large number of datasets released for many languages. However, the research in MRC has been understudied in several domains, including religious texts. The goal of the Qur'an QA 2022 shared task is to fill this gap by producing state-of-the-art question answering and reading comprehension research on Qur'an. This paper describes the DTW entry to the Quran QA 2022 shared task. Our methodology uses transfer learning to take advantage of available Arabic MRC data. We further improve the results using various ensemble learning strategies. Our approach provided a partial Reciprocal Rank (pRR) score of 0.49 on the test set, proving its strong performance on the task.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 12 May 2022.

Builds on

26 of 43 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  3. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  4. 2015Teaching Machines to Read and Comprehendcited by 1,049
  5. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
  6. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
  7. 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
  8. 2016NewsQA: A Machine Comprehension Datasetcited by 331
  9. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  10. 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 119
  11. 2020Retrospective Reader for Machine Reading Comprehensioncited by 86
  12. 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
14 more
  1. 2017Transfer Learning across Low-Resource, Related Languages for Neural Machine Translationcited by 58
  2. 2020FQuAD: French Question Answering Datasetcited by 58
  3. 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
  4. 2019Neural Arabic Question Answeringcited by 48
  5. 2020AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understandingcited by 43
  6. 2020A Survey on Machine Reading Comprehension Systemscited by 41
  7. 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
  8. 2019SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysiscited by 38
  9. 2021An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformerscited by 18
  10. 2017Transfer Learning for Named-Entity Recognition with Neural Networkscited by 15
  11. 2020BRUMS at SemEval-2020 Task 12 : Transformer based Multilingual Offensive Language Identification in Social Mediacited by 10
  12. 2020InfoMiner at WNUT-2020 Task 2: Transformer-based Covid-19 Informative Tweet Extractioncited by 9
  13. 2022Biographical: A Semi-Supervised Relation Extraction Datasetcited by 7
  14. 2021Transformers to Fight the COVID-19 Infodemiccited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 0; 2026: 1.

4 papers.