DTW at Qur'an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domain
Not on the map. Why?
Abstract (arXiv)
The task of machine reading comprehension (MRC) is a useful benchmark to evaluate the natural language understanding of machines. It has gained popularity in the natural language processing (NLP) field mainly due to the large number of datasets released for many languages. However, the research in MRC has been understudied in several domains, including religious texts. The goal of the Qur'an QA 2022 shared task is to fill this gap by producing state-of-the-art question answering and reading comprehension research on Qur'an. This paper describes the DTW entry to the Quran QA 2022 shared task. Our methodology uses transfer learning to take advantage of available Arabic MRC data. We further improve the results using various ensemble learning strategies. Our approach provided a partial Reciprocal Rank (pRR) score of 0.49 on the test set, proving its strong performance on the task.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 12 May 2022.
Builds on
26 of 43 references.
References · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2015Teaching Machines to Read and Comprehendcited by 1,049
- 2017Crowdsourcing Multiple Choice Science Questionscited by 765
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2016NewsQA: A Machine Comprehension Datasetcited by 331
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 119
- 2020Retrospective Reader for Machine Reading Comprehensioncited by 86
- 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
14 more
- 2017Transfer Learning across Low-Resource, Related Languages for Neural Machine Translationcited by 58
- 2020FQuAD: French Question Answering Datasetcited by 58
- 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
- 2019Neural Arabic Question Answeringcited by 48
- 2020AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understandingcited by 43
- 2020A Survey on Machine Reading Comprehension Systemscited by 41
- 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
- 2019SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysiscited by 38
- 2021An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformerscited by 18
- 2017Transfer Learning for Named-Entity Recognition with Neural Networkscited by 15
- 2020BRUMS at SemEval-2020 Task 12 : Transformer based Multilingual Offensive Language Identification in Social Mediacited by 10
- 2020InfoMiner at WNUT-2020 Task 2: Transformer-based Covid-19 Informative Tweet Extractioncited by 9
- 2022Biographical: A Semi-Supervised Relation Extraction Datasetcited by 7
- 2021Transformers to Fight the COVID-19 Infodemiccited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 0; 2026: 1.
4 papers.
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answeringcited by 9
- 2022BERT(s) to Detect Multiword Expressionscited by 5
- 2022Transformer-based Detection of Multiword Expressions in Flower and Plant Namescited by 0
- 2023Deep Learning Methods for Extracting Metaphorical Names of Flowers and Plantscited by 0
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answering12 Jan 2026
- 2023Deep Learning Methods for Extracting Metaphorical Names of Flowers and Plants18 May 2023
- 2022Transformer-based Detection of Multiword Expressions in Flower and Plant Names16 Sep 2022
- 2022BERT(s) to Detect Multiword Expressions16 Aug 2022