ArabicaQA: A Comprehensive Dataset for Arabic Question Answering
Not on the map. Why?
Abstract (arXiv)
In this paper, we address the significant gap in Arabic natural language processing (NLP) resources by introducing ArabicaQA, the first large-scale dataset for machine reading comprehension and open-domain question answering in Arabic. This comprehensive dataset, consisting of 89,095 answerable and 3,701 unanswerable questions created by crowdworkers to look similar to answerable ones, along with additional labels of open-domain questions marks a crucial advancement in Arabic NLP resources. We also present AraDPR, the first dense passage retrieval model trained on the Arabic Wikipedia corpus, specifically designed to tackle the unique challenges of Arabic text retrieval. Furthermore, our study includes extensive benchmarking of large language models (LLMs) for Arabic question answering, critically evaluating their performance in the Arabic language context. In conclusion, ArabicaQA, AraDPR, and the benchmarking of LLMs in Arabic question answering offer significant advancements in the field of Arabic NLP. The dataset and code are publicly accessible for further research https://github.com/DataScienceUIBK/ArabicaQA.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 26 of its 63 references that are in the map. First posted on arXiv 26 Mar 2024.
Builds on
26 of 63 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Mistral 7Bcited by 3,065
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
14 more
- 2018CoQA: A Conversational Question Answering Challengecited by 674
- 2017The NarrativeQA Reading Comprehension Challengecited by 590
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
- 2016FastText.zip: Compressing text classification modelscited by 331
- 2016NewsQA: A Machine Comprehension Datasetcited by 330
- 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
- 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 150
- 2019Neural Arabic Question Answeringcited by 48
- 2020A Panoramic Survey of Natural Language Processing in the Arab Worldcited by 45
- 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
- 2022Towards Best Practices for Training Multilingual Dense Retrieval Modelscited by 26
- 2016Who did What: A Large-Scale Person-Centered Cloze Datasetcited by 24
- 2020Automated Question Answer medical model based on Deep Learning Technologycited by 9
- 2021An open access NLP dataset for Arabic dialects : Data collection, labeling, and model constructioncited by 5
Built on by
Citing papers per year: 2024: 5; 2025: 10; 2026: 5.
20 papers.
Sort:
By area:
- 2024CAMEL-Bench: A Comprehensive Arabic LMM Benchmarkcited by 17
- 2025Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLMcited by 16
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generationcited by 13
- 2025ASRank: Zero-Shot Re-Ranking with Answer Scent for Document Retrievalcited by 9
- 2025From Guidelines to Practice: A New Paradigm for Arabic Language Model Evaluationcited by 6
- 2024101 Billion Arabic Words Datasetcited by 2
- 2024GemmAr: Enhancing LLMs Through Arabic Instruction-Tuningcited by 2
- 2024DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classificationcited by 2
- 2025AraTable: Benchmarking LLMs' Reasoning and Understanding of Arabic Tabular Datacited by 2
- 2025Two-Stage Quranic QA via Ensemble Retrieval and Instruction-Tuned Answer Extractioncited by 2
- 2024A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmaskingcited by 1
- 2025Enhanced Arabic Text Retrieval with Attentive Relevance Scoringcited by 1
8 more
- 2025From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledgecited by 1
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
- 2025AutoArabic: A Three-Stage Framework for Localizing Video-Text Retrieval Benchmarkscited by 0
- 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answeringcited by 0
- 2026The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Modelscited by 0
- 2026BETA-Labeling for Multilingual Dataset Construction in Low-Resource IRcited by 0
- 2026BRIDGE: Multimodal-to-Text Retrieval via Reinforcement-Learned Query Alignmentcited by 0
- 2026Large Language Models Systematically Favor Popular Options: Evidence and Mitigation Across MCQscited by 0
- 2026Large Language Models Systematically Favor Popular Options: Evidence and Mitigation Across MCQs29 Aug 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026BRIDGE: Multimodal-to-Text Retrieval via Reinforcement-Learned Query Alignment8 Apr 2026
- 2026BETA-Labeling for Multilingual Dataset Construction in Low-Resource IR16 Feb 2026
- 2026The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Models1 Feb 2026
- 2025From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledge22 Oct 2025
- 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering28 Sep 2025
- 2025AutoArabic: A Three-Stage Framework for Localizing Video-Text Retrieval Benchmarks19 Sep 2025
- 2025Two-Stage Quranic QA via Ensemble Retrieval and Instruction-Tuned Answer Extraction9 Aug 2025
- 2025Enhanced Arabic Text Retrieval with Attentive Relevance Scoring31 Jul 2025
- 2025AraTable: Benchmarking LLMs' Reasoning and Understanding of Arabic Tabular Data24 Jul 2025
- 2025From Guidelines to Practice: A New Paradigm for Arabic Language Model Evaluation2 Jun 2025
8 more
- 2025Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLM18 Mar 2025
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation4 Feb 2025
- 2025ASRank: Zero-Shot Re-Ranking with Answer Scent for Document Retrieval25 Jan 2025
- 2024DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classification30 Nov 2024
- 2024CAMEL-Bench: A Comprehensive Arabic LMM Benchmark24 Oct 2024
- 2024GemmAr: Enhancing LLMs Through Arabic Instruction-Tuning2 Jul 2024
- 2024A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmasking9 May 2024
- 2024101 Billion Arabic Words Dataset29 Apr 2024
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generationcited by 13
- 2025ASRank: Zero-Shot Re-Ranking with Answer Scent for Document Retrievalcited by 9
- 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answeringcited by 0
- 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering28 Sep 2025
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation4 Feb 2025
- 2025ASRank: Zero-Shot Re-Ranking with Answer Scent for Document Retrieval25 Jan 2025
- 2025Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLMcited by 16
- 2025From Guidelines to Practice: A New Paradigm for Arabic Language Model Evaluationcited by 6
- 2024101 Billion Arabic Words Datasetcited by 2
- 2024GemmAr: Enhancing LLMs Through Arabic Instruction-Tuningcited by 2
- 2024DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classificationcited by 2
- 2025Two-Stage Quranic QA via Ensemble Retrieval and Instruction-Tuned Answer Extractioncited by 2
- 2024A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmaskingcited by 1
- 2025Enhanced Arabic Text Retrieval with Attentive Relevance Scoringcited by 1
- 2025From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledgecited by 1
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
- 2025AutoArabic: A Three-Stage Framework for Localizing Video-Text Retrieval Benchmarkscited by 0
- 2026The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Large Language Models Systematically Favor Popular Options: Evidence and Mitigation Across MCQs29 Aug 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026BRIDGE: Multimodal-to-Text Retrieval via Reinforcement-Learned Query Alignment8 Apr 2026
- 2026BETA-Labeling for Multilingual Dataset Construction in Low-Resource IR16 Feb 2026
- 2026The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Models1 Feb 2026
- 2025From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledge22 Oct 2025
- 2025AutoArabic: A Three-Stage Framework for Localizing Video-Text Retrieval Benchmarks19 Sep 2025
- 2025Two-Stage Quranic QA via Ensemble Retrieval and Instruction-Tuned Answer Extraction9 Aug 2025
- 2025Enhanced Arabic Text Retrieval with Attentive Relevance Scoring31 Jul 2025
- 2025From Guidelines to Practice: A New Paradigm for Arabic Language Model Evaluation2 Jun 2025
- 2025Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLM18 Mar 2025
- 2024DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classification30 Nov 2024
12 newest of 15 All 15 (JSON)