Enhanced Arabic Text Retrieval with Attentive Relevance Scoring
Not on the map. Why?
Abstract (arXiv)
Arabic poses a particular challenge for natural language processing (NLP) and information retrieval (IR) due to its complex morphology, optional diacritics and the coexistence of Modern Standard Arabic (MSA) and various dialects. Despite the growing global significance of Arabic, it is still underrepresented in NLP research and benchmark resources. In this paper, we present an enhanced Dense Passage Retrieval (DPR) framework developed specifically for Arabic. At the core of our approach is a novel Attentive Relevance Scoring (ARS) that replaces standard interaction mechanisms with an adaptive scoring function that more effectively models the semantic relevance between questions and passages. Our method integrates pre-trained Arabic language models and architectural refinements to improve retrieval performance and significantly increase ranking accuracy when answering Arabic questions. The code is made publicly available at hrefhttps://github.com/Bekhouche/APRGitHub.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 31 Jul 2025.
Builds on
19 of 27 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
- 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 486
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
7 more
- 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 283
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
- 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
- 2020KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Mediacited by 84
- 2019Neural Arabic Question Answeringcited by 48
- 2020AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understandingcited by 43
- 2024ArabicaQA: A Comprehensive Dataset for Arabic Question Answeringcited by 20
Built on by
Citing papers per year: 2025: 1.
1 paper.