Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios
Not on the map. Why?
Abstract (arXiv)
Despite recent advancements in Multilingual Information Retrieval (MLIR), a significant gap remains between research and practical deployment. Many studies assess MLIR performance in isolated settings, limiting their applicability to real-world scenarios. In this work, we leverage the unique characteristics of the Quranic multilingual corpus to examine the optimal strategies to develop an ad-hoc IR system for the Islamic domain that is designed to satisfy users' information needs in multiple languages. We prepared eleven retrieval models employing four training approaches: monolingual, cross-lingual, translate-train-all, and a novel mixed method combining cross-lingual and monolingual techniques. Evaluation on an in-domain dataset demonstrates that the mixed approach achieves promising results across diverse retrieval scenarios. Furthermore, we provide a detailed analysis of how different training configurations affect the embedding space and their implications for multilingual retrieval effectiveness. Finally, we discuss deployment considerations, emphasizing the cost-efficiency of deploying a single versatile, lightweight model for real-world MLIR applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
28 of 37 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2019Cross-lingual Language Model Pretrainingcited by 1,090
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
16 more
- 2020Language-agnostic BERT Sentence Embeddingcited by 627
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 229
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 176
- 2019Learning Dense Representations for Entity Retrievalcited by 122
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
- 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Modelscited by 36
- 2020Load What You Need: Smaller Versions of Multilingual BERTcited by 32
- 2022Neural Approaches to Multilingual Information Retrievalcited by 18
- 2022Language Agnostic Multilingual Information Retrieval with Contrastive Learningcited by 8
- 2023Leveraging Domain Adaptation and Data Augmentation to Improve Qur'anic IR in English and Arabiccited by 4
- 2025Multi-stage Training of Bilingual Islamic LLM for Neural Passage Retrievalcited by 4
- 2024Building an Efficient Multilingual Non-Profit IR System for the Islamic Domain Leveraging Multiprocessing Design in Rustcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.