QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
This paper presents our approach and results for SubTask 1: Islamic Inheritance Reasoning at QIAS 2025, a shared task focused on evaluating Large Language Models (LLMs) in understanding and reasoning within Islamic inheritance knowledge. We fine-tuned the Fanar-1-9B causal language model using Low-Rank Adaptation (LoRA) and integrated it into a Retrieval-Augmented Generation (RAG) pipeline. Our system addresses the complexities of Islamic inheritance law, including comprehending inheritance scenarios, identifying eligible heirs, applying fixed-share rules, and performing precise calculations. Our system achieved an accuracy of 0.858 in the final test, outperforming other competitive models such as, GPT 4.5, LLaMA, Fanar, Mistral and ALLaM evaluated with zero-shot prompting. Our results demonstrate that QU-NLP achieves near state-of-the-art accuracy (85.8%), excelling especially on advanced reasoning (97.6%) where it outperforms Gemini 2.5 and OpenAI's o3. This highlights that domain-specific fine-tuning combined with retrieval grounding enables mid-scale Arabic LLMs to surpass frontier models in Islamic inheritance reasoning.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 8 of its 22 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
8 of 22 references.
References · 8
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023The Falcon Series of Open Language Modelscited by 535
- 2024The Faiss librarycited by 376
- 2023Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Modelscited by 69
- 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
- 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
- 2024Improving LLM Reliability with RAG in Religious Question-Answering: MufassirQAScited by 6
- 2025From RAG to Agentic: Validating Islamic-Medicine Responses with LLM Agentscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMscited by 8
- 2026IslamicLegalBench: Evaluating LLMs Knowledge and Reasoning of Islamic Law Across 1,200 Years of Islamic Pluralist Legal Traditionscited by 5
- 2026QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoningcited by 4
- 2026Fanar-Sadiq: A Multi-Agent Architecture for Grounded Islamic QAcited by 3
- 2026QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning11 Jun 2026
- 2026Fanar-Sadiq: A Multi-Agent Architecture for Grounded Islamic QA9 Mar 2026
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs8 Mar 2026
- 2026IslamicLegalBench: Evaluating LLMs Knowledge and Reasoning of Islamic Law Across 1,200 Years of Islamic Pluralist Legal Traditions2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoning
- 2025CVPD at QIAS 2025 Shared Task: An Efficient Encoder-Based Approach for Islamic Inheritance Reasoning
- 2025Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluation
- 2026CVPD at QIAS 2026: RAG-Guided LLM Reasoning for Al-Mawarith Share Computation and Heir Allocation
- 2026Which Models Perform Better in Inheritance Reasoning?
- 2025Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
- 2026Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AI
- 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering