QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning
Not on the map. Why?
Abstract (arXiv)
This paper presents a comprehensive overview of the QIAS 2026 shared task, organized as part of the OSACT7 Workshop and co-located with LREC 2026. The shared task was designed to evaluate the ability of large language models to perform complex reasoning in the religious and legal domain of Islamic inheritance. Unlike conventional question-answering benchmarks, QIAS 2026 focuses on end-to-end reasoning from natural language cases, requiring systems to perform the full inheritance calculation process, from identifying the eligible heirs to assigning the correct share to each beneficiary. To support this evaluation, the task was based on the MAWARITH benchmark, a dataset of 12,500 Arabic inheritance cases annotated with intermediate reasoning steps and final answers. System submissions were evaluated using MIR-E, a multi-step metric that measures performance across the main stages of inheritance reasoning. A total of 16 teams participated in the shared task, investigating a range of approaches, including prompting-based methods, retrieval-augmented generation, and fine-tuning strategies. The results show that Islamic inheritance remains a highly challenging benchmark for current language models, especially in stages that require precise legal interpretation and structured numerical reasoning. This overview summarizes the task design, dataset, evaluation framework, participating systems, and main results.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
12 of 34 references.
References · 12
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2026Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scalingcited by 13
- 2025Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluationcited by 10
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answeringcited by 9
- 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMscited by 8
- 2026Fanar 2.0: Arabic Generative AI Stackcited by 8
- 2025BriefMe: A Legal NLP Benchmark for Assisting with Legal Briefscited by 4
- 2025QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance Reasoningcited by 4
- 2025CVPD at QIAS 2025 Shared Task: An Efficient Encoder-Based Approach for Islamic Inheritance Reasoningcited by 2
- 2026CVPD at QIAS 2026: RAG-Guided LLM Reasoning for Al-Mawarith Share Computation and Heir Allocationcited by 1
- 2026QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoningcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answeringcited by 2
- 2026HalluTruthQA-4K: A Fine-Grained Corpus and Annotation Process for Arabic Hallucination Detection and Truth Verificationcited by 1
- 2026Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AIcited by 0
- 2026What Makes a Good Fiqh Retriever? Answer Retrieval for Arabic Islamic Jurisprudencecited by 0
- 2026What Makes a Good Fiqh Retriever? Answer Retrieval for Arabic Islamic Jurisprudence20 Aug 2026
- 2026HalluTruthQA-4K: A Fine-Grained Corpus and Annotation Process for Arabic Hallucination Detection and Truth Verification4 Aug 2026
- 2026HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answering22 Jul 2026
- 2026Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AI15 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
- 2026Which Models Perform Better in Inheritance Reasoning?
- 2024The Qiyas Benchmark: Measuring ChatGPT Mathematical and Language Understanding in Arabic
- 2026IslamicLegalBench: Evaluating LLMs Knowledge and Reasoning of Islamic Law Across 1,200 Years of Islamic Pluralist Legal Traditions
- 2026PARSE: An Open-Domain Reasoning Question Answering Benchmark for Persian
- 2024BEnQA: A Question Answering and Reasoning Benchmark for Bengali and English
- 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering
- 2025Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures