MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Islamic inheritance law is challenging for large language models because solving inheritance cases requires complex, structured, multi-step reasoning and the correct application of juristic rules to compute heirs' shares. We introduce textitMAWARITH, a large-scale annotated dataset of 12,500 Arabic inheritance cases for training and evaluating models on the full reasoning chain: (i) identifying eligible heirs, (ii) applying blocking (textitdhajb) and allocation rules, and (iii) computing exact inheritance shares. To the best of our knowledge, textitMAWARITH is the first Arabic corpus and benchmark designed for end-to-end Islamic inheritance reasoning. Unlike prior datasets that restrict inheritance case solving to multiple-choice questions, textitMAWARITH supports the full reasoning chain and provides step-by-step solutions with justifications grounded in classical juristic sources and established inheritance rules, as well as exact share calculations. This enables models to learn how to generate detailed, step-by-step responses to user queries that reflect real-world Islamic inheritance cases. To evaluate models beyond final-answer accuracy, we propose textitMIR-E (Mawarith Inheritance Reasoning Evaluation), a weighted multi-stage metric that scores key reasoning stages and captures error propagation across the pipeline. We evaluate six large language models in a zero-shot setting. A commercial model achieves about 90%, whereas all evaluated open-source models remain below 50%. Our error analysis identifies recurring failure patterns, including scenario misinterpretation, errors in heir identification, errors in share allocation, and missing or incorrect application of key inheritance rules such as textittextquotesingle awl and textitradd. The textitMAWARITH dataset is publicly available at https://gitlab.com/nlpresearcher/mawarith.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 18 of its 40 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
18 of 40 references.
Closest ancestors · 4
Same direction, newest first
- 2025Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluation1 Sep
- 2025CVPD at QIAS 2025 Shared Task: An Efficient Encoder-Based Approach for Islamic Inheritance Reasoning30 Aug
- 2025QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance Reasoning20 Aug
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models20 Aug
Other references · 14
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2025OpenAI GPT-5 System Cardcited by 910
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
- 2024MedExQA: Medical Question Answering Benchmark with Multiple Explanationscited by 58
- 2025QwenLong-L1.5: Post-Training Recipe for Long-Context Reasoning and Memory Managementcited by 24
2 more
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoningcited by 4
- 2026HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answeringcited by 2
- 2026QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoningcited by 1
- 2026HalluTruthQA-4K: A Fine-Grained Corpus and Annotation Process for Arabic Hallucination Detection and Truth Verificationcited by 1
- 2026Which Models Perform Better in Inheritance Reasoning?cited by 0
- 2026Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AIcited by 0
- 2026Detecting Hallucinations and Recovering Verified Answers in Arabic Islamic Question Answeringcited by 0
- 2026IslamicTurathBench: A Multi-Task, Multi-Discipline Benchmark for Evaluating Large Language Models on the Islamic Scholarly Tradition (turath)cited by 0
- 2026IslamicTurathBench: A Multi-Task, Multi-Discipline Benchmark for Evaluating Large Language Models on the Islamic Scholarly Tradition (turath)5 Aug 2026
- 2026HalluTruthQA-4K: A Fine-Grained Corpus and Annotation Process for Arabic Hallucination Detection and Truth Verification4 Aug 2026
- 2026Detecting Hallucinations and Recovering Verified Answers in Arabic Islamic Question Answering4 Aug 2026
- 2026HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answering22 Jul 2026
- 2026Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AI15 Jun 2026
- 2026QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning11 Jun 2026
- 2026Which Models Perform Better in Inheritance Reasoning?11 Jun 2026
- 2026QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoning29 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
- 2026CVPD at QIAS 2026: RAG-Guided LLM Reasoning for Al-Mawarith Share Computation and Heir Allocation
- 2026IslamicLegalBench: Evaluating LLMs Knowledge and Reasoning of Islamic Law Across 1,200 Years of Islamic Pluralist Legal Traditions
- 2025ALARB: An Arabic Legal Argument Reasoning Benchmark
- 2025AraTable: Benchmarking LLMs' Reasoning and Understanding of Arabic Tabular Data
- 2026SAHM: A Benchmark for Arabic Financial and Shari'ah-Compliant Reasoning
- 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Models
- 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain