mlsanityData to 7 Oct 2026

MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMs

arXiv 2603.07539 ↗First posted 8 Mar 2026cs.CLcited by 8

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Islamic inheritance law is challenging for large language models because solving inheritance cases requires complex, structured, multi-step reasoning and the correct application of juristic rules to compute heirs' shares. We introduce textitMAWARITH, a large-scale annotated dataset of 12,500 Arabic inheritance cases for training and evaluating models on the full reasoning chain: (i) identifying eligible heirs, (ii) applying blocking (textitdhajb) and allocation rules, and (iii) computing exact inheritance shares. To the best of our knowledge, textitMAWARITH is the first Arabic corpus and benchmark designed for end-to-end Islamic inheritance reasoning. Unlike prior datasets that restrict inheritance case solving to multiple-choice questions, textitMAWARITH supports the full reasoning chain and provides step-by-step solutions with justifications grounded in classical juristic sources and established inheritance rules, as well as exact share calculations. This enables models to learn how to generate detailed, step-by-step responses to user queries that reflect real-world Islamic inheritance cases. To evaluate models beyond final-answer accuracy, we propose textitMIR-E (Mawarith Inheritance Reasoning Evaluation), a weighted multi-stage metric that scores key reasoning stages and captures error propagation across the pipeline. We evaluate six large language models in a zero-shot setting. A commercial model achieves about 90%, whereas all evaluated open-source models remain below 50%. Our error analysis identifies recurring failure patterns, including scenario misinterpretation, errors in heir identification, errors in share allocation, and missing or incorrect application of key inheritance rules such as textittextquotesingle awl and textitradd. The textitMAWARITH dataset is publicly available at https://gitlab.com/nlpresearcher/mawarith.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 18 of its 40 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

18 of 40 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluation1 Sep
  2. 2025CVPD at QIAS 2025 Shared Task: An Efficient Encoder-Based Approach for Islamic Inheritance Reasoning30 Aug
  3. 2025QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance Reasoning20 Aug
  4. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models20 Aug

Other references · 14

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  7. 2025OpenAI GPT-5 System Cardcited by 910
  8. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  9. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  10. 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
  11. 2024MedExQA: Medical Question Answering Benchmark with Multiple Explanationscited by 58
  12. 2025QwenLong-L1.5: Post-Training Recipe for Long-Context Reasoning and Memory Managementcited by 24
2 more
  1. 2026From RAG to Agentic RAG for Faithful Islamic Question Answeringcited by 9
  2. 2025BriefMe: A Legal NLP Benchmark for Assisting with Legal Briefscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
  2. 2026CVPD at QIAS 2026: RAG-Guided LLM Reasoning for Al-Mawarith Share Computation and Heir Allocation
  3. 2026IslamicLegalBench: Evaluating LLMs Knowledge and Reasoning of Islamic Law Across 1,200 Years of Islamic Pluralist Legal Traditions
  4. 2025ALARB: An Arabic Legal Argument Reasoning Benchmark
  5. 2025AraTable: Benchmarking LLMs' Reasoning and Understanding of Arabic Tabular Data
  6. 2026SAHM: A Benchmark for Arabic Financial and Shari'ah-Compliant Reasoning
  7. 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Models
  8. 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain