mlsanityData to 14 Oct 2026

QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning

arXiv 2606.13756 ↗First posted 11 Jun 2026cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper presents a comprehensive overview of the QIAS 2026 shared task, organized as part of the OSACT7 Workshop and co-located with LREC 2026. The shared task was designed to evaluate the ability of large language models to perform complex reasoning in the religious and legal domain of Islamic inheritance. Unlike conventional question-answering benchmarks, QIAS 2026 focuses on end-to-end reasoning from natural language cases, requiring systems to perform the full inheritance calculation process, from identifying the eligible heirs to assigning the correct share to each beneficiary. To support this evaluation, the task was based on the MAWARITH benchmark, a dataset of 12,500 Arabic inheritance cases annotated with intermediate reasoning steps and final answers. System submissions were evaluated using MIR-E, a multi-step metric that measures performance across the main stages of inheritance reasoning. A total of 16 teams participated in the shared task, investigating a range of approaches, including prompting-based methods, retrieval-augmented generation, and fine-tuning strategies. The results show that Islamic inheritance remains a highly challenging benchmark for current language models, especially in stages that require precise legal interpretation and structured numerical reasoning. This overview summarizes the task design, dataset, evaluation framework, participating systems, and main results.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

12 of 34 references.

References · 12

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2026Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scalingcited by 13
  4. 2025Assessing Large Language Models on Islamic Legal Reasoning: Evidence from Inheritance Law Evaluationcited by 10
  5. 2026From RAG to Agentic RAG for Faithful Islamic Question Answeringcited by 9
  6. 2026MAWARITH: A Dataset and Benchmark for Legal Inheritance Reasoning with LLMscited by 8
  7. 2026Fanar 2.0: Arabic Generative AI Stackcited by 8
  8. 2025BriefMe: A Legal NLP Benchmark for Assisting with Legal Briefscited by 4
  9. 2025QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance Reasoningcited by 4
  10. 2025CVPD at QIAS 2025 Shared Task: An Efficient Encoder-Based Approach for Islamic Inheritance Reasoningcited by 2
  11. 2026CVPD at QIAS 2026: RAG-Guided LLM Reasoning for Al-Mawarith Share Computation and Heir Allocationcited by 1
  12. 2026QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
  2. 2026Which Models Perform Better in Inheritance Reasoning?
  3. 2024The Qiyas Benchmark: Measuring ChatGPT Mathematical and Language Understanding in Arabic
  4. 2026IslamicLegalBench: Evaluating LLMs Knowledge and Reasoning of Islamic Law Across 1,200 Years of Islamic Pluralist Legal Traditions
  5. 2026PARSE: An Open-Domain Reasoning Question Answering Benchmark for Persian
  6. 2024BEnQA: A Question Answering and Reasoning Benchmark for Bengali and English
  7. 2025Transformer Tafsir at QIAS 2025 Shared Task: Hybrid Retrieval-Augmented Generation for Islamic Knowledge Question Answering
  8. 2025Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures