mlsanityData to 7 Oct 2026

Software Engineering Methods For AI-Driven Deductive Legal Reasoning

arXiv 2404.09868 ↗First posted 15 Apr 2024cs.SE cs.CL cs.CYcited by 3

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

The recent proliferation of generative artificial intelligence (AI) technologies such as pre-trained large language models (LLMs) has opened up new frontiers in computational law. An exciting area of development is the use of AI to automate the deductive rule-based reasoning inherent in statutory and contract law. This paper argues that such automated deductive legal reasoning can now be viewed from the lens of software engineering, treating LLMs as interpreters of natural-language programs with natural-language inputs. We show how it is possible to apply principled software engineering techniques to enhance AI-driven legal reasoning of complex statutes and to unlock new applications in automated meta-reasoning such as mutation-guided example generation and metamorphic property-based testing.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 31 references that are in the map. First posted on arXiv 15 Apr 2024.

Builds on

13 of 31 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  3. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  4. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  5. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
  6. 2021Explaining Answers with Entailment Treescited by 148
  7. 2020Metamorphic Testing: A New Approach for Generating Next Test Casescited by 71
  8. 2023Can GPT-3 Perform Statutory Reasoning?cited by 71
  9. 2020A Dataset for Statutory Reasoning in Tax Law Entailment and Question Answeringcited by 61
  10. 2023Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergencecited by 42
  11. 2021Factoring Statutory Reasoning as Language Understanding Challengescited by 20
  12. 2021Catala: A Programming Language for the Lawcited by 18
1 more
  1. 2022Metamorphic Testing and Debugging of Tax Preparation Softwarecited by 7

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning
  2. 2025Towards Trustworthy Legal AI through LLM Agents and Formal Reasoning
  3. 2025On Verifiable Legal Reasoning: A Multi-Agent Framework with Formalized Knowledge Representations
  4. 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Law
  5. 2026Know Your Limits : On the Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning
  6. 2025Artificial Intelligence and Legal Analysis: Implications for Legal Education and the Profession
  7. 2026Accurate Legal Reasoning at Scale: Neuro-Symbolic Offloading and Structural Auditability for Robust Legal Adjudication
  8. 2025Challenges for Generative AI in Legal Reasoning