mlsanityData to 14 Oct 2026

Towards Trustworthy Legal AI through LLM Agents and Formal Reasoning

arXiv 2511.21033 ↗First posted 26 Nov 2025cs.AIcited by 5

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Legal decisions should be logical and based on statutory laws. While large language models(LLMs) are good at understanding legal text, they cannot provide verifiable justifications. We present L4L, a solver-centric framework that enforces formal alignment between LLM-based legal reasoning and statutory laws. The framework integrates role-differentiated LLM agents with SMT-backed verification, combining the flexibility of natural language with the rigor of symbolic reasoning. Our approach operates in four stages: (1) Statute Knowledge Building, where LLMs autoformalize legal provisions into logical constraints and validate them through case-level testing; (2) Dual Fact-and-Statute Extraction, in which the prosecutor-and defense-aligned agents independently map case narratives to argument tuples; (3) Solver-Centric Adjudication, where SMT solvers check the legal admissibility and consistency of the arguments against the formalized statute knowledge; (4) Judicial Rendering, in which a judge agent integrates solver-validated reasoning with statutory interpretation and similar precedents to produce a legally grounded verdict. Experiments on public legal benchmarks show that L4L consistently outperforms baselines, while providing auditable justifications that enable trustworthy legal AI.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 32 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

19 of 32 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Explainable Rule Application via Structured Prompting: A Neural-Symbolic Approach19 Jun
  2. 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Law24 Feb

Other references · 17

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
  3. 2020Logic Tensor Networkscited by 199
  4. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
  5. 2023Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergencecited by 42
  6. 2023LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Datasetcited by 38
  7. 2024LawLLM: Law Large Language Model for the US Legal Systemcited by 37
  8. 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 37
  9. 2023Unlocking Practical Applications in Legal Domain: Evaluation of GPT for Zero-Shot Semantic Annotation of Legal Textscited by 33
  10. 2025On Verifiable Legal Reasoning: A Multi-Agent Framework with Formalized Knowledge Representationscited by 18
  11. 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 13
  12. 2024Neuro-symbolic Learning Yielding Logical Constraintscited by 12
5 more
  1. 2024Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairscited by 11
  2. 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justicecited by 10
  3. 2025Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Usecited by 6
  4. 2024Logic Rules as Explanations for Legal Case Retrievalcited by 5
  5. 2024Gaps or Hallucinations? Gazing into Machine-Generated Legal Analysis for Fine-grained Text Evaluationscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning
  2. 2025A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences
  3. 2026Know Your Limits : On the Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning
  4. 2026Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI
  5. 2026Which Changes Matter? Towards Trustworthy Legal AI via Relevance-Sensitive Evaluation and Solver-Grounded Reasoning
  6. 2024Software Engineering Methods For AI-Driven Deductive Legal Reasoning
  7. 2025Better Call CLAUSE: A Discrepancy Benchmark for Auditing LLMs Legal Reasoning Capabilities
  8. 2024LegalAgentBench: Evaluating LLM Agents in Legal Domain