Towards Trustworthy Legal AI through LLM Agents and Formal Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Legal decisions should be logical and based on statutory laws. While large language models(LLMs) are good at understanding legal text, they cannot provide verifiable justifications. We present L4L, a solver-centric framework that enforces formal alignment between LLM-based legal reasoning and statutory laws. The framework integrates role-differentiated LLM agents with SMT-backed verification, combining the flexibility of natural language with the rigor of symbolic reasoning. Our approach operates in four stages: (1) Statute Knowledge Building, where LLMs autoformalize legal provisions into logical constraints and validate them through case-level testing; (2) Dual Fact-and-Statute Extraction, in which the prosecutor-and defense-aligned agents independently map case narratives to argument tuples; (3) Solver-Centric Adjudication, where SMT solvers check the legal admissibility and consistency of the arguments against the formalized statute knowledge; (4) Judicial Rendering, in which a judge agent integrates solver-validated reasoning with statutory interpretation and similar precedents to produce a legally grounded verdict. Experiments on public legal benchmarks show that L4L consistently outperforms baselines, while providing auditable justifications that enable trustworthy legal AI.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 32 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
19 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2025Explainable Rule Application via Structured Prompting: A Neural-Symbolic Approach19 Jun
- 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Law24 Feb
Other references · 17
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
- 2020Logic Tensor Networkscited by 199
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
- 2023Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergencecited by 42
- 2023LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Datasetcited by 38
- 2024LawLLM: Law Large Language Model for the US Legal Systemcited by 37
- 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 37
- 2023Unlocking Practical Applications in Legal Domain: Evaluation of GPT for Zero-Shot Semantic Annotation of Legal Textscited by 33
- 2025On Verifiable Legal Reasoning: A Multi-Agent Framework with Formalized Knowledge Representationscited by 18
- 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 13
- 2024Neuro-symbolic Learning Yielding Logical Constraintscited by 12
5 more
- 2024Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairscited by 11
- 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justicecited by 10
- 2025Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Usecited by 6
- 2024Logic Rules as Explanations for Legal Case Retrievalcited by 5
- 2024Gaps or Hallucinations? Gazing into Machine-Generated Legal Analysis for Fine-grained Text Evaluationscited by 4
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026LLM Agents in Law: Taxonomy, Applications, and Challengescited by 5
- 2026Verification Required: The Impact of Information Credibility on AI Persuasioncited by 1
- 2026Formally Verified Patent Analysis via Dependent Type Theory: Machine-Checkable Certificates from a Hybrid AI + Lean 4 Pipelinecited by 1
- 2026REGREACT: Self-Correcting Multi-Agent Pipelines for Structured Regulatory Information Extractioncited by 0
- 2026Probing the Structure and Dynamics of LLM Value Expression through Value Conflictscited by 0
- 2026Probing the Structure and Dynamics of LLM Value Expression through Value Conflicts7 Sep 2026
- 2026Formally Verified Patent Analysis via Dependent Type Theory: Machine-Checkable Certificates from a Hybrid AI + Lean 4 Pipeline20 Apr 2026
- 2026REGREACT: Self-Correcting Multi-Agent Pipelines for Structured Regulatory Information Extraction13 Apr 2026
- 2026Verification Required: The Impact of Information Credibility on AI Persuasion1 Feb 2026
- 2026LLM Agents in Law: Taxonomy, Applications, and Challenges8 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning
- 2025A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences
- 2026Know Your Limits : On the Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning
- 2026Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI
- 2026Which Changes Matter? Towards Trustworthy Legal AI via Relevance-Sensitive Evaluation and Solver-Grounded Reasoning
- 2024Software Engineering Methods For AI-Driven Deductive Legal Reasoning
- 2025Better Call CLAUSE: A Discrepancy Benchmark for Auditing LLMs Legal Reasoning Capabilities
- 2024LegalAgentBench: Evaluating LLM Agents in Legal Domain