mlsanityData to 7 Oct 2026

Legal Mathematical Reasoning with LLMs: Procedural Alignment through Two-Stage Reinforcement Learning

arXiv 2504.02590 ↗First posted 3 Apr 2025cs.CLcited by 7

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Legal mathematical reasoning is essential for applying large language models (LLMs) in high-stakes legal contexts, where outputs must be both mathematically accurate and procedurally compliant. However, existing legal LLMs lack structured numerical reasoning, and open-domain models, though capable of calculations, often overlook mandatory legal steps. To address this, we present LexNum, the first Chinese legal mathematical reasoning benchmark, covering three representative scenarios where each instance reflects legally grounded procedural flows. We further propose LexPam, a two-stage reinforcement learning framework for efficient legal reasoning training. Leveraging curriculum learning, we use a stronger teacher model to partition data into basic and challenging subsets. A lightweight 1.5B student model is then fine-tuned with Group Relative Policy Optimization, which avoids costly value networks and enables stable training from sparse, end-of-sequence rewards. The first stage improves accuracy and format; the second introduces a novel reward to guide procedural alignment via task-specific legal elements. Experiments show that existing models perform poorly on LexNum, while LexPam enhances both mathematical accuracy and legal coherence, and generalizes effectively across tasks and domains.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 21 of its 26 references that are in the map. First posted on arXiv 3 Apr 2025.

Builds on

21 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Evaluating Test-Time Scaling LLMs for Legal Reasoning: OpenAI o1, DeepSeek-R1, and Beyond20 Mar
  2. 2024Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning19 Dec
  3. 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction2 Jul
  4. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb

Other references · 17

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2025s1: Simple test-time scalingcited by 1,311
  6. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  7. 2025LIMO: Less is More for Reasoningcited by 488
  8. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruningcited by 278
  9. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
  10. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
  11. 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 115
  12. 2022LEVEN: A Large-Scale Chinese Legal Event Detection Datasetcited by 36
5 more
  1. 2022Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extractioncited by 21
  2. 2023Mixed Distillation Helps Smaller Language Model Better Reasoningcited by 18
  3. 2024CitaLaw: Enhancing LLM with Citations in Legal Domaincited by 16
  4. 2023Explicitly Integrating Judgment Prediction with Legal Document Retrieval: A Law-Guided Generative Approachcited by 14
  5. 2024Logic Rules as Explanations for Legal Case Retrievalcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoning
  2. 2025Unilaw-R1: A Large Language Model for Legal Reasoning with Reinforcement Learning and Iterative Inference
  3. 2023Enhancing Logical Reasoning in Large Language Models to Facilitate Legal Applications
  4. 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction
  5. 2025LexPro-1.0 Technical Report
  6. 2025An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
  7. 2025Continual Pre-Training is (not) What You Need in Domain Adaption
  8. 2024LegalAgentBench: Evaluating LLM Agents in Legal Domain