Legal Mathematical Reasoning with LLMs: Procedural Alignment through Two-Stage Reinforcement Learning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Legal mathematical reasoning is essential for applying large language models (LLMs) in high-stakes legal contexts, where outputs must be both mathematically accurate and procedurally compliant. However, existing legal LLMs lack structured numerical reasoning, and open-domain models, though capable of calculations, often overlook mandatory legal steps. To address this, we present LexNum, the first Chinese legal mathematical reasoning benchmark, covering three representative scenarios where each instance reflects legally grounded procedural flows. We further propose LexPam, a two-stage reinforcement learning framework for efficient legal reasoning training. Leveraging curriculum learning, we use a stronger teacher model to partition data into basic and challenging subsets. A lightweight 1.5B student model is then fine-tuned with Group Relative Policy Optimization, which avoids costly value networks and enables stable training from sparse, end-of-sequence rewards. The first stage improves accuracy and format; the second introduces a novel reward to guide procedural alignment via task-specific legal elements. Experiments show that existing models perform poorly on LexNum, while LexPam enhances both mathematical accuracy and legal coherence, and generalizes effectively across tasks and domains.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 21 of its 26 references that are in the map. First posted on arXiv 3 Apr 2025.
Builds on
21 of 26 references.
Closest ancestors · 4
Same direction, newest first
- 2025Evaluating Test-Time Scaling LLMs for Legal Reasoning: OpenAI o1, DeepSeek-R1, and Beyond20 Mar
- 2024Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning19 Dec
- 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction2 Jul
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
Other references · 17
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2025s1: Simple test-time scalingcited by 1,311
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2025LIMO: Less is More for Reasoningcited by 488
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruningcited by 278
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
- 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 115
- 2022LEVEN: A Large-Scale Chinese Legal Event Detection Datasetcited by 36
5 more
- 2022Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extractioncited by 21
- 2023Mixed Distillation Helps Smaller Language Model Better Reasoningcited by 18
- 2024CitaLaw: Enhancing LLM with Citations in Legal Domaincited by 16
- 2023Explicitly Integrating Judgment Prediction with Legal Document Retrieval: A Law-Guided Generative Approachcited by 14
- 2024Logic Rules as Explanations for Legal Case Retrievalcited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gaincited by 11
- 2025PrLM: Learning Explicit Reasoning for Personalized RAG via Contrastive Reward Optimizationcited by 8
- 2026LRAS: Advanced Legal Reasoning with Agentic Searchcited by 8
- 2026PoliLegalLM: A Technical Report on a Large Language Model for Political and Legal Affairscited by 0
- 2026Relation Reasoning with LLMs in Expensive Optimizationcited by 0
- 2026Time as Structure: Temporal Dependency Graphs for Verifiable Deadline Computation over Legal Documentscited by 0
- 2026LexReward: A Taxonomy-Driven Reward Framework for Legal Language Modelscited by 0
- 2026LexReward: A Taxonomy-Driven Reward Framework for Legal Language Models30 Sep 2026
- 2026Time as Structure: Temporal Dependency Graphs for Verifiable Deadline Computation over Legal Documents15 Aug 2026
- 2026Relation Reasoning with LLMs in Expensive Optimization30 Apr 2026
- 2026PoliLegalLM: A Technical Report on a Large Language Model for Political and Legal Affairs19 Apr 2026
- 2026LRAS: Advanced Legal Reasoning with Agentic Search12 Jan 2026
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain17 Aug 2025
- 2025PrLM: Learning Explicit Reasoning for Personalized RAG via Contrastive Reward Optimization10 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoning
- 2025Unilaw-R1: A Large Language Model for Legal Reasoning with Reinforcement Learning and Iterative Inference
- 2023Enhancing Logical Reasoning in Large Language Models to Facilitate Legal Applications
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction
- 2025LexPro-1.0 Technical Report
- 2025An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
- 2025Continual Pre-Training is (not) What You Need in Domain Adaption
- 2024LegalAgentBench: Evaluating LLM Agents in Legal Domain