ASP2LJ : An Adversarial Self-Play Laywer Augmented Legal Judgment Framework
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
Legal Judgment Prediction (LJP) aims to predict judicial outcomes, including relevant legal charge, terms, and fines, which is a crucial process in Large Language Model(LLM). However, LJP faces two key challenges: (1)Long Tail Distribution: Current datasets, derived from authentic cases, suffer from high human annotation costs and imbalanced distributions, leading to model performance degradation. (2)Lawyer's Improvement: Existing systems focus on enhancing judges' decision-making but neglect the critical role of lawyers in refining arguments, which limits overall judicial accuracy. To address these issues, we propose an Adversarial Self-Play Lawyer Augmented Legal Judgment Framework, called ASP2LJ, which integrates a case generation module to tackle long-tailed data distributions and an adversarial self-play mechanism to enhance lawyers' argumentation skills. Our framework enables a judge to reference evolved lawyers' arguments, improving the objectivity, fairness, and rationality of judicial decisions. Besides, We also introduce RareCases, a dataset for rare legal cases in China, which contains 120 tail-end cases. We demonstrate the effectiveness of our approach on the SimuCourt dataset and our RareCases dataset. Experimental results show our framework brings improvements, indicating its utilization. Our contributions include an integrated framework, a rare-case dataset, and publicly releasing datasets and code to support further research in automated judicial systems.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 16 of its 46 references that are in the map. First posted on arXiv 11 Jun 2025.
Builds on
16 of 46 references.
References · 16
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 170
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 118
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
- 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
- 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentationcited by 40
- 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 37
- 2022Mining Legal Arguments in Court Decisionscited by 35
- 2021Yes, BM25 is a Strong Baseline for Legal Case Retrievalcited by 24
- 2021Legal Judgment Prediction with Multi-Stage CaseRepresentation Learning in the Real Court Settingcited by 24
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
4 more
- 2021JuriBERT: A Masked-Language Model Adaptation for French Legal Textcited by 14
- 2023Explicitly Integrating Judgment Prediction with Legal Document Retrieval: A Law-Guided Generative Approachcited by 14
- 2024Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairscited by 11
- 2025Debate-Feedback: A Multi-Agent Framework for Efficient Legal Judgment Predictioncited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System
- 2024Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning
- 2024Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Models
- 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction
- 2023Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning
- 2024Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Models
- 2025Evaluating the Limits of Large Language Models in Multilingual Legal Reasoning
- 2026Multi-Source Retrieval and Reasoning for Legal Sentencing Prediction