CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction
Not on the map. Why?
Cited by 23 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this paper, we introduce the Chinese AI and Law challenge dataset (CAIL2018), the first large-scale Chinese legal dataset for judgment prediction. dataset contains more than 2.6 million criminal cases published by the Supreme People's Court of China, which are several times larger than other datasets in existing works on judgment prediction. Moreover, the annotations of judgment results are more detailed and rich. It consists of applicable law articles, charges, and prison terms, which are expected to be inferred according to the fact descriptions of cases. For comparison, we implement several conventional text classification baselines for judgment prediction and experimental results show that it is still a challenge for current models to predict the judgment results of legal cases, especially on prison terms. To help the researchers make improvements on legal judgment prediction, both dataset and baselines will be released after the CAIL competitionfootnotehttp://cail.cipsc.org.cn/.
Key facts. Cited by 168 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 13; 2023: 27; 2024: 37; 2025: 39; 2026: 36.
168 papers.
Sort:
By area:
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 115
- 2021ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanationcited by 78
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2023Lawyer LLaMA Technical Reportcited by 54
- 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 51
- 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 48
- 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 45
38 more
- 2022A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Predictioncited by 44
- 2024Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challengescited by 42
- 2021A Statutory Article Retrieval Dataset in Frenchcited by 40
- 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentationcited by 39
- 2023Legal Syllogism Prompting: Teaching Large Language Models for Legal Judgment Predictioncited by 37
- 2022LEVEN: A Large-Scale Chinese Legal Event Detection Datasetcited by 36
- 2024LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Modelscited by 36
- 2025Fine-tuning Large Language Models for Improving Factuality in Legal Question Answeringcited by 28
- 2023A Comprehensive Evaluation of Large Language Models on Legal Judgment Predictioncited by 27
- 2022Corpus for Automatic Structuring of Legal Documentscited by 25
- 2021Legal Judgment Prediction with Multi-Stage CaseRepresentation Learning in the Real Court Settingcited by 24
- 2021LeSICiN: A Heterogeneous Graph-based Approach for Automatic Legal Statute Identification from Indian Legal Documentscited by 23
- 2024Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Modelscited by 23
- 2021Factoring Statutory Reasoning as Language Understanding Challengescited by 20
- 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversationcited by 19
- 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
- 2023Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoningcited by 17
- 2022On the Role of Negative Precedent in Legal Outcome Predictioncited by 16
- 2022An Empirical Study on Cross-X Transfer for Legal Judgment Predictioncited by 16
- 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Predictioncited by 16
- 2021Learning Fine-grained Fact-Article Correspondence in Legal Casescited by 15
- 2021Multi-granular Legal Topic Classification on Greek Legislationcited by 15
- 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Supportcited by 15
- 2024Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courtscited by 15
- 2021Everything Has a Cause: Leveraging Causal Inference in Legal Text Analysiscited by 14
- 2023CaseEncoder: A Knowledge-enhanced Pre-trained Model for Legal Case Encodingcited by 14
- 2023The Cambridge Law Corpus: A Dataset for Legal AI Researchcited by 14
- 2024LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultationcited by 14
- 2024Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaborationcited by 14
- 2021Dependency Learning for Legal Judgment Prediction with a Unified Text-to-Text Transformercited by 13
- 2024Re-TASK: Revisiting LLM Tasks from Capability, Skill, and Knowledge Perspectivescited by 13
- 2026PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practicecited by 13
- 2023Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise: A Case Study on Chinese Legal Domaincited by 12
- 2021Equality before the Law: Legal Judgment Consistency Analysis for Fairnesscited by 11
- 2022CINO: A Chinese Minority Pre-trained Language Modelcited by 11
- 2022HLDC: Hindi Legal Documents Corpuscited by 11
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gaincited by 11
- 2023BLT: Can Large Language Models Handle Basic Legal Text?cited by 10
50 most cited of 168 All 168 (JSON)
- 2026JusticeAxis: Benchmarking Legal Judgment between Rigid Rule Application and Ungrounded Discretion30 Sep 2026
- 2026How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards16 Sep 2026
- 2026Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models11 Sep 2026
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors9 Sep 2026
- 2026LexIssue: Benchmarking Legal Issue Identification in Chinese Civil Litigation2 Sep 2026
- 2026OBJECTION! Lawyer Agents Mitigate Guilty Bias in Legal Judgment Prediction2 Sep 2026
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction30 Aug 2026
- 2026LexKairos: Benchmarking Legal Temporal Capabilities in LLMs10 Aug 2026
- 2026CrossLex: A Source-Grounded Benchmark for Cross-Jurisdictional Legal Reasoning in Large Language Models2 Aug 2026
- 2026Semantics of Subterfuge: Benchmarking Legal Deception Detection Against General-domain State-of-the-Art31 Jul 2026
- 2026LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports23 Jul 2026
- 2026When Do LLMs Apply the Wrong Law? Diagnosing LLM Failures in Temporal Legal Reasoning8 Jul 2026
38 more
- 2026Peeking Inside LLMs: Leveraging Internal Artifacts of LLMs for Enhancing Reliability in Legal Classification18 Jun 2026
- 2026LegalWorld: A Life-Cycle Interactive Environment for Legal Agents17 Jun 2026
- 2026An Ontology-Guided Multi-Anchor Graph Retrieval Framework for Traffic Legal Liability Determination10 Jun 2026
- 2026LexRubric: A Rubric-Guided Diagnostic Benchmark for Open-Ended Legal Tasks8 Jun 2026
- 2026HKJudge: A Legal Discourse-Annotated Corpus for Interpreting What Courts Find, How They Reason, and What They Rule4 Jun 2026
- 2026The Cases LJP Never Sees: Prosecution Decision Prediction for More Complete Criminal Liability Assessment27 May 2026
- 2026LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning27 May 2026
- 2026TypedCSIP: Typed Counterfactual Pretraining for Chinese Legislative Conflict Classification25 May 2026
- 2026GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment19 May 2026
- 2026Retrieval-Based Multi-Label Legal Annotation: Extensible, Data-Efficient and Hallucination-Free16 May 2026
- 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoning9 May 2026
- 2026RPS: Information Elicitation with Reinforcement Prompt Selection15 Apr 2026
- 2026VERDICT: Verifiable Evolving Reasoning with Directive-Informed Collegial Teams for Legal Judgment Prediction13 Mar 2026
- 2026LLM-Assisted Causal Structure Disambiguation and Factor Extraction for Legal Judgment Prediction12 Mar 2026
- 2026LAMUS: A Large-Scale Corpus for Legal Argument Mining from U.S. Caselaw using LLMs9 Mar 2026
- 2026Vichara: Appellate Judgment Prediction and Explanation for the Indian Judicial System20 Feb 2026
- 2026CLASE: A Hybrid Method for Chinese Legalese Stylistic Evaluation13 Feb 2026
- 2026Multi-Source Retrieval and Reasoning for Legal Sentencing Prediction4 Feb 2026
- 2026ILSIC: Corpora for Identifying Indian Legal Statutes from Queries by Laypeople31 Jan 2026
- 2026AR-BENCH: Benchmarking Legal Reasoning with Judgment Error Detection, Classification and Correction30 Jan 2026
- 2026PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice23 Jan 2026
- 2026Evaluation of Large Language Models in Legal Applications: Challenges, Methods, and Future Directions21 Jan 2026
- 2026Logic-Guided Multistage Inference for Explainable Multidefendant Judgment Prediction19 Jan 2026
- 2026LRAS: Advanced Legal Reasoning with Agentic Search12 Jan 2026
- 2025ReGal: A First Look at PPO-based Legal AI for Judgment Prediction and Summarization in India19 Dec 2025
- 2025IL-PCSR: Legal Corpus for Prior Case and Statute Retrieval31 Oct 2025
- 2025CAPC-CG: A Large-Scale, Expert-Directed LLM-Annotated Corpus of Adaptive Policy Communication in China10 Oct 2025
- 2025Judging by Appearances? Auditing and Intervening Vision-Language Models for Bail Prediction30 Sep 2025
- 2025Universal Legal Article Prediction via Tight Collaboration between Supervised Classification Model and LLM26 Sep 2025
- 2025Understanding Benchmark Language Under Weakened Formal Semantics22 Sep 2025
- 2025Large Language Models Meet Legal Artificial Intelligence: A Survey12 Sep 2025
- 2025PL-CA: A Parametric Legal Case Augmentation Framework8 Sep 2025
- 2025Chinese Court Simulation with LLM-Based Agent System24 Aug 2025
- 2025GLARE: Agentic Reasoning for Legal Judgment Prediction22 Aug 2025
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain17 Aug 2025
- 2025IBPS: Indian Bail Prediction System11 Aug 2025
- 2025ContractEval: Benchmarking LLMs for Clause-Level Legal Risk Identification in Commercial Contracts5 Aug 2025
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System1 Aug 2025
50 newest of 168 All 168 (JSON)
- 2023Legal Syllogism Prompting: Teaching Large Language Models for Legal Judgment Predictioncited by 37
- 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Predictioncited by 16
- 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Supportcited by 15
- 2024Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaborationcited by 14
- 2024Re-TASK: Revisiting LLM Tasks from Capability, Skill, and Knowledge Perspectivescited by 13
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gaincited by 11
- 2024Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Modelscited by 10
- 2026LRAS: Advanced Legal Reasoning with Agentic Searchcited by 8
- 2025Legal Mathematical Reasoning with LLMs: Procedural Alignment through Two-Stage Reinforcement Learningcited by 7
- 2025GLARE: Agentic Reasoning for Legal Judgment Predictioncited by 6
- 2024Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoningcited by 5
- 2025JUREX-4E: Juridical Expert-Annotated Four-Element Knowledge Base for Legal Reasoningcited by 5
12 most cited of 23 All 23 (JSON)
- 2026Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models11 Sep 2026
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction30 Aug 2026
- 2026CrossLex: A Source-Grounded Benchmark for Cross-Jurisdictional Legal Reasoning in Large Language Models2 Aug 2026
- 2026When Do LLMs Apply the Wrong Law? Diagnosing LLM Failures in Temporal Legal Reasoning8 Jul 2026
- 2026LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning27 May 2026
- 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoning9 May 2026
- 2026Multi-Source Retrieval and Reasoning for Legal Sentencing Prediction4 Feb 2026
- 2026AR-BENCH: Benchmarking Legal Reasoning with Judgment Error Detection, Classification and Correction30 Jan 2026
- 2026LRAS: Advanced Legal Reasoning with Agentic Search12 Jan 2026
- 2025GLARE: Agentic Reasoning for Legal Judgment Prediction22 Aug 2025
- 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain17 Aug 2025
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning13 Jun 2025
12 newest of 23 All 23 (JSON)
- 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentationcited by 39
- 2024LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultationcited by 14
- 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justicecited by 10
- 2025Debate-Feedback: A Multi-Agent Framework for Efficient Legal Judgment Predictioncited by 9
- 2025Chinese Court Simulation with LLM-Based Agent Systemcited by 7
- 2025Chinese Court Simulation with LLM-Based Agent System24 Aug 2025
- 2025Debate-Feedback: A Multi-Agent Framework for Efficient Legal Judgment Prediction7 Apr 2025
- 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justice24 Dec 2024
- 2024LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultation23 Jul 2024
- 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation5 Mar 2024
- 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversationcited by 19
- 2025LRAGE: Legal Retrieval Augmented Generation Evaluation Toolcited by 5
- 2024Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Modelscited by 2
- 2026LexIssue: Benchmarking Legal Issue Identification in Chinese Civil Litigationcited by 0
- 2026LexIssue: Benchmarking Legal Issue Identification in Chinese Civil Litigation2 Sep 2026
- 2025LRAGE: Legal Retrieval Augmented Generation Evaluation Tool2 Apr 2025
- 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversation28 Feb 2025
- 2024Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Models15 Oct 2024
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 115
- 2021ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanationcited by 78
- 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2023Lawyer LLaMA Technical Reportcited by 54
- 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 51
- 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
- 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 48
- 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 45
12 most cited of 133 All 133 (JSON)
- 2026JusticeAxis: Benchmarking Legal Judgment between Rigid Rule Application and Ungrounded Discretion30 Sep 2026
- 2026How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards16 Sep 2026
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors9 Sep 2026
- 2026OBJECTION! Lawyer Agents Mitigate Guilty Bias in Legal Judgment Prediction2 Sep 2026
- 2026LexKairos: Benchmarking Legal Temporal Capabilities in LLMs10 Aug 2026
- 2026Semantics of Subterfuge: Benchmarking Legal Deception Detection Against General-domain State-of-the-Art31 Jul 2026
- 2026LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports23 Jul 2026
- 2026Peeking Inside LLMs: Leveraging Internal Artifacts of LLMs for Enhancing Reliability in Legal Classification18 Jun 2026
- 2026LegalWorld: A Life-Cycle Interactive Environment for Legal Agents17 Jun 2026
- 2026An Ontology-Guided Multi-Anchor Graph Retrieval Framework for Traffic Legal Liability Determination10 Jun 2026
- 2026LexRubric: A Rubric-Guided Diagnostic Benchmark for Open-Ended Legal Tasks8 Jun 2026
- 2026HKJudge: A Legal Discourse-Annotated Corpus for Interpreting What Courts Find, How They Reason, and What They Rule4 Jun 2026
12 newest of 133 All 133 (JSON)