ClaimGen-CN: A Large-scale Chinese Dataset for Legal Claim Generation
Not on the map. Why?
Abstract (arXiv)
Legal claims refer to the plaintiff's demands in a case and are essential to guiding judicial reasoning and case resolution. While many works have focused on improving the efficiency of legal professionals, the research on helping non-professionals (e.g., plaintiffs) remains unexplored. This paper explores the problem of legal claim generation based on the given case's facts. First, we construct ClaimGen-CN, the first dataset for Chinese legal claim generation task, from various real-world legal disputes. Additionally, we design an evaluation metric tailored for assessing the generated claims, which encompasses two essential dimensions: factuality and clarity. Building on this, we conduct a comprehensive zero-shot evaluation of state-of-the-art general and legal-domain large language models. Our findings highlight the limitations of the current models in factual precision and expressive clarity, pointing to the need for more targeted development in this domain. To encourage further exploration of this important task, we will make the dataset publicly available.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 54 references that are in the map. First posted on arXiv 24 Aug 2025.
Builds on
20 of 54 references.
References · 20
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 674
- 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2017Why We Need New Evaluation Metrics for NLGcited by 233
- 2020How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligencecited by 129
- 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 116
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
- 2023LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scorescited by 90
- 2021ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanationcited by 78
8 more
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2018The price of debiasing automatic metrics in natural language evaluationcited by 60
- 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
- 2023Natural Language Processing in the Legal Domaincited by 38
- 2018LexNLP: Natural language processing and information extraction for legal and regulatory textscited by 28
- 2021Legal Judgment Prediction with Multi-Stage CaseRepresentation Learning in the Real Court Settingcited by 24
- 2018Automatic Judgment Prediction via Legal Reading Comprehensioncited by 19
- 2020Hier-SPCNet: A Legal Statute Hierarchy-based Heterogeneous Network for Computing Legal Case Document Similaritycited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.