CJRC: A Reliable Human-Annotated Benchmark DataSet for Chinese Judicial Reading Comprehension
Not on the map. Why?
Abstract (arXiv)
We present a Chinese judicial reading comprehension (CJRC) dataset which contains approximately 10K documents and almost 50K questions with answers. The documents come from judgment documents and the questions are annotated by law experts. The CJRC dataset can help researchers extract elements by reading comprehension technology. Element extraction is an important task in the legal field. However, it is difficult to predefine the element types completely due to the diversity of document types and causes of action. By contrast, machine reading comprehension technology can quickly extract elements by answering various questions from the long document. We build two strong baseline models based on BERT and BiDAF. The experimental results show that there is enough space for improvement compared to human annotators.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 8; 2024: 4; 2025: 5; 2026: 2.
26 papers.
Sort:
By area:
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
- 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Informationcited by 65
- 2022A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Predictioncited by 44
- 2021A Statutory Article Retrieval Dataset in Frenchcited by 40
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Modelscited by 35
- 2024LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Modelcited by 34
- 2023MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understandingcited by 33
- 2023VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Modelscited by 15
- 2023WYWEB: A NLP Evaluation Benchmark For Classical Chinesecited by 12
- 2022HLDC: Hindi Legal Documents Corpuscited by 11
14 more
- 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
- 2023LAiW: A Chinese Legal Large Language Models Benchmarkcited by 9
- 2022Agent-Specific Deontic Modality Detection in Legal Languagecited by 7
- 2024Event Grounded Criminal Court View Generation with Cooperative (Large) Language Modelscited by 7
- 2025AIReg-Bench: Benchmarking Language Models That Assess AI Regulation Compliancecited by 6
- 2023FedJudge: Federated Legal Large Language Modelcited by 5
- 2024Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Modelscited by 5
- 2025VLQA: The First Comprehensive, Large, and High-Quality Vietnamese Dataset for Legal Question Answeringcited by 4
- 2026CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Methodcited by 3
- 2023Analyzing Hong Kong's Legal Judgments from a Computational Linguistics point-of-viewcited by 1
- 2024LFED: A Literary Fiction Evaluation Dataset for Large Language Modelscited by 1
- 2025Simple Yet Effective: Extracting Private Data Across Clients in Federated Fine-Tuning of Large Language Modelscited by 1
- 2025CAPC-CG: A Large-Scale, Expert-Directed LLM-Annotated Corpus of Adaptive Policy Communication in Chinacited by 1
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offscited by 0
- 2026CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method18 Aug 2026
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offs15 Mar 2026
- 2025CAPC-CG: A Large-Scale, Expert-Directed LLM-Annotated Corpus of Adaptive Policy Communication in China10 Oct 2025
- 2025AIReg-Bench: Benchmarking Language Models That Assess AI Regulation Compliance1 Oct 2025
- 2025Large Language Models Meet Legal Artificial Intelligence: A Survey12 Sep 2025
- 2025VLQA: The First Comprehensive, Large, and High-Quality Vietnamese Dataset for Legal Question Answering26 Jul 2025
- 2025Simple Yet Effective: Extracting Private Data Across Clients in Federated Fine-Tuning of Large Language Models6 Jun 2025
- 2024Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models26 Jul 2024
- 2024LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model7 Jun 2024
- 2024LFED: A Literary Fiction Evaluation Dataset for Large Language Models16 May 2024
- 2024Event Grounded Criminal Court View Generation with Cooperative (Large) Language Models10 Apr 2024
- 2023LAiW: A Chinese Legal Large Language Models Benchmark9 Oct 2023
14 more
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models29 Sep 2023
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Services20 Sep 2023
- 2023FedJudge: Federated Legal Large Language Model15 Sep 2023
- 2023WYWEB: A NLP Evaluation Benchmark For Classical Chinese23 May 2023
- 2023VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models20 May 2023
- 2023Analyzing Hong Kong's Legal Judgments from a Computational Linguistics point-of-view4 May 2023
- 2023MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understanding2 Jan 2023
- 2022Agent-Specific Deontic Modality Detection in Legal Language23 Nov 2022
- 2022A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Prediction10 Jun 2022
- 2022HLDC: Hindi Legal Documents Corpus2 Apr 2022
- 2021A Statutory Article Retrieval Dataset in French26 Aug 2021
- 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information30 Jun 2021
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents9 May 2021
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review10 Mar 2021
- 2022Agent-Specific Deontic Modality Detection in Legal Language23 Nov 2022
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 116
- 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Informationcited by 65
- 2022A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Predictioncited by 44
- 2021A Statutory Article Retrieval Dataset in Frenchcited by 40
- 2024LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Modelcited by 34
- 2023MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understandingcited by 33
- 2023VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Modelscited by 15
- 2023WYWEB: A NLP Evaluation Benchmark For Classical Chinesecited by 12
- 2022HLDC: Hindi Legal Documents Corpuscited by 11
- 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
12 most cited of 23 All 23 (JSON)
- 2026An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offs15 Mar 2026
- 2025CAPC-CG: A Large-Scale, Expert-Directed LLM-Annotated Corpus of Adaptive Policy Communication in China10 Oct 2025
- 2025AIReg-Bench: Benchmarking Language Models That Assess AI Regulation Compliance1 Oct 2025
- 2025Large Language Models Meet Legal Artificial Intelligence: A Survey12 Sep 2025
- 2025VLQA: The First Comprehensive, Large, and High-Quality Vietnamese Dataset for Legal Question Answering26 Jul 2025
- 2025Simple Yet Effective: Extracting Private Data Across Clients in Federated Fine-Tuning of Large Language Models6 Jun 2025
- 2024Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models26 Jul 2024
- 2024LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model7 Jun 2024
- 2024LFED: A Literary Fiction Evaluation Dataset for Large Language Models16 May 2024
- 2024Event Grounded Criminal Court View Generation with Cooperative (Large) Language Models10 Apr 2024
- 2023LAiW: A Chinese Legal Large Language Models Benchmark9 Oct 2023
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Services20 Sep 2023
12 newest of 23 All 23 (JSON)