Legal-DC: Benchmarking Retrieval-Augmented Generation for Legal Documents
On the map: Retrieval-augmented generation → Legal and financial RAG
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has emerged as a promising technology for legal document consultation, yet its application in Chinese legal scenarios faces two key limitations: existing benchmarks lack specialized support for joint retriever-generator evaluation, and mainstream RAG systems often fail to accommodate the structured nature of legal provisions. To address these gaps, this study advances two core contributions: First, we constructed the Legal-DC benchmark dataset, comprising 480 legal documents (covering areas such as market regulation and contract management) and 2,475 refined question-answer pairs, each annotated with clause-level references, filling the gap for specialized evaluation resources in Chinese legal RAG. Second, we propose the LegRAG framework, which integrates legal adaptive indexing (clause-boundary segmentation) with a dual-path self-reflection mechanism to ensure clause integrity while enhancing answer accuracy. Third, we introduce automated evaluation methods for large language models to meet the high-reliability demands of legal retrieval scenarios. LegRAG outperforms existing state-of-the-art methods by 1.3% to 5.6% across key evaluation metrics. This research provides a specialized benchmark, practical framework, and empirical insights to advance the development of Chinese legal RAG systems. Our code and data are available at https://github.com/legal-dc/Legal-DC.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Legal and financial RAG, one of 15 directions in Retrieval-augmented generation. Builds on 20 of its 34 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
20 of 34 references.
References · 20
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 259
- 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 136
- 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 119
- 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generationcited by 75
- 2023UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluationcited by 74
- 2023Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-Incited by 71
8 more
- 2023Lawyer LLaMA Technical Reportcited by 54
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Modelscited by 50
- 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
- 2023Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Rankingcited by 44
- 2024MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answeringcited by 43
- 2023HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responsescited by 25
- 2024Better Call GPT, Comparing Large Language Models Against Lawyerscited by 25
- 2024Enhancing Q&A with Domain-Specific Fine-Tuning and Iterative Reasoning: A Comparative Studycited by 11
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Fine-grained Claim-level RAG Benchmark for Law
- 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversation
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domain
- 2026CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method
- 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal System
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasets
- 2025A Reasoning-Focused Legal Retrieval Benchmark
- 2025All for law and law for all: Adaptive RAG Pipeline for Legal Research