LegalCheck: Retrieval- and Context-Augmented Generation for Drafting Municipal Legal Advice Letters
Not on the map. Why?
Abstract (arXiv)
Public-sector legal departments in the Netherlands face acute staff shortages, increased case volumes, and increased pressure to meet regulatory compliance. This paper presents LegalCheck, a novel system that addresses these challenges by automating the drafting of objection response letters through a combination of Retrieval-Augmented Generation (RAG) and Context-Augmented Generation (CAG). Using a large language model (LLM) alongside curated legal knowledge bases, LegalCheck performs retrieval of relevant laws and precedents, and uses controlled prompting to incorporate both external knowledge and case-specific details into a coherent draft. An expert-in-the-loop review ensures that each generated letter is legally sound and contextually appropriate. In a real-world deployment within the Municipality of Amsterdam, LegalCheck produced near-final advice letters in minutes rather than hours, while maintaining high legal consistency and factual accuracy. The output is based on actual regulations and prior cases, providing explainable outputs that captured the vast majority of required legal reasoning (often 80% to 100% of essential content). Legal professionals found that the system reduced their workload and ensured a consistent application of legal standards, without replacing human judgment. These results demonstrate substantial efficiency gains, improved legal consistency, and positive user acceptance. More broadly, this work illustrates how responsible AI can be deployed in the legal domain by augmenting LLMs with domain knowledge and governance mechanisms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 37 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
5 of 37 references.
References · 5
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 176
- 2024CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question Answeringcited by 72
- 2025Source Attribution in Retrieval-Augmented Generationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domain
- 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversation
- 2026CanLegalRAGBench: Evaluating Retrieval-Augmented Generation on Canadian Case Law
- 2025All for law and law for all: Adaptive RAG Pipeline for Legal Research
- 2024CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation
- 2025ASVRI-Legal: Fine-Tuning LLMs with Retrieval Augmented Generation for Enhanced Legal Regulation
- 2026Fine-grained Claim-level RAG Benchmark for Law
- 2026Legal-DC: Benchmarking Retrieval-Augmented Generation for Legal Documents