Temporal Misgrounding in Legal RAG: A Versioned-Corpus Benchmark for French Tax Law
Not on the map. Why?
Abstract (arXiv)
We identify and quantify temporal misgrounding: the systematic retrieval and citation of the currently in-force version of a legal article when the applicable version is an earlier or future one. Standard legal RAG treats the corpus as static; we argue legal question answering is a temporally-indexed retrieval problem. We introduce FiscalQA Pro, pairing a versioned corpus of 32,436 article-versions of the French tax code (93 years, 1938-2031) with an all-model-hard temporal-reasoning track: 209 scored, expert-reviewed questions across 33 CGI articles (221 released; twelve flagged out of the answerable scope). At selection time, no evaluated model recovered its date-applicable answer closed-book in any of four sampling draws, and the currently in-force text lacks the gold value for all but one of the scored questions. Answers are scored deterministically via atomic ground-truth "nuggets" (regex and numeric-with-tolerance), never LLM-as-judge: an LLM judge would inherit the temporal bias it is meant to score. Across eleven models (five frontier closed-API systems plus Gemini 2.5 Pro as a substitute entry, and five open-weight), parametric knowledge yields 3.0% mean strict accuracy and RAG over a static current-version corpus 2.7%. Static RAG retrieves the date-applicable version 0% of the time, confidently citing a real but inapplicable version. Our end-to-end retriever over a multi-version index, with no oracle, reaches 98.3% mean strict; an oracle-article ablation reaches 99.1%, locating the residual gap in first-stage recall, not version selection. We additionally release a version-aware jurisprudence dataset of 69,208 citation links, together with the corpus, benchmark, model responses, and pipeline code.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
12 of 18 references.
References · 12
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 318
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
- 2025LEXam: Benchmarking Legal Reasoning on 340 Law Examscited by 54
- 2026OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoningcited by 39
- 2021JuriBERT: A Masked-Language Model Adaptation for French Legal Textcited by 14
- 2025It's High Time: A Survey of Temporal Question Answeringcited by 14
- 2025LexTime: A Benchmark for Temporal Ordering of Legal Eventscited by 10
- 2026Fine-grained Claim-level RAG Benchmark for Lawcited by 2
- 2026Can LLMs Time Travel? Enhancing Temporal Consistency in Legal Agentic Search through Reinforcement Learningcited by 2
- 2026Asking For An Old Friend: Diagnosing and Mitigating Temporal Failure Modes in LLM-based Statutory Question Answeringcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SteuerLLM: Local specialized large language model for German tax law analysis
- 2025BR-TaxQA-R: A Dataset for Question Answering with References for Brazilian Personal Income Tax Law, including case law
- 2026Chunking German Legal Code
- 2025A Reasoning-Focused Legal Retrieval Benchmark
- 2026Legal RAG Bench: an end-to-end benchmark for legal RAG
- 2026From Judgments to Issues: Structured Extraction of Legal Reasoning with Citation-Hallucination Control
- 2025Taxation Perspectives from Large Language Models: A Case Study on Additional Tax Penalties
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models