mlsanityData to 7 Oct 2026

De Jure: Iterative LLM Self-Refinement for Structured Extraction of Regulatory Rules

arXiv 2604.02276 ↗First posted 2 Apr 2026cs.AI cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Regulatory documents encode legally binding obligations that LLM-based systems must respect. Yet converting dense, hierarchically structured legal text into machine-readable rules remains a costly, expert-intensive process. We present De Jure, a fully automated, domain-agnostic pipeline for extracting structured regulatory rules from raw documents, requiring no human annotation, domain-specific prompting, or annotated gold data. De Jure operates through four sequential stages: normalization of source documents into structured Markdown; LLM-driven semantic decomposition into structured rule units; multi-criteria LLM-as-a-judge evaluation across 19 dimensions spanning metadata, definitions, and rule semantics; and iterative repair of low-scoring extractions within a bounded regeneration budget, where upstream components are repaired before rule units are evaluated. We evaluate De Jure across four models on three regulatory corpora spanning finance, healthcare, and AI governance. On the finance domain, De Jure yields consistent and monotonic improvement in extraction quality, reaching peak performance within three judge-guided iterations. De Jure generalizes effectively to healthcare and AI governance, maintaining high performance across both open- and closed-source models. In a downstream compliance question-answering evaluation via RAG, responses grounded in De Jure extracted rules are preferred over prior work in 73.8% of cases at single-rule retrieval depth, rising to 84.0% under broader retrieval, confirming that extraction fidelity translates directly into downstream utility. These results demonstrate that explicit, interpretable evaluation criteria can substitute for human annotation in complex regulatory domains, offering a scalable and auditable path toward regulation-grounded LLM alignment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

21 of 42 references.

References · 21

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2017Deep reinforcement learning from human preferencescited by 3,846
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  9. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  10. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  11. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  12. 2023BloombergGPT: A Large Language Model for Financecited by 923
9 more
  1. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  2. 2023FinGPT: Open-Source Financial Large Language Modelscited by 244
  3. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
  4. 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 145
  5. 2018CLAUDETTE: an Automated Detector of Potentially Unfair Clauses in Online Terms of Servicecited by 72
  6. 2024Docling Technical Reportcited by 29
  7. 2022Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humanscited by 23
  8. 2025Executable Governance for AI: Translating Policies into Rules Using LLMscited by 3
  9. 2025Toward Robust Legal Text Formalization into Defeasible Deontic Logic using LLMscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026REGREACT: Self-Correcting Multi-Agent Pipelines for Structured Regulatory Information Extraction
  2. 2025Metadata Extraction Leveraging Large Language Models
  3. 2026Code-as-Auditor: Executable Compliance Reasoning via Regulation-to-Code
  4. 2026From Naive RAG to Deep Agentic Retrieval: An Evolving Context Engineering Pipeline for Regulatory Compliance
  5. 2026ARCCS: An Automated Regulatory Compliance Checking System
  6. 2025GraphCompliance: Aligning Policy and Context Graphs for LLM-Based Regulatory Compliance
  7. 2026Navigating Global AI Regulation: A Multi-Jurisdictional Retrieval-Augmented Generation System
  8. 2025ASVRI-Legal: Fine-Tuning LLMs with Retrieval Augmented Generation for Enhanced Legal Regulation