ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detection
Not on the map. Why?
Abstract (arXiv)
Financial institutions must track over 60,000 regulatory events annually, overwhelming manual compliance teams; the industry has paid over USD 300 billion in fines and settlements since the 2008 financial crisis. We present ComplianceNLP, an end-to-end system that automatically monitors regulatory changes, extracts structured obligations, and identifies compliance gaps against institutional policies. The system integrates three components: (1) a knowledge-graph-augmented RAG pipeline grounding generations in a regulatory knowledge graph of 12,847 provisions across SEC, MiFID II, and Basel III; (2) multi-task obligation extraction combining NER, deontic classification, and cross-reference resolution over a shared LEGAL-BERT encoder; and (3) compliance gap analysis that maps obligations to internal policies with severity-aware scoring. On our benchmark, ComplianceNLP achieves 87.7 F1 on gap detection, outperforming GPT-4o+RAG by +3.5 F1, with 94.2% grounding accuracy (r=0.83 vs. human judgments) and 83.4 F1 under realistic end-to-end error propagation. Ablations show that knowledge-graph re-ranking contributes the largest marginal gain (+4.6 F1), confirming that structural regulatory knowledge is critical for cross-reference-heavy tasks. Domain-specific knowledge distillation (70B → 8B) combined with Medusa speculative decoding yields 2.8× inference speedup; regulatory text's low entropy (H=2.31 bits vs. 3.87 general text) produces 91.3% draft-token acceptance rates. In four months of parallel-run deployment processing 9,847 updates at a financial institution, the system achieved 96.0% estimated recall and 90.7% precision, with a 3.1× sustained analyst efficiency gain. We report deployment lessons on trust calibration, GRC integration, and distributional shift monitoring for regulated-domain NLP.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
22 of 40 references.
References · 22
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 975
- 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 821
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
10 more
- 2022Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Datasetcited by 113
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 113
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 59
- 2024Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challengescited by 42
- 2020A Dataset of German Legal Documents for Named Entity Recognitioncited by 24
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
- 2022NLP-based Automated Compliance Checking of Data Processing Agreements against GDPRcited by 18
- 2021Regulatory Compliance through Doc2Doc Information Retrieval: A case study in EU/UK legislation where text similarity has limitationscited by 13
- 2022Agent-Specific Deontic Modality Detection in Legal Languagecited by 7
- 2025CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generationcited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ARCCS: An Automated Regulatory Compliance Checking System
- 2026CTRAG: An In-Context Retrieval-based Framework for Automated Compliance Checking using LLMs
- 2025Compliance-to-Code: Enhancing Financial Compliance Checking via Code Generation
- 2025Regulatory Graphs and GenAI for Real-Time Transaction Monitoring and Compliance Explanation in Banking
- 2026REGREACT: Self-Correcting Multi-Agent Pipelines for Structured Regulatory Information Extraction
- 2025Explainable Compliance Detection with Multi-Hop Natural Language Inference on Assurance Case Structure
- 2025GraphCompliance: Aligning Policy and Context Graphs for LLM-Based Regulatory Compliance
- 2026De Jure: Iterative LLM Self-Refinement for Structured Extraction of Regulatory Rules