mlsanityData to 14 Oct 2026

Advancing Risk and Quality Assurance: A RAG Chatbot for Improved Regulatory Compliance

arXiv 2507.16711 ↗First posted 22 Jul 2025cs.CL cs.AIcited by 4

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

Risk and Quality (R&Q) assurance in highly regulated industries requires constant navigation of complex regulatory frameworks, with employees handling numerous daily queries demanding accurate policy interpretation. Traditional methods relying on specialized experts create operational bottlenecks and limit scalability. We present a novel Retrieval Augmented Generation (RAG) system leveraging Large Language Models (LLMs), hybrid search and relevance boosting to enhance R&Q query processing. Evaluated on 124 expert-annotated real-world queries, our actively deployed system demonstrates substantial improvements over traditional RAG approaches. Additionally, we perform an extensive hyperparameter analysis to compare and evaluate multiple configuration setups, delivering valuable insights to practitioners.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 4 of its 5 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

4 of 5 references.

References · 4

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

  1. 2025RAGulating Compliance: A Multi-Agent Knowledge Graph for Regulatory QAcited by 6
  2. 2026Domain-Adaptation through Synthetic Data: Fine-Tuning Large Language Models for German Lawcited by 2
  3. 2025Multi-Modal Vision vs. Text-Based Parsing: Benchmarking LLM Strategies for Invoice Processingcited by 1
  4. 2026Automated Regulatory Compliance Question Answering in Financial Services with Domain-Adapted Retrieval-Augmented Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024From RAG to QA-RAG: Integrating Generative AI for Pharmaceutical Regulatory Compliance Process
  2. 2026From Naive RAG to Deep Agentic Retrieval: An Evolving Context Engineering Pipeline for Regulatory Compliance
  3. 2025A Knowledge Graph and a Tripartite Evaluation Framework Make Retrieval-Augmented Generation Scalable and Transparent
  4. 2025Evaluation of retrieval-based QA on QUEST-LOFT
  5. 2025Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
  6. 2024RAG-Fusion: a New Take on Retrieval-Augmented Generation
  7. 2025Secure Multifaceted-RAG for Enterprise: Hybrid Knowledge Retrieval with Security Filtering
  8. 2026AGO AI Quality Gate: Evidence-First Release Decisions for Retrieval-Augmented Generation