mlsanityData to 7 Oct 2026

Hybrid Retrieval-Augmented Generation Agent for Trustworthy Legal Question Answering in Judicial Forensics

arXiv 2511.01668 ↗First posted 3 Nov 2025cs.AIcited by 0

On the map: Retrieval-augmented generation → Legal and financial RAG

also in 1 more
Abstract (arXiv)

As artificial intelligence permeates judicial forensics, ensuring the veracity and traceability of legal question answering (QA) has become critical. Conventional large language models (LLMs) are prone to hallucination, risking misleading guidance in legal consultation, while static knowledge bases struggle to keep pace with frequently updated statutes and case law. We present a hybrid legal QA agent tailored for judicial settings that integrates retrieval-augmented generation (RAG) with multi-model ensembling to deliver reliable, auditable, and continuously updatable counsel. The system prioritizes retrieval over generation: when a trusted legal repository yields relevant evidence, answers are produced via RAG; otherwise, multiple LLMs generate candidates that are scored by a specialized selector, with the top-ranked answer returned. High-quality outputs then undergo human review before being written back to the repository, enabling dynamic knowledge evolution and provenance tracking. Experiments on the LawQA dataset show that our hybrid approach significantly outperforms both a single-model baseline and a vanilla RAG pipeline on F1, ROUGE-L, and an LLM-as-a-Judge metric. Ablations confirm the complementary contributions of retrieval prioritization, model ensembling, and the human-in-the-loop update mechanism. The proposed system demonstrably reduces hallucination while improving answer quality and legal compliance, advancing the practical landing of media forensics technologies in judicial scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Legal and financial RAG, one of 15 directions in Retrieval-augmented generation. Builds on 14 of its 23 references that are in the map. First posted on arXiv 3 Nov 2025.

Builds on

14 of 23 references.

References · 14

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2017Billion-scale similarity search with GPUscited by 2,477
  4. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  5. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  7. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  8. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
  9. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  10. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
  11. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
  12. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
2 more
  1. 2024Continual Learning for Large Language Models: A Surveycited by 144
  2. 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directionscited by 69

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Reasoning-Focused Legal Retrieval Benchmark
  2. 2026Fine-grained Claim-level RAG Benchmark for Law
  3. 2026Retrieval Augmented Generation Framework for the Nepali Legal Domain Question Answering
  4. 2024HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications
  5. 2024Experimenting with Legal AI Solutions: The Case of Question-Answering for Access to Justice
  6. 2026AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System
  7. 2026Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning
  8. 2026Efficient LLM Distillation for Bangladesh Legal Context: A Smartphone-Compatible Retrieval-Augmented Generation Model