Hybrid Retrieval-Augmented Generation Agent for Trustworthy Legal Question Answering in Judicial Forensics
On the map: Retrieval-augmented generation → Legal and financial RAG
also in 1 more
Abstract (arXiv)
As artificial intelligence permeates judicial forensics, ensuring the veracity and traceability of legal question answering (QA) has become critical. Conventional large language models (LLMs) are prone to hallucination, risking misleading guidance in legal consultation, while static knowledge bases struggle to keep pace with frequently updated statutes and case law. We present a hybrid legal QA agent tailored for judicial settings that integrates retrieval-augmented generation (RAG) with multi-model ensembling to deliver reliable, auditable, and continuously updatable counsel. The system prioritizes retrieval over generation: when a trusted legal repository yields relevant evidence, answers are produced via RAG; otherwise, multiple LLMs generate candidates that are scored by a specialized selector, with the top-ranked answer returned. High-quality outputs then undergo human review before being written back to the repository, enabling dynamic knowledge evolution and provenance tracking. Experiments on the LawQA dataset show that our hybrid approach significantly outperforms both a single-model baseline and a vanilla RAG pipeline on F1, ROUGE-L, and an LLM-as-a-Judge metric. Ablations confirm the complementary contributions of retrieval prioritization, model ensembling, and the human-in-the-loop update mechanism. The proposed system demonstrably reduces hallucination while improving answer quality and legal compliance, advancing the practical landing of media forensics technologies in judicial scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Legal and financial RAG, one of 15 directions in Retrieval-augmented generation. Builds on 14 of its 23 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
14 of 23 references.
References · 14
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Reasoning-Focused Legal Retrieval Benchmark
- 2026Fine-grained Claim-level RAG Benchmark for Law
- 2026Retrieval Augmented Generation Framework for the Nepali Legal Domain Question Answering
- 2024HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications
- 2024Experimenting with Legal AI Solutions: The Case of Question-Answering for Access to Justice
- 2026AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System
- 2026Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning
- 2026Efficient LLM Distillation for Bangladesh Legal Context: A Smartphone-Compatible Retrieval-Augmented Generation Model