HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications
On the map: Retrieval-augmented generation → Legal and financial RAG
Abstract (arXiv)
Large Language Models (LLMs) face limitations in AI legal and policy applications due to outdated knowledge, hallucinations, and poor reasoning in complex contexts. Retrieval-Augmented Generation (RAG) systems address these issues by incorporating external knowledge, but suffer from retrieval errors, ineffective context integration, and high operational costs. This paper presents the Hybrid Parameter-Adaptive RAG (HyPA-RAG) system, designed for the AI legal domain, with NYC Local Law 144 (LL144) as the test case. HyPA-RAG integrates a query complexity classifier for adaptive parameter tuning, a hybrid retrieval approach combining dense, sparse, and knowledge graph methods, and a comprehensive evaluation framework with tailored question types and metrics. Testing on LL144 demonstrates that HyPA-RAG enhances retrieval accuracy, response fidelity, and contextual precision, offering a robust and adaptable solution for high-stakes legal and policy applications.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Legal and financial RAG, one of 15 directions in Retrieval-augmented generation. Builds on 30 of its 49 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
30 of 49 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023BloombergGPT: A Large Language Model for Financecited by 923
18 more
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020Knowledge Graphscited by 619
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2023Preference Ranking Optimization for Human Alignmentcited by 283
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 259
- 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 170
- 2024Seven Failure Points When Engineering a Retrieval Augmented Generation Systemcited by 138
- 2023Can GPT-3 Perform Statutory Reasoning?cited by 71
- 2024KG-RAG: Bridging the Gap Between Knowledge and Creativitycited by 55
- 2022Legal Prompt Engineering for Multilingual Legal Judgement Predictioncited by 54
- 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 51
- 2024RaFe: Ranking Feedback Improves Query Rewriting for RAGcited by 47
- 2021Learning to Retrieve Passages without Supervisioncited by 46
- 2023A Comprehensive Evaluation of Large Language Models on Legal Judgment Predictioncited by 27
- 2022A Study on the Efficiency and Generalization of Light Hybrid Retrieverscited by 7
Built on by
Citing papers per year: 2025: 9; 2026: 13.
22 papers.
Sort:
By area:
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2025KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGcited by 29
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasetscited by 12
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunkingcited by 7
- 2025Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysiscited by 5
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law Systemcited by 5
- 2025All for law and law for all: Adaptive RAG Pipeline for Legal Researchcited by 5
- 2026Revisiting RAG Retrievers: An Information Theoretic Benchmarkcited by 2
- 2025TAI Scan Tool: A RAG-Based Tool With Minimalistic Input for Trustworthy AI Self-Assessmentcited by 1
- 2026LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encodingcited by 1
- 2026Uncertainty-Aware Hybrid Retrieval for Long-Document RAGcited by 1
- 2025The 3rd Place Solution of CCIR CUP 2025: A Framework for Retrieval-Augmented Generation in Multi-Turn Legal Conversationcited by 0
10 more
- 2026Autonomous Edge-Deployed AI Agents for Electric Vehicle Charging Infrastructure Managementcited by 0
- 2026Guaranteeing Knowledge Integration with Joint Decoding for Retrieval-Augmented Generationcited by 0
- 2026PoliLegalLM: A Technical Report on a Large Language Model for Political and Legal Affairscited by 0
- 2026Navigating Global AI Regulation: A Multi-Jurisdictional Retrieval-Augmented Generation Systemcited by 0
- 2026Sifei at SemEval-2026 Task 8: Hybrid Retrieval and Query Rewriting for Multi-Turn RAGcited by 0
- 2026Evaluating RAG for French immigration law: a benchmark and baseline studycited by 0
- 2026R2Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAGcited by 0
- 2026Pre-retrieval Query Clustering for Adaptive Top-k Document Retrieval in RAG Systemscited by 0
- 2026FootprintRAG: Visual Analytics for Evidence Context Refinement in RAG-based Scientific Literature Explorationcited by 0
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoningcited by 0
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning1 Oct 2026
- 2026FootprintRAG: Visual Analytics for Evidence Context Refinement in RAG-based Scientific Literature Exploration17 Sep 2026
- 2026Pre-retrieval Query Clustering for Adaptive Top-k Document Retrieval in RAG Systems11 Sep 2026
- 2026Evaluating RAG for French immigration law: a benchmark and baseline study27 Jul 2026
- 2026R2Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG1 Jul 2026
- 2026Uncertainty-Aware Hybrid Retrieval for Long-Document RAG11 Jun 2026
- 2026Sifei at SemEval-2026 Task 8: Hybrid Retrieval and Query Rewriting for Multi-Turn RAG5 Jun 2026
- 2026LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encoding3 Jun 2026
- 2026Navigating Global AI Regulation: A Multi-Jurisdictional Retrieval-Augmented Generation System28 Apr 2026
- 2026PoliLegalLM: A Technical Report on a Large Language Model for Political and Legal Affairs19 Apr 2026
- 2026Guaranteeing Knowledge Integration with Joint Decoding for Retrieval-Augmented Generation9 Apr 2026
- 2026Revisiting RAG Retrievers: An Information Theoretic Benchmark25 Feb 2026
10 more
- 2026Autonomous Edge-Deployed AI Agents for Electric Vehicle Charging Infrastructure Management24 Feb 2026
- 2025The 3rd Place Solution of CCIR CUP 2025: A Framework for Retrieval-Augmented Generation in Multi-Turn Legal Conversation17 Oct 2025
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasets8 Oct 2025
- 2025All for law and law for all: Adaptive RAG Pipeline for Legal Research18 Aug 2025
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System1 Aug 2025
- 2025TAI Scan Tool: A RAG-Based Tool With Minimalistic Input for Trustworthy AI Self-Assessment23 Jul 2025
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking14 Jul 2025
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation11 Mar 2025
- 2025Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysis28 Feb 2025
- 2025KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAG13 Feb 2025
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2025KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGcited by 29
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasetscited by 12
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunkingcited by 7
- 2025All for law and law for all: Adaptive RAG Pipeline for Legal Researchcited by 5
- 2026Revisiting RAG Retrievers: An Information Theoretic Benchmarkcited by 2
- 2026LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encodingcited by 1
- 2026Uncertainty-Aware Hybrid Retrieval for Long-Document RAGcited by 1
- 2025The 3rd Place Solution of CCIR CUP 2025: A Framework for Retrieval-Augmented Generation in Multi-Turn Legal Conversationcited by 0
- 2026Guaranteeing Knowledge Integration with Joint Decoding for Retrieval-Augmented Generationcited by 0
- 2026Navigating Global AI Regulation: A Multi-Jurisdictional Retrieval-Augmented Generation Systemcited by 0
- 2026Sifei at SemEval-2026 Task 8: Hybrid Retrieval and Query Rewriting for Multi-Turn RAGcited by 0
12 most cited of 15 All 15 (JSON)
- 2026FootprintRAG: Visual Analytics for Evidence Context Refinement in RAG-based Scientific Literature Exploration17 Sep 2026
- 2026Pre-retrieval Query Clustering for Adaptive Top-k Document Retrieval in RAG Systems11 Sep 2026
- 2026R2Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG1 Jul 2026
- 2026Uncertainty-Aware Hybrid Retrieval for Long-Document RAG11 Jun 2026
- 2026Sifei at SemEval-2026 Task 8: Hybrid Retrieval and Query Rewriting for Multi-Turn RAG5 Jun 2026
- 2026LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encoding3 Jun 2026
- 2026Navigating Global AI Regulation: A Multi-Jurisdictional Retrieval-Augmented Generation System28 Apr 2026
- 2026Guaranteeing Knowledge Integration with Joint Decoding for Retrieval-Augmented Generation9 Apr 2026
- 2026Revisiting RAG Retrievers: An Information Theoretic Benchmark25 Feb 2026
- 2025The 3rd Place Solution of CCIR CUP 2025: A Framework for Retrieval-Augmented Generation in Multi-Turn Legal Conversation17 Oct 2025
- 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasets8 Oct 2025
- 2025All for law and law for all: Adaptive RAG Pipeline for Legal Research18 Aug 2025
12 newest of 15 All 15 (JSON)
- 2025Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysiscited by 5
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law Systemcited by 5
- 2025TAI Scan Tool: A RAG-Based Tool With Minimalistic Input for Trustworthy AI Self-Assessmentcited by 1
- 2026Autonomous Edge-Deployed AI Agents for Electric Vehicle Charging Infrastructure Managementcited by 0
- 2026PoliLegalLM: A Technical Report on a Large Language Model for Political and Legal Affairscited by 0
- 2026Evaluating RAG for French immigration law: a benchmark and baseline studycited by 0
- 2026Evaluating RAG for French immigration law: a benchmark and baseline study27 Jul 2026
- 2026PoliLegalLM: A Technical Report on a Large Language Model for Political and Legal Affairs19 Apr 2026
- 2026Autonomous Edge-Deployed AI Agents for Electric Vehicle Charging Infrastructure Management24 Feb 2026
- 2025NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System1 Aug 2025
- 2025TAI Scan Tool: A RAG-Based Tool With Minimalistic Input for Trustworthy AI Self-Assessment23 Jul 2025
- 2025Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysis28 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2026Retrieval Improvements Do Not Guarantee Better Answers: A Study of RAG for AI Policy QA
- 2025A Reasoning-Focused Legal Retrieval Benchmark
- 2025Hybrid Retrieval-Augmented Generation Agent for Trustworthy Legal Question Answering in Judicial Forensics
- 2025Domain-Partitioned Hybrid RAG for Legal Reasoning: Toward Modular and Explainable Legal AI for India
- 2025Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation
- 2025ASVRI-Legal: Fine-Tuning LLMs with Retrieval Augmented Generation for Enhanced Legal Regulation
- 2026CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method
- 2026Fine-grained Claim-level RAG Benchmark for Law