Enhancing Financial RAG with Agentic AI and Multi-HyDE: A Novel Approach to Knowledge Retrieval and Hallucination Reduction
On the map: LLM agents and tool use → Financial trading and forecasting agents
Abstract (arXiv)
Accurate and reliable knowledge retrieval is vital for financial question-answering, where continually updated data sources and complex, high-stakes contexts demand precision. Traditional retrieval systems rely on a single database and retriever, but financial applications require more sophisticated approaches to handle intricate regulatory filings, market analyses, and extensive multi-year reports. We introduce a framework for financial Retrieval Augmented Generation (RAG) that leverages agentic AI and the Multi-HyDE system, an approach that generates multiple, nonequivalent queries to boost the effectiveness and coverage of retrieval from large, structured financial corpora. Our pipeline is optimized for token efficiency and multi-step financial reasoning, and we demonstrate that their combination improves accuracy by 11.2% and reduces hallucinations by 15%. Our method is evaluated on standard financial QA benchmarks, showing that integrating domain-specific retrieval mechanisms such as Multi-HyDE with robust toolsets, including keyword and table-based retrieval, significantly enhances both the accuracy and reliability of answers. This research not only delivers a modular, adaptable retrieval framework for finance but also highlights the importance of structured agent workflows and multi-perspective retrieval for trustworthy deployment of AI in high-stakes financial applications.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 40 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
24 of 40 references.
References · 24
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
12 more
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
- 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoningcited by 108
- 2024StateFlow: Enhancing LLM Task-Solving through State-Driven Workflowscited by 65
- 2024DMQR-RAG: Diverse Multi-Query Rewriting for RAGcited by 27
- 2025FinSage: A Multi-aspect RAG System for Financial Filings Question Answeringcited by 19
- 2024RE-GAINS & EnChAnT: Intelligent Tool Manipulation Systems For Enhanced Query Responsescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025VERAFI: Verified Agentic Financial Intelligence through Neurosymbolic Policy Generationcited by 4
- 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answeringcited by 0
- 2026W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Basescited by 0
- 2026VikingRAG: Accurate and Token-efficient Retrieval-augmented Generation over Structured Documentscited by 0
- 2026VikingRAG: Accurate and Token-efficient Retrieval-augmented Generation over Structured Documents10 Sep 2026
- 2026W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases22 Aug 2026
- 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering20 Feb 2026
- 2025VERAFI: Verified Agentic Financial Intelligence through Neurosymbolic Policy Generation12 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Retrieval-Augmented Generation for Financial Document Question Answering
- 2025Rethinking Retrieval: From Traditional Retrieval Augmented Generation to Agentic and Non-Vector Reasoning Systems in the Financial Domain for Large Language Models
- 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answering
- 2026MimirRAG: A Multi-Agent RAG Framework for Financial Data Retrieval with Metadata Integration
- 2026FinRetrieval: A Benchmark for Financial Data Retrieval by AI Agents
- 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering
- 2025FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generation
- 2025Integrating Domain Knowledge for Financial QA: A Multi-Retriever RAG Approach with LLMs