MARAG-R1: Beyond Single Retriever via Reinforcement-Learned Multi-Tool Agentic Retrieval
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 2 more
Abstract (arXiv)
Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses this issue by grounding LLMs in external knowledge; However, the effectiveness of RAG critically depends on whether the model can adequately access relevant information. Existing RAG systems rely on a single retriever with fixed top-k selection, restricting access to a narrow and static subset of the corpus. As a result, this single-retriever paradigm has become the primary bottleneck for comprehensive external information acquisition, especially in tasks requiring corpus-level reasoning. To overcome this limitation, we propose MARAG-R1, a reinforcement-learned multi-tool RAG framework that enables LLMs to dynamically coordinate multiple retrieval mechanisms for broader and more precise information access. MARAG-R1 equips the model with four retrieval tools -- semantic search, keyword search, filtering, and aggregation -- and learns both how and when to use them through a two-stage training process: supervised fine-tuning followed by reinforcement learning. This design allows the model to interleave reasoning and retrieval, progressively gathering sufficient evidence for corpus-level synthesis. Experiments on GlobalQA, HotpotQA, and 2WikiMultiHopQA demonstrate that MARAG-R1 substantially outperforms strong baselines and achieves new state-of-the-art results in corpus-level reasoning tasks.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 33 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
21 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning12 Mar
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec
Other references · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
7 more
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 257
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
- 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
- 2024KG-RAG: Bridging the Gap Between Knowledge and Creativitycited by 56
- 2025LinearRAG: Linear Graph Retrieval Augmented Generation on Large-scale Corporacited by 49
- 2024Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questionscited by 9
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Doctor-RAG: A Failure-Aware Repair Framework for Agentic Retrieval-Augmented Generationcited by 5
- 2026Language-Coupled Reinforcement Learning for Multilingual Retrieval-Augmented Generationcited by 2
- 2026GRASP: GRanularity-Aware Search Policy for Agentic RAGcited by 1
- 2026CoBRA: Learning Tool-Use Boundaries via Counterfactual Marginscited by 0
- 2026ToolSearcher: Optimizing Tool Selection at Scale via Reinforcement Learningcited by 0
- 2026ToolSearcher: Optimizing Tool Selection at Scale via Reinforcement Learning25 Sep 2026
- 2026CoBRA: Learning Tool-Use Boundaries via Counterfactual Margins1 Sep 2026
- 2026GRASP: GRanularity-Aware Search Policy for Agentic RAG11 Jul 2026
- 2026Doctor-RAG: A Failure-Aware Repair Framework for Agentic Retrieval-Augmented Generation1 Apr 2026
- 2026Language-Coupled Reinforcement Learning for Multilingual Retrieval-Augmented Generation21 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning
- 2025Search Wisely: Mitigating Sub-optimal Agentic Searches By Reducing Uncertainty
- 2025R1-Searcher++: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning
- 2026OThink-SRR1: Search, Refine and Reasoning with Reinforced Learning for Large Language Models
- 2025Interact-RAG: Reason and Interact with the Corpus, Beyond Black-Box Retrieval
- 2025R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learning
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications
- 2025RAG-R1: Incentivizing the Search and Reasoning Capabilities of LLMs through Multi-query Parallelism