MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
also in 1 more
Abstract (arXiv)
Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process often struggles to reconcile evidence effectively. We propose MASS-RAG, a multi-agent synthesis approach to retrieval-augmented generation that structures evidence processing into multiple role-specialized agents. MASS-RAG applies distinct agents for evidence summarization, evidence extraction, and reasoning over retrieved documents, and combines their outputs through a dedicated synthesis stage to produce the final answer. This design exposes multiple intermediate evidence views, allowing the model to compare and integrate complementary information before answer generation. Experiments on four benchmarks show that MASS-RAG consistently improves performance over strong RAG baselines, particularly in settings where relevant evidence is distributed across retrieved contexts.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 25 of its 34 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
25 of 34 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
13 more
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 234
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
- 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 147
- 2024RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculturecited by 81
- 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
- 2023InstructRetro: Instruction Tuning post Retrieval-Augmented Pretrainingcited by 53
- 2023PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adaptercited by 38
- 2024Are Large Language Models Good Classifiers? A Study on Edit Intent Classification in Scientific Document Revisionscited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FAIR-RAG: Faithful Adaptive Iterative Refinement for Retrieval-Augmented Generation
- 2025HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation
- 2025MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning
- 2025SIRAG: Towards Stable and Interpretable RAG with A Process-Supervised Multi-Agent Framework
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
- 2025RAGCap-Bench: Benchmarking Capabilities of LLMs in Agentic Retrieval Augmented Generation Systems
- 2026SPD-RAG: Sub-Agent Per Document Retrieval-Augmented Generation
- 2025Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges