DIVERGE: Diversity-Enhanced RAG for Open-Ended Information Seeking
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Existing retrieval-augmented generation (RAG) systems often assume that each query has a single correct answer. This assumption overlooks open-ended information-seeking scenarios where multiple plausible answers are valuable, and where diversity is important for creativity, fairness, and inclusive access to information. We show that standard RAG systems fail to fully use diverse retrieved contexts: simply increasing retrieval diversity does not necessarily lead to diverse generations. To address this limitation, we propose Diverge, a plug-and-play agentic RAG framework that improves the diversity--quality trade-off through iterative, reflection-guided exploration of diverse viewpoints and diversity-aware retrieval support. We further introduce evaluation metrics for characterizing the diversity-quality trade-off in open-ended question answering. Experiments across multiple real-world datasets and backbone LLMs show that Diverge achieves the best trade-off among competitive baselines, increasing diversity by ~2× without noticeable quality degradation. These results reveal a systematic limitation of current RAGs and show the value of explicit diversity modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 29 of its 51 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
29 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2024RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions31 Dec
- 2024Evaluation of Retrieval-Augmented Generation: A Survey13 May
Other references · 27
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
- 2021Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasetscited by 179
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 148
- 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 145
- 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
- 2024A Thorough Examination of Decoding Methods in the Era of LLMscited by 112
15 more
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
- 2025Reasoning with Sampling: Your Base Model is Smarter Than You Thinkcited by 84
- 2025Evaluating the Diversity and Quality of LLM Generated Contentcited by 51
- 2025Improve LLM-as-a-Judge Ability as a General Abilitycited by 35
- 2025IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistancecited by 22
- 2021Diversity driven Query Rewriting in Search Advertisingcited by 14
- 2025Vendi-RAG: Adaptively Trading-Off Diversity And Quality Significantly Improves Retrieval Augmented Generation With LLMscited by 13
- 2024BRAIn: Bayesian Reward-conditioned Amortized Inference for natural language generation from feedbackcited by 7
- 2025Diversity Enhances an LLM's Performance in RAG and Long-context Taskcited by 7
- 2022Wikipedia Reader Navigation: When Synthetic Data Is Enoughcited by 6
- 2025Logits are All We Need to Adapt Closed Modelscited by 4
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generationcited by 4
- 2025Culinary Crossroads: A RAG Framework for Enhancing Diversity in Cross-Cultural Recipe Adaptationcited by 2
- 2025MuISQA: Multi-Intent Retrieval-Augmented Generation for Scientific Question Answeringcited by 2
- 2023Paraphrase Acquisition from Image Captionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Scaling DPPs for RAG: Density Meets Diversity
- 2024Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation Systems
- 2026Forgotten History or Test-of-Time? Retrospect and Prospect on RAG from an IR Perspective
- 2026A-RAG: Scaling Agentic Retrieval-Augmented Generation via Hierarchical Retrieval Interfaces
- 2025RAGSmith: A Framework for Finding the Optimal Composition of Retrieval-Augmented Generation Methods Across Datasets
- 2024Better RAG using Relevant Information Gain
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning
- 2026Finding the Right Balance: Relevance and Diversity in LLM Retrieval