Beyond the Reranker: Do RAG Retrieval Enhancements Help Once a Strong Reranker Is Present?
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Retrieval-augmented generation (RAG) is routinely extended with methods meant to improve retrieval: query expansion, hierarchical and cross-document summarization, graph-based expansion, per-query routing, rank fusion, and corrective re-retrieval. The benefits reported for these methods come almost exclusively from homogeneous corpora, predominantly Wikipedia prose. Whether they hold on the mixed-format collections common in practice, where code, markdown, tables, scientific PDFs, and prose are interleaved within one corpus, has not been measured. To study this directly, we build HetDocQA, a heterogeneous benchmark with chunker-agnostic span-overlap relevance labels and collection-disjoint splits, and pair it with MuSiQue and QASPER as homogeneous controls. We evaluate eight methods on a shared backbone, with bootstrap confidence intervals and multiple-comparison correction. A strong cross-encoder reranker accounts for most of the pipeline's quality; beyond it, only two methods yield reliable gains: query expansion and SSCC. SSCC, a per-source calibrated corrector introduced here, sets a separate acceptance threshold for each score source and helps only on heterogeneous data. The remaining reranking and pool-expansion methods in common use, among them hierarchical summarization, graph expansion, routing, and rank fusion, give no reliable gain once that reranker is present.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 41 of its 57 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
41 of 57 references.
Closest ancestors · 3
Same direction, newest first
- 2023Active Retrieval Augmented Generation11 May
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb
Other references · 38
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2018Datasheets for Datasetscited by 1,371
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
26 more
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
- 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 373
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2021QuALITY: Question Answering with Long Input Texts, Yes!cited by 204
- 2024Corrective Retrieval Augmented Generationcited by 187
- 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
- 2023Query2doc: Query Expansion with Large Language Modelscited by 146
- 2025A Systematic Review of Key Retrieval-Augmented Generation (RAG) Systems: Progress, Gaps, and Future Directionscited by 30
- 2026A-RAG: Scaling Agentic Retrieval-Augmented Generation via Hierarchical Retrieval Interfacescited by 24
- 2026Reasoning in Trees: Improving Retrieval-Augmented Generation for Multi-Hop Question Answeringcited by 13
- 2025RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Modelscited by 8
- 2025RouteRAG: Efficient Retrieval-Augmented Generation from Text and Graph via Reinforcement Learningcited by 5
- 2025Cross-Granularity Hypergraph Retrieval-Augmented Generation for Multi-hop Question Answeringcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Test-time Corpus Feedback: From Retrieval to RAG
- 2024ARAGOG: Advanced RAG Output Grading
- 2025Enhancing Retrieval-Augmented Generation with Two-Stage Retrieval: FlashRank Reranking and Query Expansion
- 2026LURE-RAG: Lightweight Utility-driven Reranking for Efficient RAG
- 2025Embedding-Based Context-Aware Reranker
- 2025RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation
- 2026Revisiting RAG Retrievers: An Information Theoretic Benchmark
- 2024CoFE-RAG: A Comprehensive Full-chain Evaluation Framework for Retrieval-Augmented Generation with Enhanced Data Diversity