Test-time Corpus Feedback: From Retrieval to RAG
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has emerged as a standard framework for knowledge-intensive NLP tasks, combining large language models (LLMs) with document retrieval from external corpora. Despite its widespread use, most RAG pipelines continue to treat retrieval and reasoning as isolated components, retrieving documents once and then generating answers without further interaction. This static design often limits performance on complex tasks that require iterative evidence gathering or high-precision retrieval. Recent work in both the information retrieval (IR) and NLP communities has begun to close this gap by introducing adaptive retrieval and ranking methods that incorporate feedback. In this survey, we present a structured overview of advanced retrieval and ranking mechanisms that integrate such feedback. We categorize feedback signals based on their source and role in improving the query, retrieved context, or document pool. By consolidating these developments, we aim to bridge IR and NLP perspectives and highlight retrieval as a dynamic, learnable component of end-to-end RAG systems.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 73 of its 124 references that are in the map. First posted on arXiv 21 Aug 2025.
Builds on
73 of 124 references.
Closest ancestors · 3
Same direction, newest first
- 2025Controlled Retrieval-augmented Context Evaluation for Long-form RAG24 Jun
- 2024The Power of Noise: Redefining Retrieval for RAG Systems26 Jan
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems16 Nov
Other references · 70
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
38 more
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
- 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 376
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2020Overview of the TREC 2019 deep learning trackcited by 286
- 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 272
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 208
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 201
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 200
- 2021Overview of the TREC 2020 deep learning trackcited by 196
- 2020Generation-Augmented Retrieval for Open-domain Question Answeringcited by 186
- 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 158
- 2023RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze!cited by 155
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2023Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Taskscited by 73
- 2025Rank1: Test-Time Compute for Reranking in Information Retrievalcited by 70
- 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
- 2022An Analysis of Fusion Functions for Hybrid Retrievalcited by 51
- 2023Information Retrieval: Recent Advances and Beyondcited by 49
- 2021Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedbackcited by 47
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
- 2024BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filteringcited by 29
- 2025Knowing You Don't Know: Learning When to Continue Search in Multi-round RAG through Self-Practicingcited by 25
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Think Before You Retrieve: Learning Test-Time Adaptive Search with Small Language Modelscited by 5
- 2026When Does Persona Prompting Actually Help? A Retrieval and Metric Analysis of Expert Role Injection in LLMscited by 4
- 2026A Matryoshka Hierarchical RAG for Efficient Multi-Hop Question Answeringcited by 0
- 2026A Matryoshka Hierarchical RAG for Efficient Multi-Hop Question Answering1 Oct 2026
- 2026When Does Persona Prompting Actually Help? A Retrieval and Metric Analysis of Expert Role Injection in LLMs28 May 2026
- 2025Think Before You Retrieve: Learning Test-Time Adaptive Search with Small Language Models10 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation
- 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directions
- 2025A Systematic Review of Key Retrieval-Augmented Generation (RAG) Systems: Progress, Gaps, and Future Directions
- 2024Evaluation of Retrieval-Augmented Generation: A Survey
- 2025Enhancing Retrieval-Augmented Generation: A Study of Best Practices
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey
- 2025When Retrieval Succeeds and Fails: Rethinking Retrieval-Augmented Generation for LLMs