Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answering
Not on the map. Why?
Abstract (arXiv)
This paper introduces a new framework for open-domain question answering in which the retriever and the reader iteratively interact with each other. The framework is agnostic to the architecture of the machine reading model, only requiring access to the token-level hidden representations of the reader. The retriever uses fast nearest neighbor search to scale to corpora containing millions of paragraphs. A gated recurrent unit updates the query at each step conditioned on the state of the reader and the reformulated query is used to re-rank the paragraphs by the retriever. We conduct analysis and show that iterative interaction helps in retrieving informative paragraphs from the corpus. Finally, we show that our multi-step-reasoning framework brings consistent improvement when applied to two widely used reader architectures DrQA and BiDAF on various large open-domain datasets --- TriviaQA-unfiltered, QuasarT, SearchQA, and SQuAD-Open.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 8; 2023: 6; 2024: 9; 2025: 4; 2026: 3.
48 papers.
Sort:
By area:
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2024Language Models with Conformal Factuality Guaranteescited by 131
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2021Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answeringcited by 50
- 2024BERGEN: A Benchmarking Library for Retrieval-Augmented Generationcited by 31
- 2021Challenges in Generalization in Open Domain Question Answeringcited by 30
- 2021Adaptive Information Seeking for Open-Domain Question Answeringcited by 29
- 2021Rider: Reader-Guided Passage Reranking for Open-Domain Question Answeringcited by 28
- 2022Visconde: Multi-document QA with GPT-3 and Neural Rerankingcited by 23
- 2021Database Reasoning Over Textcited by 20
36 more
- 2021Boosting Search Engines with Interactive Agentscited by 19
- 2021Rethinking Search: Making Domain Experts out of Dilettantescited by 18
- 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphscited by 18
- 2022Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Surveycited by 14
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2022Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?cited by 10
- 2023LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoorscited by 9
- 2023Drilling Down into the Discourse Structure with LLMs for Long Document Question Answeringcited by 8
- 2021A Graph-guided Multi-round Retrieval Method for Conversational Open-domain Question Answeringcited by 7
- 2021Design Challenges for a Multi-Perspective Search Enginecited by 7
- 2022Interactive Question Answering Systems: Literature Reviewcited by 7
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answeringcited by 7
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generationcited by 7
- 20231-PAGER: One Pass Answer Generation and Evidence Retrievalcited by 7
- 2024CuriousLLM: Elevating Multi-Document Question Answering with LLM-Enhanced Knowledge Graph Reasoningcited by 7
- 2026ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agentscited by 7
- 2024ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation Fusioncited by 5
- 2021Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answeringcited by 4
- 2021Weakly-Supervised Open-Retrieval Conversational Question Answeringcited by 4
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answeringcited by 4
- 2025LLM-Specific Utility for Retrieval-Augmented Generationcited by 4
- 2021Simple and Efficient ways to Improve REALMcited by 3
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrievalcited by 3
- 2021Generative Context Pair Selection for Multi-hop Question Answeringcited by 2
- 2022PReGAN: Answer Oriented Passage Ranking with Weakly Supervised GANcited by 2
- 2023Strong and Efficient Baselines for Open Domain Conversational Question Answeringcited by 2
- 2024Location Aware Modular Biencoder for Tourism Question Answeringcited by 2
- 2024Passage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Modelscited by 2
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generationcited by 2
- 2024LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarizationcited by 1
- 2025Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Taskscited by 1
- 2021Building a Question Answering System for the Manufacturing Domaincited by 0
- 2024PrefRAG: Preference-Driven Multi-Source Retrieval Augmented Generationcited by 0
- 2025A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generationcited by 0
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generationcited by 0
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generationcited by 0
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation3 Jun 2026
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation15 May 2026
- 2026ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agents17 Jan 2026
- 2025A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation29 Dec 2025
- 2025LLM-Specific Utility for Retrieval-Augmented Generation13 Oct 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Tasks10 Jan 2025
- 2024PrefRAG: Preference-Driven Multi-Source Retrieval Augmented Generation1 Nov 2024
- 2024BERGEN: A Benchmarking Library for Retrieval-Augmented Generation1 Jul 2024
- 2024LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization18 Jun 2024
- 2024Passage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Models31 May 2024
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answering22 Apr 2024
36 more
- 2024CuriousLLM: Elevating Multi-Document Question Answering with LLM-Enhanced Knowledge Graph Reasoning13 Apr 2024
- 2024Language Models with Conformal Factuality Guarantees15 Feb 2024
- 2024ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation Fusion4 Jan 2024
- 2024Location Aware Modular Biencoder for Tourism Question Answering4 Jan 2024
- 2023Drilling Down into the Discourse Structure with LLMs for Long Document Question Answering22 Nov 2023
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval5 Nov 2023
- 20231-PAGER: One Pass Answer Generation and Evidence Retrieval25 Oct 2023
- 2023Strong and Efficient Baselines for Open Domain Conversational Question Answering23 Oct 2023
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation20 Oct 2023
- 2023LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoors26 Aug 2023
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec 2022
- 2022Visconde: Multi-document QA with GPT-3 and Neural Reranking19 Dec 2022
- 2022Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?23 Nov 2022
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering9 Oct 2022
- 2022Interactive Question Answering Systems: Literature Review4 Sep 2022
- 2022Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey5 Aug 2022
- 2022PReGAN: Answer Oriented Passage Ranking with Weakly Supervised GAN5 Jul 2022
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering24 May 2022
- 2021Design Challenges for a Multi-Perspective Search Engine15 Dec 2021
- 2021Building a Question Answering System for the Manufacturing Domain19 Nov 2021
- 2021Adaptive Information Seeking for Open-Domain Question Answering14 Sep 2021
- 2021Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering9 Sep 2021
- 2021Challenges in Generalization in Open Domain Question Answering2 Sep 2021
- 2021Boosting Search Engines with Interactive Agents1 Sep 2021
- 2021Database Reasoning Over Text2 Jun 2021
- 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphs11 May 2021
- 2021Rethinking Search: Making Domain Experts out of Dilettantes5 May 2021
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Bases18 Apr 2021
- 2021Generative Context Pair Selection for Multi-hop Question Answering18 Apr 2021
- 2021Simple and Efficient ways to Improve REALM18 Apr 2021
- 2021A Graph-guided Multi-round Retrieval Method for Conversational Open-domain Question Answering17 Apr 2021
- 2021Weakly-Supervised Open-Retrieval Conversational Question Answering3 Mar 2021
- 2021Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answering7 Feb 2021
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering4 Jan 2021
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval2 Jan 2021
- 2021Rider: Reader-Guided Passage Reranking for Open-Domain Question Answering1 Jan 2021
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answeringcited by 7
- 2024CuriousLLM: Elevating Multi-Document Question Answering with LLM-Enhanced Knowledge Graph Reasoningcited by 7
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answeringcited by 4
- 2024Location Aware Modular Biencoder for Tourism Question Answeringcited by 2
- 2025A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generationcited by 0
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generationcited by 0
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generationcited by 0
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation3 Jun 2026
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation15 May 2026
- 2025A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation29 Dec 2025
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answering22 Apr 2024
- 2024CuriousLLM: Elevating Multi-Document Question Answering with LLM-Enhanced Knowledge Graph Reasoning13 Apr 2024
- 2024Location Aware Modular Biencoder for Tourism Question Answering4 Jan 2024
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec 2022
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering9 Oct 2022
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2024Language Models with Conformal Factuality Guaranteescited by 131
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2021Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answeringcited by 50
- 2021Challenges in Generalization in Open Domain Question Answeringcited by 30
- 2021Adaptive Information Seeking for Open-Domain Question Answeringcited by 29
- 2021Rider: Reader-Guided Passage Reranking for Open-Domain Question Answeringcited by 28
- 2022Visconde: Multi-document QA with GPT-3 and Neural Rerankingcited by 23
- 2021Database Reasoning Over Textcited by 20
- 2021Boosting Search Engines with Interactive Agentscited by 19
- 2021Rethinking Search: Making Domain Experts out of Dilettantescited by 18
12 most cited of 35 All 35 (JSON)
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Tasks10 Jan 2025
- 2024LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization18 Jun 2024
- 2024Passage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Models31 May 2024
- 2024Language Models with Conformal Factuality Guarantees15 Feb 2024
- 2024ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation Fusion4 Jan 2024
- 2023Drilling Down into the Discourse Structure with LLMs for Long Document Question Answering22 Nov 2023
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval5 Nov 2023
- 20231-PAGER: One Pass Answer Generation and Evidence Retrieval25 Oct 2023
- 2023Strong and Efficient Baselines for Open Domain Conversational Question Answering23 Oct 2023
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation20 Oct 2023
- 2022Visconde: Multi-document QA with GPT-3 and Neural Reranking19 Dec 2022
12 newest of 35 All 35 (JSON)