Answering Complex Open-domain Questions Through Iterative Query Generation
Not on the map. Why?
Abstract (arXiv)
It is challenging for current one-step retrieve-and-read question answering (QA) systems to answer questions like "Which novel by the author of 'Armada' will be adapted as a feature film by Steven Spielberg?" because the question seldom contains retrievable clues about the missing entity (here, the author). Answering such a question requires multi-hop reasoning where one must gather information about the missing entity (or facts) to proceed with further reasoning. We present GoldEn (Gold Entity) Retriever, which iterates between reading context and retrieving more supporting documents to answer open-domain multi-hop questions. Instead of using opaque and computationally expensive neural retrieval models, GoldEn Retriever generates natural language search queries given the question and available context, and leverages off-the-shelf information retrieval systems to query for missing entities. This allows GoldEn Retriever to scale up efficiently for open-domain multi-hop reasoning while maintaining interpretability. We evaluate GoldEn Retriever on the recently proposed open-domain multi-hop QA dataset, HotpotQA, and demonstrate that it outperforms the best previously published model despite not using pretrained language models such as BERT.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 17; 2023: 12; 2024: 9; 2025: 3; 2026: 4.
60 papers.
Sort:
By area:
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 82
- 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
- 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 71
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2021Conversational Question Answering: A Surveycited by 31
- 2021Adaptive Information Seeking for Open-Domain Question Answeringcited by 29
38 more
- 2021Multi-Step Reasoning Over Unstructured Text with Beam Dense Retrievalcited by 25
- 2021What's in a Name? Answer Equivalence For Open-Domain Question Answeringcited by 21
- 2022Modeling Multi-hop Question Answering as Single Sequence Predictioncited by 21
- 2021Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question Answeringcited by 19
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Modelscited by 18
- 2021The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architecturescited by 16
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
- 2023Answering Ambiguous Questions via Iterative Promptingcited by 13
- 2021Hopper: Multi-hop Transformer for Spatiotemporal Reasoningcited by 12
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2026SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activationcited by 12
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunitiescited by 11
- 2022Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?cited by 10
- 2026DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agentcited by 10
- 2023Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answeringcited by 9
- 2025PRISM: Agentic Retrieval with LLMs for Multi-Hop Question Answeringcited by 8
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answeringcited by 7
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoningcited by 7
- 2021Giving Commands to a Self-Driving Car: How to Deal with Uncertain Situations?cited by 6
- 2022Zero-Shot Retrieval with Search Agents and Hybrid Environmentscited by 6
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answeringcited by 6
- 2021Coarse-grained decomposition and fine-grained interaction for multi-hop question answeringcited by 5
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2023Single Sequence Prediction over Reasoning Graphs for Multi-hop QAcited by 5
- 2025Query Decomposition for RAG: Balancing Exploration-Exploitationcited by 5
- 2021Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answeringcited by 4
- 2022Double Retrieval and Ranking for Accurate Question Answeringcited by 4
- 2022ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chainscited by 4
- 2023Performance Prediction for Multi-hop Questionscited by 4
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answeringcited by 4
- 2024ConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generationcited by 4
- 2024Multi-Field Adaptive Retrievalcited by 4
- 2021Weakly Supervised Pre-Training for Multi-Hop Retrievercited by 3
- 2021Extract, Integrate, Compete: Towards Verification Style Reading Comprehensioncited by 3
- 2022Prompt-based Conservation Learning for Multi-hop Question Answeringcited by 3
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrievalcited by 3
- 2023Response Enhanced Semi-supervised Dialogue Query Generationcited by 2
50 most cited of 60 All 60 (JSON)
- 2026EviReform: Evidence-Guided Query Reformulation for Multi-Hop Graph Retrieval13 Aug 2026
- 2026DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agent1 Mar 2026
- 2026RVR: Retrieve-Verify-Retrieve for Comprehensive Question Answering20 Feb 2026
- 2026SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activation6 Jan 2026
- 2025Query Decomposition for RAG: Balancing Exploration-Exploitation21 Oct 2025
- 2025PRISM: Agentic Retrieval with LLMs for Multi-Hop Question Answering16 Oct 2025
- 2025Discrepancy Detection at the Data Level: Toward Consistent Multilingual Question Answering13 Oct 2025
- 2024Multi-Field Adaptive Retrieval26 Oct 2024
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine22 Oct 2024
- 2024ConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generation20 Oct 2024
- 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurization11 Oct 2024
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunities17 Jul 2024
38 more
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answering3 Jul 2024
- 2024LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization18 Jun 2024
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answering22 Apr 2024
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Models16 Feb 2024
- 2023Response Enhanced Semi-supervised Dialogue Query Generation20 Dec 2023
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin15 Dec 2023
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval5 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines5 Oct 2023
- 2023Performance Prediction for Multi-hop Questions12 Aug 2023
- 2023Answering Ambiguous Questions via Iterative Prompting8 Jul 2023
- 2023Single Sequence Prediction over Reasoning Graphs for Multi-hop QA1 Jul 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering23 May 2023
- 2023Complex Claim Verification with Evidence Retrieved in the Wild19 May 2023
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answering4 May 2023
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec 2022
- 2022Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?23 Nov 2022
- 2022Cheater's Bowl: Human vs. Computer Search Strategies for Open-Domain Question Answering15 Nov 2022
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge22 Oct 2022
- 2022ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains17 Oct 2022
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning13 Oct 2022
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering9 Oct 2022
- 2022Measuring and Narrowing the Compositionality Gap in Language Models7 Oct 2022
- 2022Zero-Shot Retrieval with Search Agents and Hybrid Environments30 Sep 2022
- 2022Prompt-based Conservation Learning for Multi-hop Question Answering14 Sep 2022
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering24 May 2022
- 2022Modeling Multi-hop Question Answering as Single Sequence Prediction18 May 2022
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claims14 May 2022
- 2022ISA-bEL: Intelligent Search Algorithm based on Entity Linking9 May 2022
- 2022LoL: A Comparative Regularization Loss over Query Reformulation Losses for Pseudo-Relevance Feedback25 Apr 2022
- 2022Iteratively Prompt Pre-trained Language Models for Chain of Thought16 Mar 2022
- 2022Double Retrieval and Ranking for Accurate Question Answering16 Jan 2022
- 2021Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question Answering14 Sep 2021
- 2021Adaptive Information Seeking for Open-Domain Question Answering14 Sep 2021
- 2021What's in a Name? Answer Equivalence For Open-Domain Question Answering11 Sep 2021
- 2021Extract, Integrate, Compete: Towards Verification Style Reading Comprehension11 Sep 2021
- 2021Weakly Supervised Pre-Training for Multi-Hop Retriever18 Jun 2021
50 newest of 60 All 60 (JSON)
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
- 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 71
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Modelscited by 18
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
- 2026SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activationcited by 12
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answeringcited by 7
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoningcited by 7
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answeringcited by 6
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2023Single Sequence Prediction over Reasoning Graphs for Multi-hop QAcited by 5
12 most cited of 14 All 14 (JSON)
- 2026SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activation6 Jan 2026
- 2024SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine22 Oct 2024
- 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurization11 Oct 2024
- 2024FSM: A Finite State Machine Based Zero-Shot Prompting Paradigm for Multi-Hop Question Answering3 Jul 2024
- 2024Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answering22 Apr 2024
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Models16 Feb 2024
- 2023Single Sequence Prediction over Reasoning Graphs for Multi-hop QA1 Jul 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec 2022
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge22 Oct 2022
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning13 Oct 2022
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering9 Oct 2022
12 newest of 14 All 14 (JSON)
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2021Conversational Question Answering: A Surveycited by 31
- 2021Adaptive Information Seeking for Open-Domain Question Answeringcited by 29
- 2021Multi-Step Reasoning Over Unstructured Text with Beam Dense Retrievalcited by 25
- 2021What's in a Name? Answer Equivalence For Open-Domain Question Answeringcited by 21
- 2022Modeling Multi-hop Question Answering as Single Sequence Predictioncited by 21
- 2021Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question Answeringcited by 19
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2021The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architecturescited by 16
12 most cited of 37 All 37 (JSON)
- 2026EviReform: Evidence-Guided Query Reformulation for Multi-Hop Graph Retrieval13 Aug 2026
- 2026RVR: Retrieve-Verify-Retrieve for Comprehensive Question Answering20 Feb 2026
- 2025Discrepancy Detection at the Data Level: Toward Consistent Multilingual Question Answering13 Oct 2025
- 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunities17 Jul 2024
- 2024LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization18 Jun 2024
- 2023Response Enhanced Semi-supervised Dialogue Query Generation20 Dec 2023
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval5 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023Performance Prediction for Multi-hop Questions12 Aug 2023
- 2023Answering Ambiguous Questions via Iterative Prompting8 Jul 2023
- 2023Complex Claim Verification with Evidence Retrieved in the Wild19 May 2023
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answering4 May 2023
12 newest of 37 All 37 (JSON)