PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Text
Not on the map. Why?
Cited by 37 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We consider open-domain queston answering (QA) where answers are drawn from either a corpus, a knowledge base (KB), or a combination of both of these. We focus on a setting in which a corpus is supplemented with a large but incomplete KB, and on questions that require non-trivial (e.g., ``multi-hop'') reasoning. We describe PullNet, an integrated framework for (1) learning what to retrieve (from the KB and/or corpus) and (2) reasoning with this heterogeneous information to find the best answer. PullNet uses an {iterative} process to construct a question-specific subgraph that contains information relevant to the question. In each iteration, a graph convolutional network (graph CNN) is used to identify subgraph nodes that should be expanded using retrieval (or ``pull'') operations on the corpus and/or KB. After the subgraph is complete, a similar graph CNN is used to extract the answer from the subgraph. This retrieve-and-reason process allows us to answer multi-hop questions using large KBs and corpora. PullNet is weakly supervised, requiring question-answer pairs but not gold inference paths. Experimentally PullNet improves over the prior state-of-the art, and in the setting where a corpus is used with incomplete KB these improvements are often dramatic. PullNet is also often superior to prior systems in a KB-only setting or a text-only setting.
Key facts. Cited by 182 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 42; 2022: 27; 2023: 31; 2024: 25; 2025: 37; 2026: 20.
182 papers.
Sort:
By area:
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161
- 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
38 more
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
- 2021Question Answering Over Temporal Knowledge Graphscited by 99
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 90
- 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
- 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 83
- 2021Multi-Modal Answer Validation for Knowledge-Based VQAcited by 78
- 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
- 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 77
- 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
- 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
- 2021Complex Temporal Question Answering on Knowledge Graphscited by 69
- 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 66
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
- 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 59
- 2021Complex Knowledge Base Question Answering: A Surveycited by 52
- 2023KnowledGPT: Enhancing Large Language Models with Retrieval and Storage Access on Knowledge Basescited by 52
- 2023ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Modelscited by 44
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoningcited by 44
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 40
- 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 38
- 2021TWEAC: Transformer with Extendable QA Agent Classifierscited by 37
- 2021Program Transfer for Answering Complex Questions over Knowledge Basescited by 34
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2021Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answeringcited by 33
- 2021Phrase Retrieval Learns Passage Retrieval, Toocited by 33
- 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operationscited by 30
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 29
- 2023Time-aware Multiway Adaptive Fusion Network for Temporal Knowledge Graph Question Answeringcited by 27
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
- 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
- 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
- 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMscited by 24
- 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graphcited by 23
- 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
50 most cited of 182 All 182 (JSON)
- 2026Meet, Compare, or Abstain: LatWeave for Deterministic Multi-Hop Question Answering on Knowledge Lattices23 Sep 2026
- 2026Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines4 Sep 2026
- 2026MissDiag: Diagnostic Evaluation of Incomplete-Knowledge Robustness in KGQA and KG-RAG19 Aug 2026
- 2026VISPATH: Visual-Intent-Guided Path Reasoning for Multimodal Knowledge Graph Question Answering4 Aug 2026
- 2026KAMR: Grounding Generation via Knowledge-Aligned Multi-hop Retrieval29 Jul 2026
- 2026RSF-GLLM: Bridging the Semantic Gap in Multi-Hop Knowledge Graph QA via Recurrent Soft-Flow and Decoupled LLM Generation7 Jul 2026
- 2026Ontology-Guided Evidence Path Inference for Multi-hop Knowledge Graph Question Answering26 Jun 2026
- 2026Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling12 Jun 2026
- 2026Structure Over Scale: Schema-Constrained Causal Graphs for RAG10 Jun 2026
- 2026GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering28 May 2026
- 2026Bounded Path Context: A Controlled Study of Visible Path History in LLM-Based Knowledge Graph Question Answering26 May 2026
- 2026TCAR-Gen: Temporal Graph Retrieval with Evidence Fusion for Knowledge-Grounded Generation15 Apr 2026
38 more
- 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval13 Apr 2026
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering13 Apr 2026
- 2026RouterKGQA: Specialized--General Model Routing for Constraint-Aware Knowledge Graph Question Answering20 Mar 2026
- 2026MDER-DR: Multi-Hop Question Answering with Entity-Centric Summaries11 Mar 2026
- 2026S-Path-RAG: Semantic-Aware Shortest-Path Retrieval Augmented Generation for Multi-Hop Knowledge Graph Question Answering5 Mar 2026
- 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge25 Feb 2026
- 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modeling25 Feb 2026
- 2026Autonomous Knowledge Graph Exploration with Adaptive Breadth-Depth Retrieval20 Jan 2026
- 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answering10 Dec 2025
- 2025Debate over Mixed-knowledge: A Robust Multi-Agent Reasoning Framework for Incomplete Knowledge Graph Question Answering15 Nov 2025
- 2025Learning to Refine: An Agentic RL Approach for Iterative SPARQL Query Construction14 Nov 2025
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering6 Nov 2025
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering6 Nov 2025
- 2025Deep Literature Survey Automation with an Iterative Workflow24 Oct 2025
- 2025DTKG: Dual-Track Knowledge Graph-Verified Reasoning Framework for Multi-Hop QA18 Oct 2025
- 2025MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoning15 Oct 2025
- 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering10 Oct 2025
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs9 Oct 2025
- 2025Knowledge Graph Sparsification for GNN-based Rare Disease Diagnosis9 Oct 2025
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs8 Oct 2025
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering6 Oct 2025
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2025CLAUSE: Agentic Neuro-Symbolic Knowledge Graph Reasoning via Dynamic Learnable Context Engineering25 Sep 2025
- 2025GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models20 Sep 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework30 Aug 2025
- 2025DAMR: Efficient and Adaptive Context-Aware Knowledge Graph Question Answering with LLM-Guided MCTS1 Aug 2025
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs13 Jul 2025
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs12 Jun 2025
- 2025PGDA-KGQA: A Prompt-Guided Generative Framework with Multiple Data Augmentation Strategies for Knowledge Graph Question Answering11 Jun 2025
- 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking29 May 2025
- 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering20 May 2025
- 2025Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioning20 May 2025
- 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering19 May 2025
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answering18 May 2025
- 2025Injecting Knowledge Graphs into Large Language Models12 May 2025
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey8 Apr 2025
- 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases7 Apr 2025
50 newest of 182 All 182 (JSON)
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoningcited by 44
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 40
- 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 38
- 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graphcited by 23
- 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
- 2023keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLMcited by 16
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaborationcited by 16
12 most cited of 37 All 37 (JSON)
- 2026TCAR-Gen: Temporal Graph Retrieval with Evidence Fusion for Knowledge-Grounded Generation15 Apr 2026
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering13 Apr 2026
- 2026RouterKGQA: Specialized--General Model Routing for Constraint-Aware Knowledge Graph Question Answering20 Mar 2026
- 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge25 Feb 2026
- 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modeling25 Feb 2026
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering6 Nov 2025
- 2025DTKG: Dual-Track Knowledge Graph-Verified Reasoning Framework for Multi-Hop QA18 Oct 2025
- 2025MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoning15 Oct 2025
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs9 Oct 2025
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs8 Oct 2025
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2025GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models20 Sep 2025
12 newest of 37 All 37 (JSON)
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
- 2024Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answeringcited by 7
- 2025RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answeringcited by 5
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILEcited by 4
- 2026S-Path-RAG: Semantic-Aware Shortest-Path Retrieval Augmented Generation for Multi-Hop Knowledge Graph Question Answeringcited by 3
- 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filteringcited by 2
- 2025Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioningcited by 2
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
- 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Frameworkcited by 0
- 2026MDER-DR: Multi-Hop Question Answering with Entity-Centric Summariescited by 0
12 most cited of 16 All 16 (JSON)
- 2026Meet, Compare, or Abstain: LatWeave for Deterministic Multi-Hop Question Answering on Knowledge Lattices23 Sep 2026
- 2026MissDiag: Diagnostic Evaluation of Incomplete-Knowledge Robustness in KGQA and KG-RAG19 Aug 2026
- 2026KAMR: Grounding Generation via Knowledge-Aligned Multi-hop Retrieval29 Jul 2026
- 2026Structure Over Scale: Schema-Constrained Causal Graphs for RAG10 Jun 2026
- 2026MDER-DR: Multi-Hop Question Answering with Entity-Centric Summaries11 Mar 2026
- 2026S-Path-RAG: Semantic-Aware Shortest-Path Retrieval Augmented Generation for Multi-Hop Knowledge Graph Question Answering5 Mar 2026
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering6 Nov 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework30 Aug 2025
- 2025Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioning20 May 2025
- 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering19 May 2025
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey8 Apr 2025
12 newest of 16 All 16 (JSON)
- 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 59
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 29
- 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Searchcited by 21
- 2025CLAUSE: Agentic Neuro-Symbolic Knowledge Graph Reasoning via Dynamic Learnable Context Engineeringcited by 3
- 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrievalcited by 3
- 2025Learning to Refine: An Agentic RL Approach for Iterative SPARQL Query Constructioncited by 2
- 2026GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answeringcited by 1
- 2026GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering28 May 2026
- 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval13 Apr 2026
- 2025Learning to Refine: An Agentic RL Approach for Iterative SPARQL Query Construction14 Nov 2025
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering6 Oct 2025
- 2025CLAUSE: Agentic Neuro-Symbolic Knowledge Graph Reasoning via Dynamic Learnable Context Engineering25 Sep 2025
- 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search31 Jan 2025
- 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering23 Apr 2024
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161
- 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
- 2021Question Answering Over Temporal Knowledge Graphscited by 99
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 90
- 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
12 most cited of 122 All 122 (JSON)
- 2026Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines4 Sep 2026
- 2026VISPATH: Visual-Intent-Guided Path Reasoning for Multimodal Knowledge Graph Question Answering4 Aug 2026
- 2026RSF-GLLM: Bridging the Semantic Gap in Multi-Hop Knowledge Graph QA via Recurrent Soft-Flow and Decoupled LLM Generation7 Jul 2026
- 2026Ontology-Guided Evidence Path Inference for Multi-hop Knowledge Graph Question Answering26 Jun 2026
- 2026Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling12 Jun 2026
- 2026Bounded Path Context: A Controlled Study of Visible Path History in LLM-Based Knowledge Graph Question Answering26 May 2026
- 2026Autonomous Knowledge Graph Exploration with Adaptive Breadth-Depth Retrieval20 Jan 2026
- 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answering10 Dec 2025
- 2025Debate over Mixed-knowledge: A Robust Multi-Agent Reasoning Framework for Incomplete Knowledge Graph Question Answering15 Nov 2025
- 2025Deep Literature Survey Automation with an Iterative Workflow24 Oct 2025
- 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering10 Oct 2025
- 2025Knowledge Graph Sparsification for GNN-based Rare Disease Diagnosis9 Oct 2025
12 newest of 122 All 122 (JSON)