Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval
Not on the map. Why?
Abstract (arXiv)
Information retrieval (IR) methods for KGQA consist of two stages: subgraph extraction and answer reasoning. We argue current subgraph extraction methods underestimate the importance of structural dependencies among evidence facts. We propose Evidence Pattern Retrieval (EPR) to explicitly model the structural dependencies during subgraph extraction. We implement EPR by indexing the atomic adjacency pattern of resource pairs. Given a question, we perform dense retrieval to obtain atomic patterns formed by resource pairs. We then enumerate their combinations to construct candidate evidence patterns. These evidence patterns are scored using a neural model, and the best one is selected to extract a subgraph for downstream answer reasoning. Experimental results demonstrate that the EPR-based approach has significantly improved the F1 scores of IR-KGQA methods by over 10 points on ComplexWebQuestions and achieves competitive performance on WebQuestionsSP.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 3 Feb 2024.
Builds on
20 of 37 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
- 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 169
- 2015Large-scale Simple Question Answering with Memory Networkscited by 127
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
8 more
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
- 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 83
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
- 2021Complex Knowledge Base Question Answering: A Surveycited by 52
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
- 2016Question Answering on Freebase via Relation Extraction and Textual Evidencecited by 39
- 2018Variational Knowledge Graph Reasoningcited by 27
Built on by
Citing papers per year: 2024: 3; 2025: 10; 2026: 3.
16 papers.
Sort:
By area:
- 2024Graph Neural Network Enhanced Retrieval for Question Answering of LLMscited by 10
- 2024Effective Instruction Parsing Plugin for Complex Logical Query Answering on Knowledge Graphscited by 8
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generationcited by 8
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
- 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasetscited by 5
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
- 2024Dynamic Few-Shot Learning for Knowledge Graph Question Answeringcited by 4
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMscited by 4
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
- 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generationcited by 3
- 2025CLAUSE: Agentic Neuro-Symbolic Knowledge Graph Reasoning via Dynamic Learnable Context Engineeringcited by 3
- 2025KG-CQR: Leveraging Structured Relation Representations in Knowledge Graphs for Contextual Query Retrievalcited by 1
4 more
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
- 2026RPO-RAG: Aligning Small LLMs with Relation-aware Preference Optimization for Knowledge Graph Question Answeringcited by 1
- 2026CHE-TKG: Collaborative Historical Evidence and Evolutionary Dynamics Learning for Temporal Knowledge Graph Reasoningcited by 0
- 2026Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generationcited by 0
- 2026Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation26 Aug 2026
- 2026CHE-TKG: Collaborative Historical Evidence and Evolutionary Dynamics Learning for Temporal Knowledge Graph Reasoning6 May 2026
- 2026RPO-RAG: Aligning Small LLMs with Relation-aware Preference Optimization for Knowledge Graph Question Answering27 Jan 2026
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoning15 Oct 2025
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAG15 Oct 2025
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs9 Oct 2025
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs25 Sep 2025
- 2025CLAUSE: Agentic Neuro-Symbolic Knowledge Graph Reasoning via Dynamic Learnable Context Engineering25 Sep 2025
- 2025KG-CQR: Leveraging Structured Relation Representations in Knowledge Graphs for Contextual Query Retrieval28 Aug 2025
- 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generation5 Aug 2025
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answering18 May 2025
- 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasets6 Mar 2025
4 more
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation18 Feb 2025
- 2024Effective Instruction Parsing Plugin for Complex Logical Query Answering on Knowledge Graphs27 Oct 2024
- 2024Dynamic Few-Shot Learning for Knowledge Graph Question Answering1 Jul 2024
- 2024Graph Neural Network Enhanced Retrieval for Question Answering of LLMs3 Jun 2024
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
- 2026RPO-RAG: Aligning Small LLMs with Relation-aware Preference Optimization for Knowledge Graph Question Answeringcited by 1
- 2026RPO-RAG: Aligning Small LLMs with Relation-aware Preference Optimization for Knowledge Graph Question Answering27 Jan 2026
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoning15 Oct 2025
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs9 Oct 2025
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answering18 May 2025
- 2024Graph Neural Network Enhanced Retrieval for Question Answering of LLMscited by 10
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
- 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generationcited by 3
- 2025KG-CQR: Leveraging Structured Relation Representations in Knowledge Graphs for Contextual Query Retrievalcited by 1
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAG15 Oct 2025
- 2025KG-CQR: Leveraging Structured Relation Representations in Knowledge Graphs for Contextual Query Retrieval28 Aug 2025
- 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generation5 Aug 2025
- 2024Graph Neural Network Enhanced Retrieval for Question Answering of LLMs3 Jun 2024
- 2024Effective Instruction Parsing Plugin for Complex Logical Query Answering on Knowledge Graphscited by 8
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generationcited by 8
- 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasetscited by 5
- 2024Dynamic Few-Shot Learning for Knowledge Graph Question Answeringcited by 4
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMscited by 4
- 2026CHE-TKG: Collaborative Historical Evidence and Evolutionary Dynamics Learning for Temporal Knowledge Graph Reasoningcited by 0
- 2026Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generationcited by 0
- 2026Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation26 Aug 2026
- 2026CHE-TKG: Collaborative Historical Evidence and Evolutionary Dynamics Learning for Temporal Knowledge Graph Reasoning6 May 2026
- 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs25 Sep 2025
- 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasets6 Mar 2025
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation18 Feb 2025
- 2024Effective Instruction Parsing Plugin for Complex Logical Query Answering on Knowledge Graphs27 Oct 2024
- 2024Dynamic Few-Shot Learning for Knowledge Graph Question Answering1 Jul 2024