Complex Knowledge Base Question Answering: A Survey
Not on the map. Why?
Abstract (arXiv)
Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Early studies mainly focused on answering simple questions over KBs and achieved great success. However, their performance on complex questions is still far from satisfactory. Therefore, in recent years, researchers propose a large number of novel methods, which looked into the challenges of answering complex questions. In this survey, we review recent advances on KBQA with the focus on solving complex questions, which usually contain multiple subjects, express compound relations, or involve numerical operations. In detail, we begin with introducing the complex KBQA task and relevant background. Then, we describe benchmark datasets for complex KBQA task and introduce the construction process of these datasets. Next, we present two mainstream categories of methods for complex KBQA, namely semantic parsing-based (SP-based) methods and information retrieval-based (IR-based) methods. Specifically, we illustrate their procedures with flow designs and discuss their major differences and similarities. After that, we summarize the challenges that these two categories of methods encounter when answering complex questions, and explicate advanced solutions and techniques used in existing work. Finally, we conclude and discuss several promising directions related to complex KBQA for future research.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 81 of its 171 references that are in the map. First posted on arXiv 15 Aug 2021.
Builds on
81 of 171 references.
References · 81
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
- 2019How Can We Know What Language Models Know?cited by 959
38 more
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
- 2018Hypergraph Neural Networkscited by 488
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 306
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2019Measuring Compositional Generalization: A Comprehensive Method on Realistic Datacited by 284
- 2019Deep Learning for Symbolic Mathematicscited by 270
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
- 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 171
- 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
- 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
- 2020Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both?cited by 147
- 2015Large-scale Simple Question Answering with Memory Networkscited by 127
- 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
- 2019Learning by Abstraction: The Neural State Machinecited by 113
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 103
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
- 2020Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspectivecited by 95
- 2016Learning to Compose Neural Networks for Question Answeringcited by 85
- 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
- 2019Inducing Relational Knowledge from BERTcited by 75
- 2016Image-embodied Knowledge Representation Learningcited by 68
- 2019OpenNRE: An Open and Extensible Toolkit for Neural Relation Extractioncited by 62
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2014Question Answering with Subgraph Embeddingscited by 58
- 2020Leveraging Abstract Meaning Representation for Knowledge Base Question Answeringcited by 53
- 2018An Interpretable Reasoning Network for Multi-Relation Question Answeringcited by 47
- 2019TEQUILA: Temporal Question Answering over Knowledge Basescited by 47
- 2020SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Basescited by 47
- 2020A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challengescited by 47
- 2017Improved Neural Relation Detection for Knowledge Base Question Answeringcited by 44
50 most cited of 81 All 81 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 9; 2024: 16; 2025: 11; 2026: 10.
52 papers.
Sort:
By area:
- 2023A Survey of Large Language Modelscited by 2,576
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
- 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 93
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
- 2024HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Basescited by 29
- 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
- 2022Chart Question Answering: State of the Art and Future Directionscited by 26
- 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
38 more
- 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chainscited by 20
- 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answeringcited by 19
- 2024LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environmentscited by 18
- 2024Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrievalcited by 16
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 14
- 2024Distilling Reasoning Ability from Large Language Models with Adaptive Thinkingcited by 13
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagramcited by 13
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answeringcited by 8
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasetscited by 6
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
- 2023Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documentscited by 5
- 2024UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Modelscited by 5
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILEcited by 4
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challengescited by 3
- 2023Data Distribution Bottlenecks in Grounding Language Models to Knowledge Basescited by 3
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2025Fine-Grained Appropriate Reliance: Human-AI Collaboration with a Multi-Step Transparent Decision Workflow for Complex Task Decompositioncited by 3
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
- 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answeringcited by 3
- 2024DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generationcited by 2
- 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphscited by 2
- 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?cited by 2
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
- 2026JobResQA: A Benchmark for LLM Machine Reading Comprehension on Multilingual R'esum'es and JDscited by 2
- 2022Where Was COVID-19 First Discovered? Designing a Question-Answering System for Pandemic Situationscited by 1
- 2023From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Basecited by 1
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphscited by 1
- 2026CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factorscited by 1
- 2026Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibrationcited by 1
- 2026GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAGcited by 1
- 2023GNN2R: Weakly-Supervised Rationale-Providing Question Answering over Knowledge Graphscited by 0
- 2024DELE: Deductive EL++ Embeddings for Knowledge Base Completioncited by 0
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answeringcited by 0
- 2026Reward on Path: Learning Intermediate Supervision Signals for Knowledge Graph Question Answeringcited by 0
- 2026KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answeringcited by 0
- 2026SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generationcited by 0
- 2026Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systemscited by 0
50 most cited of 52 All 52 (JSON)
- 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Models24 Aug 2026
- 2026GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAG15 Aug 2026
- 2026GGC: Selective Query Correction for Reliable Text-to-SPARQL Generation30 Jul 2026
- 2026Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systems29 Jul 2026
- 2026SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generation16 Jul 2026
- 2026KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answering29 May 2026
- 2026Reward on Path: Learning Intermediate Supervision Signals for Knowledge Graph Question Answering11 May 2026
- 2026Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibration8 May 2026
- 2026CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors16 Apr 2026
- 2026JobResQA: A Benchmark for LLM Machine Reading Comprehension on Multilingual R'esum'es and JDs30 Jan 2026
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs4 Dec 2025
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering6 Nov 2025
38 more
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering6 Nov 2025
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAG15 Oct 2025
- 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?26 Sep 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering2 Jun 2025
- 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering20 May 2025
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answering18 May 2025
- 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs18 Feb 2025
- 2025Fine-Grained Appropriate Reliance: Human-AI Collaboration with a Multi-Step Transparent Decision Workflow for Complex Task Decomposition19 Jan 2025
- 2024HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Bases20 Dec 2024
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables5 Dec 2024
- 2024DELE: Deductive EL++ Embeddings for Knowledge Base Completion3 Nov 2024
- 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains24 Oct 2024
- 2024LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environments28 Aug 2024
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug 2024
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagram10 Jul 2024
- 2024UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models4 Jun 2024
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning30 May 2024
- 2024Distilling Reasoning Ability from Large Language Models with Adaptive Thinking14 Apr 2024
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Future6 Apr 2024
- 2024DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation4 Mar 2024
- 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models23 Feb 2024
- 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph17 Feb 2024
- 2024Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval3 Feb 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023GNN2R: Weakly-Supervised Rationale-Providing Question Answering over Knowledge Graphs4 Dec 2023
- 2023Data Distribution Bottlenecks in Grounding Language Models to Knowledge Bases15 Sep 2023
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph15 Jul 2023
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasets20 Jun 2023
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models19 May 2023
- 2023From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base5 May 2023
- 2023A Survey of Large Language Models31 Mar 2023
- 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answering18 Mar 2023
- 2023Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documents14 Feb 2023
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges27 Nov 2022
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Bases24 Oct 2022
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspective12 Sep 2022
- 2022Chart Question Answering: State of the Art and Future Directions8 May 2022
50 newest of 52 All 52 (JSON)
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
- 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 93
- 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chainscited by 20
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 14
- 2024Distilling Reasoning Ability from Large Language Models with Adaptive Thinkingcited by 13
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagramcited by 13
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answeringcited by 8
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
- 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphscited by 2
- 2023From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Basecited by 1
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Models24 Aug 2026
- 2026GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAG15 Aug 2026
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs4 Dec 2025
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering6 Nov 2025
- 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering2 Jun 2025
- 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answering18 May 2025
- 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs18 Feb 2025
- 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables5 Dec 2024
- 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains24 Oct 2024
- 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagram10 Jul 2024
- 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning30 May 2024
- 2024Distilling Reasoning Ability from Large Language Models with Adaptive Thinking14 Apr 2024
12 newest of 15 All 15 (JSON)
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2024HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Basescited by 29
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILEcited by 4
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering6 Nov 2025
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAG15 Oct 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2024HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Bases20 Dec 2024
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug 2024
- 2023A Survey of Large Language Modelscited by 2,576
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
- 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
- 2022Chart Question Answering: State of the Art and Future Directionscited by 26
- 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
- 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answeringcited by 19
- 2024LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environmentscited by 18
- 2024Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrievalcited by 16
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasetscited by 6
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
12 most cited of 30 All 30 (JSON)
- 2026GGC: Selective Query Correction for Reliable Text-to-SPARQL Generation30 Jul 2026
- 2026KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answering29 May 2026
- 2026Reward on Path: Learning Intermediate Supervision Signals for Knowledge Graph Question Answering11 May 2026
- 2026Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibration8 May 2026
- 2026CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors16 Apr 2026
- 2026JobResQA: A Benchmark for LLM Machine Reading Comprehension on Multilingual R'esum'es and JDs30 Jan 2026
- 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?26 Sep 2025
- 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering20 May 2025
- 2025Fine-Grained Appropriate Reliance: Human-AI Collaboration with a Multi-Step Transparent Decision Workflow for Complex Task Decomposition19 Jan 2025
- 2024DELE: Deductive EL++ Embeddings for Knowledge Base Completion3 Nov 2024
- 2024LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environments28 Aug 2024
- 2024UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models4 Jun 2024
12 newest of 30 All 30 (JSON)