mlsanityData to 14 Oct 2026

Complex Knowledge Base Question Answering: A Survey

arXiv 2108.06688 ↗First posted 15 Aug 2021cs.CLcited by 52

Not on the map. Why?

Abstract (arXiv)

Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Early studies mainly focused on answering simple questions over KBs and achieved great success. However, their performance on complex questions is still far from satisfactory. Therefore, in recent years, researchers propose a large number of novel methods, which looked into the challenges of answering complex questions. In this survey, we review recent advances on KBQA with the focus on solving complex questions, which usually contain multiple subjects, express compound relations, or involve numerical operations. In detail, we begin with introducing the complex KBQA task and relevant background. Then, we describe benchmark datasets for complex KBQA task and introduce the construction process of these datasets. Next, we present two mainstream categories of methods for complex KBQA, namely semantic parsing-based (SP-based) methods and information retrieval-based (IR-based) methods. Specifically, we illustrate their procedures with flow designs and discuss their major differences and similarities. After that, we summarize the challenges that these two categories of methods encounter when answering complex questions, and explicate advanced solutions and techniques used in existing work. Finally, we conclude and discuss several promising directions related to complex KBQA for future research.

Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 81 of its 171 references that are in the map. First posted on arXiv 15 Aug 2021.

Builds on

81 of 171 references.

References · 81

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  8. 2019Language Models as Knowledge Bases?cited by 1,936
  9. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  10. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  11. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  12. 2019How Can We Know What Language Models Know?cited by 959
38 more
  1. 2016Complex Embeddings for Simple Link Predictioncited by 902
  2. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  3. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  4. 2018Hypergraph Neural Networkscited by 488
  5. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
  6. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  7. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  8. 2021Pre-Trained Models: Past, Present and Futurecited by 319
  9. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 306
  10. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  11. 2019Measuring Compositional Generalization: A Comprehensive Method on Realistic Datacited by 284
  12. 2019Deep Learning for Symbolic Mathematicscited by 270
  13. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  14. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
  15. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 171
  16. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  17. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
  18. 2020Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both?cited by 147
  19. 2015Large-scale Simple Question Answering with Memory Networkscited by 127
  20. 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
  21. 2019Learning by Abstraction: The Neural State Machinecited by 113
  22. 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
  23. 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 103
  24. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
  25. 2020Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspectivecited by 95
  26. 2016Learning to Compose Neural Networks for Question Answeringcited by 85
  27. 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
  28. 2019Inducing Relational Knowledge from BERTcited by 75
  29. 2016Image-embodied Knowledge Representation Learningcited by 68
  30. 2019OpenNRE: An Open and Extensible Toolkit for Neural Relation Extractioncited by 62
  31. 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
  32. 2014Question Answering with Subgraph Embeddingscited by 58
  33. 2020Leveraging Abstract Meaning Representation for Knowledge Base Question Answeringcited by 53
  34. 2018An Interpretable Reasoning Network for Multi-Relation Question Answeringcited by 47
  35. 2019TEQUILA: Temporal Question Answering over Knowledge Basescited by 47
  36. 2020SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Basescited by 47
  37. 2020A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challengescited by 47
  38. 2017Improved Neural Relation Detection for Knowledge Base Question Answeringcited by 44

50 most cited of 81 All 81 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 9; 2024: 16; 2025: 11; 2026: 10.

52 papers.

Sort:

By area:

  1. 2023A Survey of Large Language Modelscited by 2,576
  2. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
  3. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  4. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
  5. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  6. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 93
  7. 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
  8. 2024HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Basescited by 29
  9. 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
  10. 2022Chart Question Answering: State of the Art and Future Directionscited by 26
  11. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  12. 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
38 more
  1. 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chainscited by 20
  2. 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answeringcited by 19
  3. 2024LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environmentscited by 18
  4. 2024Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrievalcited by 16
  5. 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 14
  6. 2024Distilling Reasoning Ability from Large Language Models with Adaptive Thinkingcited by 13
  7. 2024Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagramcited by 13
  8. 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answeringcited by 8
  9. 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
  10. 2023On Evaluating Multilingual Compositional Generalization with Translated Datasetscited by 6
  11. 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
  12. 2023Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documentscited by 5
  13. 2024UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Modelscited by 5
  14. 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILEcited by 4
  15. 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challengescited by 3
  16. 2023Data Distribution Bottlenecks in Grounding Language Models to Knowledge Basescited by 3
  17. 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
  18. 2025Fine-Grained Appropriate Reliance: Human-AI Collaboration with a Multi-Step Transparent Decision Workflow for Complex Task Decompositioncited by 3
  19. 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
  20. 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answeringcited by 3
  21. 2024DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generationcited by 2
  22. 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphscited by 2
  23. 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?cited by 2
  24. 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
  25. 2026JobResQA: A Benchmark for LLM Machine Reading Comprehension on Multilingual R'esum'es and JDscited by 2
  26. 2022Where Was COVID-19 First Discovered? Designing a Question-Answering System for Pandemic Situationscited by 1
  27. 2023From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Basecited by 1
  28. 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphscited by 1
  29. 2026CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factorscited by 1
  30. 2026Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibrationcited by 1
  31. 2026GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAGcited by 1
  32. 2023GNN2R: Weakly-Supervised Rationale-Providing Question Answering over Knowledge Graphscited by 0
  33. 2024DELE: Deductive EL++ Embeddings for Knowledge Base Completioncited by 0
  34. 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answeringcited by 0
  35. 2026Reward on Path: Learning Intermediate Supervision Signals for Knowledge Graph Question Answeringcited by 0
  36. 2026KG-Guard: Graph-Based Hallucination Detection for Knowledge Base Question Answeringcited by 0
  37. 2026SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generationcited by 0
  38. 2026Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systemscited by 0

50 most cited of 52 All 52 (JSON)