A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutions
Not on the map. Why?
Abstract (arXiv)
Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Recently, a large number of studies focus on semantically or syntactically complicated questions. In this paper, we elaborately summarize the typical challenges and solutions for complex KBQA. We begin with introducing the background about the KBQA task. Next, we present the two mainstream categories of methods for complex KBQA, namely semantic parsing-based (SP-based) methods and information retrieval-based (IR-based) methods. We then review the advanced methods comprehensively from the perspective of the two categories. Specifically, we explicate their solutions to the typical challenges. Finally, we conclude and discuss some promising directions for future research.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Builds on 26 of its 72 references that are in the map. First posted on arXiv 25 May 2021.
Builds on
26 of 72 references.
References · 26
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2019How Can We Know What Language Models Know?cited by 953
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
- 2019Measuring Compositional Generalization: A Comprehensive Method on Realistic Datacited by 280
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2020Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learningcited by 216
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
- 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
- 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 169
- 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 167
- 2015Large-scale Simple Question Answering with Memory Networkscited by 127
- 2019Learning by Abstraction: The Neural State Machinecited by 113
14 more
- 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 101
- 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
- 2019Inducing Relational Knowledge from BERTcited by 75
- 2016Image-embodied Knowledge Representation Learningcited by 68
- 2018An Interpretable Reasoning Network for Multi-Relation Question Answeringcited by 47
- 2020SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Basescited by 47
- 2020A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challengescited by 47
- 2019UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answeringcited by 37
- 2019Improving Question Answering over Incomplete KBs with Knowledge-Aware Readercited by 37
- 2018Learning to Rank Query Graphs for Complex Question Answering over Knowledge Graphscited by 17
- 2019Introduction to Neural Network based Approaches for Question Answering over Knowledge Graphscited by 15
- 2019Leveraging Frequent Query Substructures to Generate Formal Queries for Complex Question Answeringcited by 15
- 2020Less is More: Data-Efficient Complex Question Answering over Knowledge Basescited by 9
- 2020Mining Implicit Entity Preference from User-Item Interaction Data for Knowledge Graph Completion via Adversarial Learningcited by 6
Built on by
Citing papers per year: 2021: 6; 2022: 15; 2023: 21; 2024: 20; 2025: 11; 2026: 4.
77 papers.
Sort:
By area:
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
- 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
- 2022Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answeringcited by 71
- 2021Complex Knowledge Base Question Answering: A Surveycited by 52
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 37
- 2021Program Transfer for Answering Complex Questions over Knowledge Basescited by 34
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operationscited by 30
- 2024MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistantscited by 24
- 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answeringcited by 23
38 more
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
- 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 21
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20
- 2022ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphscited by 16
- 2023Question Decomposition Tree for Answering Complex Questions over Knowledge Basescited by 15
- 2024Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Factscited by 14
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
- 2024OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing Systemcited by 12
- 2023Synergistic Interplay between Search and Large Language Models for Information Retrievalcited by 11
- 2023Large Language Models Meet Knowledge Graphs to Answer Factoid Questionscited by 11
- 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answeringcited by 11
- 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Topcited by 11
- 2023Semantic Parsing for Conversational Question Answering over Knowledge Graphscited by 10
- 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Modelscited by 9
- 2024Temporal Knowledge Graph Question Answering: A Surveycited by 9
- 2024NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Languagecited by 9
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generationcited by 8
- 2021Improving Embedded Knowledge Graph Multi-hop Question Answering by introducing Relational Chain Reasoningcited by 7
- 2021Graph-augmented Learning to Rank for Querying Large-scale Knowledge Graphcited by 7
- 2023Pay More Attention to Relation Exploration for Knowledge Base Question Answeringcited by 7
- 2023TableQAKit: A Comprehensive and Practical Toolkit for Table-based Question Answeringcited by 7
- 2023NuTrea: Neural Tree Search for Context-guided Multi-hop KGQAcited by 7
- 2023GPT4SGG: Synthesizing Scene Graphs from Holistic and Region-specific Narrativescited by 7
- 2022CBR-iKB: A Case-Based Reasoning Approach for Question Answering over Incomplete Knowledge Basescited by 6
- 2023GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answeringcited by 6
- 2023From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignmentcited by 6
- 2023MarkQA: A large scale KBQA dataset with numerical reasoningcited by 6
- 2022Evaluation of Question Answering Systems: Complexity of judging a natural languagecited by 5
- 2022GraphWOZ: Dialogue Management with Conversational Knowledge Graphscited by 5
- 2023May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainabilitycited by 5
- 2024Self-Improvement Programming for Temporal Knowledge Graph Question Answeringcited by 5
- 2024KET-QA: A Dataset for Knowledge Enhanced Table Question Answeringcited by 5
- 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databasescited by 5
- 2025Temporal Information Retrieval via Time-Specifier Model Mergingcited by 5
- 2021Attention-based Aspect Reasoning for Knowledge Base Question Answering on Clinical Notescited by 4
- 2021Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Modelscited by 4
- 2022High-quality Task Division for Large-scale Entity Alignmentcited by 4
- 2022ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chainscited by 4
50 most cited of 77 All 77 (JSON)
- 2026Build2SPARQL: A Large-Scale Text-to-SPARQL Benchmark Dataset for Building Knowledge Graph Querying22 Sep 2026
- 2026Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation26 Aug 2026
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphs14 Aug 2026
- 2026STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answering19 Apr 2026
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questions16 Dec 2025
- 2025Uncertain Knowledge Graph Completion via Semi-Supervised Confidence Distribution Learning18 Oct 2025
- 2025Research on Multi-hop Inference Optimization of LLM Based on MQUAKE Framework5 Sep 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2025An Entity Linking Agent for Question Answering5 Aug 2025
- 2025Temporal Information Retrieval via Time-Specifier Model Merging9 Jul 2025
- 2025CHAINSFORMER: Numerical Reasoning on Knowledge Graphs from a Chain Perspective19 Apr 2025
- 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases7 Apr 2025
38 more
- 2025DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition6 Apr 2025
- 2025Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrieval19 Feb 2025
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation18 Feb 2025
- 2024NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Language11 Dec 2024
- 2024Class Granularity: How richly does your knowledge graph represent the real world?10 Nov 2024
- 2024SAKA: An Intelligent Platform for Semi-automated Knowledge Graph Construction and Application10 Oct 2024
- 2024MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistants30 Sep 2024
- 2024Temporally Consistent Factuality Probing for Large Language Models21 Sep 2024
- 2024OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing System9 Sep 2024
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug 2024
- 2024CARE: A Clue-guided Assistant for CSRs to Read User Manuals7 Aug 2024
- 2024Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction5 Aug 2024
- 2024DEXTER: A Benchmark for open-domain Complex Question Answering using LLMs24 Jun 2024
- 2024Temporal Knowledge Graph Question Answering: A Survey20 Jun 2024
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detector17 Jun 2024
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphs12 Jun 2024
- 2024Cost-efficient Knowledge-based Question Answering with Large Language Models27 May 2024
- 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top24 May 2024
- 2024KET-QA: A Dataset for Knowledge Enhanced Table Question Answering13 May 2024
- 2024Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Facts10 May 2024
- 2024Self-Improvement Programming for Temporal Knowledge Graph Question Answering2 Apr 2024
- 2024EEE-QA: Exploring Effective and Efficient Question-Answer Representations4 Mar 2024
- 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering3 Mar 2024
- 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answering23 Dec 2023
- 2023GPT4SGG: Synthesizing Scene Graphs from Holistic and Region-specific Narratives7 Dec 2023
- 2023MarkQA: A large scale KBQA dataset with numerical reasoning24 Oct 2023
- 2023NuTrea: Neural Tree Search for Context-guided Multi-hop KGQA24 Oct 2023
- 2023TableQAKit: A Comprehensive and Practical Toolkit for Table-based Question Answering23 Oct 2023
- 2023GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language Models12 Oct 2023
- 2023Large Language Models Meet Knowledge Graphs to Answer Factoid Questions3 Oct 2023
- 2023May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainability25 Sep 2023
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering23 Aug 2023
- 2023ADMUS: A Progressive Question Answering Framework Adaptable to Multiple Knowledge Sources9 Aug 2023
- 2023An Effective and Efficient Time-aware Entity Alignment Framework via Two-aspect Three-view Label Propagation12 Jul 2023
- 2023VisKoP: Visual Knowledge oriented Programming for Interactive Knowledge Base Question Answering6 Jul 2023
- 2023Question Decomposition Tree for Answering Complex Questions over Knowledge Bases13 Jun 2023
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operations19 May 2023
- 2023From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment19 May 2023
50 newest of 77 All 77 (JSON)
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
- 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answeringcited by 23
- 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answeringcited by 11
- 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Modelscited by 9
- 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databasescited by 5
- 2022Exploiting Hybrid Semantics of Relation Paths for Multi-hop Question Answering Over Knowledge Graphscited by 2
- 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases7 Apr 2025
- 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering3 Mar 2024
- 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answering23 Dec 2023
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Data16 May 2023
- 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec 2022
- 2022Exploiting Hybrid Semantics of Relation Paths for Multi-hop Question Answering Over Knowledge Graphs2 Sep 2022
- 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models4 May 2022
- 2024MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistantscited by 24
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20
- 2024NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Languagecited by 9
- 2025An Entity Linking Agent for Question Answeringcited by 2
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphscited by 0
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphs14 Aug 2026
- 2025An Entity Linking Agent for Question Answering5 Aug 2025
- 2024NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Language11 Dec 2024
- 2024MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistants30 Sep 2024
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detector17 Jun 2024
- 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
- 2022Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answeringcited by 71
- 2021Complex Knowledge Base Question Answering: A Surveycited by 52
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 37
- 2021Program Transfer for Answering Complex Questions over Knowledge Basescited by 34
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operationscited by 30
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
- 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 21
- 2022ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphscited by 16
- 2023Question Decomposition Tree for Answering Complex Questions over Knowledge Basescited by 15
- 2024Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Factscited by 14
12 most cited of 61 All 61 (JSON)
- 2026Build2SPARQL: A Large-Scale Text-to-SPARQL Benchmark Dataset for Building Knowledge Graph Querying22 Sep 2026
- 2026Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation26 Aug 2026
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questions16 Dec 2025
- 2025Uncertain Knowledge Graph Completion via Semi-Supervised Confidence Distribution Learning18 Oct 2025
- 2025Research on Multi-hop Inference Optimization of LLM Based on MQUAKE Framework5 Sep 2025
- 2025Temporal Information Retrieval via Time-Specifier Model Merging9 Jul 2025
- 2025CHAINSFORMER: Numerical Reasoning on Knowledge Graphs from a Chain Perspective19 Apr 2025
- 2025DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition6 Apr 2025
- 2025Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrieval19 Feb 2025
- 2025Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation18 Feb 2025
- 2024Class Granularity: How richly does your knowledge graph represent the real world?10 Nov 2024
- 2024SAKA: An Intelligent Platform for Semi-automated Knowledge Graph Construction and Application10 Oct 2024
12 newest of 61 All 61 (JSON)