mlsanityData to 7 Oct 2026

Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering

arXiv 2505.14099 ↗First posted 20 May 2025cs.CL cs.IRcited by 2

Not on the map. Why?

Abstract (arXiv)

Knowledge Base Question Answering (KBQA) aims to answer natural language questions using structured knowledge from KBs. While LLM-only approaches offer generalization, they suffer from outdated knowledge, hallucinations, and lack of transparency. Chain-based KG-RAG methods address these issues by incorporating external KBs, but are limited to simple chain-structured questions due to the absence of planning and logical structuring. Inspired by semantic parsing methods, we propose PDRR: a four-stage framework consisting of Predict, Decompose, Retrieve, and Reason. Our method first predicts the question type and decomposes the question into structured triples. Then retrieves relevant information from KBs and guides the LLM as an agent to reason over and complete the decomposed triples. Experimental results demonstrate that PDRR consistently outperforms existing methods across various LLM backbones and achieves superior performance on both chain-structured and non-chain complex questions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

17 of 26 references.

References · 17

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
  4. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  5. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  6. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
  7. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
  8. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 169
  9. 2015Large-scale Simple Question Answering with Memory Networkscited by 127
  10. 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
  11. 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
  12. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 100
5 more
  1. 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 77
  2. 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 59
  3. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  4. 2020SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Basescited by 47
  5. 2024Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chainscited by 20

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLM
  2. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models
  3. 2024A Learn-Then-Reason Model Towards Generalization in Knowledge Base Question Answering
  4. 2025KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search
  5. 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering
  6. 2022Structured Knowledge Grounding for Question Answering
  7. 2026Joint Knowledge Base Completion and Question Answering by Combining Large Language Models and Small Language Models
  8. 2025KERAG: Knowledge-Enhanced Retrieval-Augmented Generation for Advanced Question Answering