mlsanityData to 14 Oct 2026

The benefits of query-based KGQA systems for complex and temporal questions in LLM era

arXiv 2507.11954 ↗First posted 16 Jul 2025cs.CL cs.LGcited by 1

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large language models excel in question-answering (QA) yet still struggle with multi-hop reasoning and temporal questions. Query-based knowledge graph QA (KGQA) offers a modular alternative by generating executable queries instead of direct answers. We explore multi-stage query-based framework for WikiData QA, proposing multi-stage approach that enhances performance on challenging multi-hop and temporal benchmarks. Through generalization and rejection studies, we evaluate robustness across multi-hop and temporal QA datasets. Additionally, we introduce a novel entity linking and predicate matching method using CoT reasoning. Our results demonstrate the potential of query-based multi-stage KGQA framework for improving multi-hop and temporal QA with small language models. Code and data: https://github.com/ar2max/NLDB-KGQA-System

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 45 references that are in the map. First posted on arXiv 16 Jul 2025.

Builds on

28 of 45 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 27

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
  6. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
  7. 2023Physics of Language Models: Part 3.1, Knowledge Storage and Extractioncited by 270
  8. 2022SGPT: GPT Sentence Embeddings for Semantic Searchcited by 204
  9. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 171
  10. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 84
  11. 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
  12. 2023Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Familycited by 71
15 more
  1. 2022Modern Baselines for SPARQL Semantic Parsingcited by 34
  2. 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
  3. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  4. 2019Falcon 2.0: An Entity and Relation Linking Tool over Wikidatacited by 21
  5. 2023An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answeringcited by 19
  6. 2024SPARQL Generation: an analysis on fine-tuning OpenLLaMA for Question Answering over a Life Science Knowledge Graphcited by 19
  7. 2024PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answeringcited by 15
  8. 2022Knowledge Graph Question Answering Datasets and Their Generalizability: Are They Enough for Future Research?cited by 13
  9. 2024Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistancecited by 13
  10. 2017Strong Baselines for Simple Question Answering over Knowledge Graphs with and without Neural Networkscited by 12
  11. 2025Confidence Estimation for Error Detection in Text-to-SQL Systemscited by 11
  12. 2022MEKER: Memory Efficient Knowledge Embedding Representation for Link Prediction and Question Answeringcited by 4
  13. 2024Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answeringcited by 3
  14. 2025Q-NL Verifier: Leveraging Synthetic Data for Robust Knowledge Graph Question Answeringcited by 2
  15. 2024Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptabilitycited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026DeSQ: Decomposition-based SPARQL Query Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking
  2. 2026KG2Code: Bridging Knowledge Graphs and Large Language Models via Executable Code for Question Answering
  3. 2025KG-MuLQA: A Framework for KG-based Multi-Level QA Extraction and Long-Context LLM Evaluation
  4. 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Models
  5. 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA
  6. 2022A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge Bases
  7. 2024MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge
  8. 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration