mlsanityData to 14 Oct 2026

ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models

arXiv 2310.08975 ↗First posted 13 Oct 2023cs.CL cs.AIcited by 44

Not on the map. Why?

Abstract (arXiv)

Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing. However, three core challenges remain: inefficient knowledge retrieval, mistakes of retrieval adversely impacting semantic parsing, and the complexity of previous KBQA methods. To tackle these challenges, we introduce ChatKBQA, a novel and simple generate-then-retrieve KBQA framework, which proposes first generating the logical form with fine-tuned LLMs, then retrieving and replacing entities and relations with an unsupervised retrieval method, to improve both generation and retrieval more directly. Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ. This work can also be regarded as a new paradigm for combining LLMs with knowledge graphs (KGs) for interpretable and knowledge-required question answering. Our code is publicly available.

Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Builds on 51 of its 77 references that are in the map. First posted on arXiv 13 Oct 2023.

Builds on

51 of 77 references.

References · 51

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  10. 2023A Survey of Large Language Modelscited by 2,576
  11. 2017Billion-scale similarity search with GPUscited by 2,497
  12. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
38 more
  1. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  2. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  3. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  4. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  5. 2023Large Language Modelscited by 780
  6. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
  7. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
  8. 2023Baichuan 2: Open Large-scale Language Modelscited by 670
  9. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  10. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  11. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  12. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
  13. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
  14. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  15. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  16. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
  17. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 171
  18. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
  19. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
  20. 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 160
  21. 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
  22. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 103
  23. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
  24. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  25. 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
  26. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 84
  27. 2020Efficient One-Pass End-to-End Entity Linking for Questionscited by 76
  28. 2020UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answeringcited by 61
  29. 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
  30. 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
  31. 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
  32. 2022ArcaneQA: Dynamic Program Induction and Contextualized Encoding for Knowledge Base Question Answeringcited by 48
  33. 2019UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answeringcited by 37
  34. 2021Program Transfer for Answering Complex Questions over Knowledge Basescited by 34
  35. 2023FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answeringcited by 21
  36. 2023Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQAcited by 17
  37. 2021Outlining and Filling: Hierarchical Query Graph Generation for Answering Complex Questions over Knowledge Graphscited by 16
  38. 2022Uni-Parser: Unified Semantic Parser for Question Answering on Knowledge Base and Databasecited by 16

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 20; 2025: 22; 2026: 2.

44 papers.

Sort:

By area:

  1. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  2. 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 166
  3. 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 120
  4. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
  5. 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generationcited by 67
  6. 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 66
  7. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 39
  8. 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Modelscited by 36
  9. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
  10. 2024StructLM: Towards Building Generalist Models for Structured Knowledge Groundingcited by 29
  11. 2024Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generationcited by 27
  12. 2024Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentationcited by 24
32 more
  1. 2024From Natural Language to SQL: Review of LLM-based Text-to-SQL Systemscited by 16
  2. 2024OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMscited by 14
  3. 2024Human-inspired Perspectives: A Survey on AI Long-term Memorycited by 12
  4. 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarkingcited by 12
  5. 2025Grounding LLM Reasoning with Knowledge Graphscited by 7
  6. 2026GraphWalker: Agentic Knowledge Graph Question Answering via Synthetic Trajectory Curriculumcited by 6
  7. 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphscited by 5
  8. 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
  9. 2024Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answeringcited by 4
  10. 2025Aligning Knowledge Graphs and Language Models for Factual Accuracycited by 4
  11. 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILEcited by 4
  12. 2025Enhancing Retrieval Systems with Inference-Time Logical Reasoningcited by 3
  13. 2025CLEAR-KGQA: Clarification-Enhanced Ambiguity Resolution for Knowledge Graph Question Answeringcited by 3
  14. 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generationcited by 3
  15. 2025ProgRAG: Hallucination-Resistant Progressive Retrieval and Reasoning over Knowledge Graphscited by 3
  16. 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answeringcited by 3
  17. 2024MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generationcited by 2
  18. 2025FRASE: Structured Representations for Generalizable SPARQL Query Generationcited by 2
  19. 2025KAG-Thinker: Interactive Thinking and Deep Reasoning in LLMs via Knowledge-Augmented Generationcited by 2
  20. 2025EH-Benchmark Ophthalmic Hallucination Benchmark and Agent-Driven Top-Down Traceable Reasoning Workflowcited by 2
  21. 2024EvalYaks: Instruction Tuning Datasets and LoRA Fine-tuned Models for Automated Scoring of CEFR B2 Speaking Assessment Transcriptscited by 1
  22. 2024Semantic Parsing with Candidate Expressions for Knowledge Base Question Answeringcited by 1
  23. 2025Enhancing Frame Detection with Retrieval Augmented Generationcited by 1
  24. 2025TLoRA: Tri-Matrix Low-Rank Adaptation of Large Language Modelscited by 1
  25. 2025Knowledge Fusion via Bidirectional Information Aggregationcited by 1
  26. 2025Exemplar-Guided Planing: Enhanced LLM Agent for KGQAcited by 1
  27. 2025Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphscited by 1
  28. 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphscited by 1
  29. 2024CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Modelcited by 0
  30. 2024A Learn-Then-Reason Model Towards Generalization in Knowledge Base Question Answeringcited by 0
  31. 2025PGDA-KGQA: A Prompt-Guided Generative Framework with Multiple Data Augmentation Strategies for Knowledge Graph Question Answeringcited by 0
  32. 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Surveycited by 0