mlsanityData to 14 Oct 2026

ChatGPT versus Traditional Question Answering for Knowledge Graphs: Current Status and Future Directions Towards Knowledge Graph Chatbots

arXiv 2302.06466 ↗First posted 8 Feb 2023cs.CL cs.AI cs.IRcited by 47

Not on the map. Why?

Abstract (arXiv)

Conversational AI and Question-Answering systems (QASs) for knowledge graphs (KGs) are both emerging research areas: they empower users with natural language interfaces for extracting information easily and effectively. Conversational AI simulates conversations with humans; however, it is limited by the data captured in the training datasets. In contrast, QASs retrieve the most recent information from a KG by understanding and translating the natural language question into a formal query supported by the database engine. In this paper, we present a comprehensive study of the characteristics of the existing alternatives towards combining both worlds into novel KG chatbots. Our framework compares two representative conversational models, ChatGPT and Galactica, against KGQAN, the current state-of-the-art QAS. We conduct a thorough evaluation using four real KGs across various application domains to identify the current limitations of each category of systems. Based on our findings, we propose open research opportunities to empower QASs with chatbot capabilities for KGs. All benchmarks and all raw results are available1 for further analysis.

Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 8 Feb 2023.

Builds on

18 of 30 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  8. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  9. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  10. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  11. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  12. 2022Galactica: A Large Language Model for Sciencecited by 744
6 more
  1. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
  2. 2022Improving alignment of dialogue agents via targeted human judgementscited by 531
  3. 2020Towards a Human-like Open-Domain Chatbotcited by 470
  4. 2020BioMegatron: Larger Biomedical Domain Language Modelcited by 76
  5. 2021Fusing task-oriented and open-domain dialogues in conversational agentscited by 28
  6. 2020Keyword-Guided Neural Conversational Modelcited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 33; 2024: 7; 2025: 5; 2026: 2.

47 papers.

Sort:

By area:

  1. 2023Physics of Language Models: Part 3.1, Knowledge Storage and Extractioncited by 270
  2. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
  3. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
  4. 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 168
  5. 2023Physics of Language Models: Part 3.2, Knowledge Manipulationcited by 143
  6. 2023ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmarkcited by 77
  7. 2023Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generationcited by 74
  8. 2023Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Familycited by 71
  9. 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
  10. 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
  11. 2024Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Modelscited by 44
  12. 2023LLM-assisted Knowledge Graph Engineering: Experiments with ChatGPTcited by 42
35 more
  1. 2023GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLPcited by 37
  2. 2023ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedbackcited by 34
  3. 2023To ChatGPT, or not to ChatGPT: That is the question!cited by 20
  4. 2024Triad: A Framework Leveraging a Multi-Role LLM-based Agent to Solve Knowledge Base Question Answeringcited by 18
  5. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 15
  6. 2023Disentangled Phonetic Representation for Chinese Spelling Correctioncited by 14
  7. 2023ChatGPT Hallucinates when Attributing Answerscited by 14
  8. 2023Multidimensional Evaluation for Text Style Transfer Using ChatGPTcited by 12
  9. 2023From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Modelscited by 11
  10. 2023Evaluating ChatGPT as a Question Answering System: A Comprehensive Analysis and Comparison with Existing Modelscited by 11
  11. 2023ChatGPT in the Age of Generative AI and Large Language Models: A Concise Surveycited by 10
  12. 2023On the Potential of Artificial Intelligence Chatbots for Data Exploration of Federated Bioinformatics Knowledge Graphscited by 9
  13. 2023Make a Choice! Knowledge Base Question Answering with In-Context Learningcited by 8
  14. 2025When Large Multimodal Models Confront Evolving Knowledge: Challenges and Explorationscited by 7
  15. 2023Evaluating ChatGPT's Performance for Multilingual and Emoji-based Hate Speech Detectioncited by 6
  16. 2023Generating Natural Language Queries for More Effective Systematic Review Screening Prioritisationcited by 6
  17. 2024Global-Liar: Factuality of LLMs over Time and Geographic Regionscited by 6
  18. 2023Knowledge Graph Question Answering for Materials Science (KGQA4MAT): Developing Natural Language Interface for Metal-Organic Frameworks Knowledge Graph (MOF-KG) Using LLMcited by 5
  19. 2025FIRESPARQL: A LLM-based Framework for SPARQL Query Generation over Scholarly Knowledge Graphscited by 5
  20. 2023Using Multiple RDF Knowledge Graphs for Enriching ChatGPT Responsescited by 4
  21. 2023Conversational Process Modeling: Can Generative AI Empower Domain Experts in Creating and Redesigning Process Models?cited by 4
  22. 2023Does Correction Remain A Problem For Large Language Models?cited by 3
  23. 2024Identifying the Achilles' Heel: An Iterative Method for Dynamically Uncovering Factual Errors in Large Language Modelscited by 3
  24. 2025Facts in Stats: Impacts of Pretraining Diversity on Language Model Generalizationcited by 3
  25. 2026NeuroSymActive: Differentiable Neural-Symbolic Reasoning with Active Exploration for Knowledge Graph Question Answeringcited by 3
  26. 2023Towards the Exploitation of LLM-based Chatbot for Providing Legal Support to Palestinian Cooperativescited by 2
  27. 2023DEMASQ: Unmasking the ChatGPT Wordsmithcited by 2
  28. 2025Bridging Dual Knowledge Graphs for Multi-Hop Question Answering in Construction Safetycited by 2
  29. 2023PatternGPT :A Pattern-Driven Framework for Large Language Model Text Generationcited by 1
  30. 2023Unsupervised Calibration through Prior Adaptation for Text Classification using Large Language Modelscited by 1
  31. 2023Validating ChatGPT Facts through RDF Knowledge Graphs and Sentence Similaritycited by 1
  32. 2024Lexicalization Is All You Need: Examining the Impact of Lexical Knowledge in a Compositional QALD Systemcited by 1
  33. 2023GNN2R: Weakly-Supervised Rationale-Providing Question Answering over Knowledge Graphscited by 0
  34. 2025Understanding Inequality of LLM Fact-Checking over Geographic Regions with Agent and Retrieval modelscited by 0
  35. 2026DreamKG: A KG-Augmented Conversational System for People Experiencing Homelessnesscited by 0