mlsanityData to 14 Oct 2026

Research Trends for the Interplay between Large Language Models and Knowledge Graphs

arXiv 2406.08223 ↗First posted 12 Jun 2024cs.AI cs.CLcited by 15

Not on the map. Why?

Abstract (arXiv)

This survey investigates the synergistic relationship between Large Language Models (LLMs) and Knowledge Graphs (KGs), which is crucial for advancing AI's capabilities in understanding, reasoning, and language processing. It aims to address gaps in current research by exploring areas such as KG Question Answering, ontology generation, KG validation, and the enhancement of KG accuracy and consistency through LLMs. The paper further examines the roles of LLMs in generating descriptive texts and natural language queries for KGs. Through a structured analysis that includes categorizing LLM-KG interactions, examining methodologies, and investigating collaborative uses and potential biases, this study seeks to provide new insights into the combined potential of LLMs and KGs. It highlights the importance of their interaction for improving AI applications and outlines future research directions.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 55 of its 97 references that are in the map. First posted on arXiv 12 Jun 2024.

Builds on

55 of 97 references.

References · 55

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  7. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  8. 2016Complex Embeddings for Simple Link Predictioncited by 902
  9. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  10. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  11. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  12. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
38 more
  1. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
  2. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  3. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  4. 2023Can LLM-Generated Misinformation Be Detected?cited by 177
  5. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  6. 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
  7. 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 102
  8. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  9. 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 95
  10. 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 91
  11. 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
  12. 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
  13. 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
  14. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 72
  15. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  16. 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
  17. 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
  18. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  19. 2023Zero-shot Temporal Relation Extraction with ChatGPTcited by 53
  20. 2023Structured prompt interrogation and recursive extraction of semantics (SPIRES): A method for populating knowledge bases using zero-shot learningcited by 50
  21. 2023ChatGPT versus Traditional Question Answering for Knowledge Graphs: Current Status and Future Directions Towards Knowledge Graph Chatbotscited by 47
  22. 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
  23. 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
  24. 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
  25. 2021Dict-BERT: Enhancing Language Model Pre-training with Dictionarycited by 38
  26. 2023FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checkingcited by 37
  27. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  28. 2023PromptNER: Prompting For Named Entity Recognitioncited by 35
  29. 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
  30. 2022Contextual Semantic Embeddings for Ontology Subsumption Predictioncited by 31
  31. 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
  32. 2021Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Modelscited by 29
  33. 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
  34. 2023ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoningcited by 26
  35. 2023Towards Ontology Construction with Language Modelscited by 23
  36. 2023Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Textcited by 19
  37. 2022GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generationcited by 16
  38. 2023Querying Large Language Models with SQLcited by 14

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 8; 2026: 4.

15 papers.

Sort:

By area: