Research Trends for the Interplay between Large Language Models and Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
This survey investigates the synergistic relationship between Large Language Models (LLMs) and Knowledge Graphs (KGs), which is crucial for advancing AI's capabilities in understanding, reasoning, and language processing. It aims to address gaps in current research by exploring areas such as KG Question Answering, ontology generation, KG validation, and the enhancement of KG accuracy and consistency through LLMs. The paper further examines the roles of LLMs in generating descriptive texts and natural language queries for KGs. Through a structured analysis that includes categorizing LLM-KG interactions, examining methodologies, and investigating collaborative uses and potential biases, this study seeks to provide new insights into the combined potential of LLMs and KGs. It highlights the importance of their interaction for improving AI applications and outlines future research directions.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 55 of its 97 references that are in the map. First posted on arXiv 12 Jun 2024.
Builds on
55 of 97 references.
References · 55
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
38 more
- 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 102
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 95
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 91
- 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
- 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 72
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
- 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
- 2023Zero-shot Temporal Relation Extraction with ChatGPTcited by 53
- 2023Structured prompt interrogation and recursive extraction of semantics (SPIRES): A method for populating knowledge bases using zero-shot learningcited by 50
- 2023ChatGPT versus Traditional Question Answering for Knowledge Graphs: Current Status and Future Directions Towards Knowledge Graph Chatbotscited by 47
- 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
- 2021Dict-BERT: Enhancing Language Model Pre-training with Dictionarycited by 38
- 2023FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checkingcited by 37
- 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
- 2023PromptNER: Prompting For Named Entity Recognitioncited by 35
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
- 2022Contextual Semantic Embeddings for Ontology Subsumption Predictioncited by 31
- 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
- 2021Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Modelscited by 29
- 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
- 2023ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoningcited by 26
- 2023Towards Ontology Construction with Language Modelscited by 23
- 2023Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Textcited by 19
- 2022GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generationcited by 16
- 2023Querying Large Language Models with SQLcited by 14
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 8; 2026: 4.
15 papers.
Sort:
By area:
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
- 2024Combining Knowledge Graphs and Large Language Modelscited by 16
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Studycited by 6
- 2024LLM+KG@VLDB'24 Workshop Summarycited by 3
- 2024FastRAG: Retrieval Augmented Generation for Semi-structured Datacited by 3
- 2025LLM-Powered Knowledge Graphs for Enterprise Intelligence and Analyticscited by 2
- 2025Leveraging Knowledge Graphs and LLMs for Context-Aware Messagingcited by 2
- 2025Trusted Knowledge Extraction for Operations and Maintenance Intelligencecited by 2
- 2025Automated Archival Descriptions with Federated Intelligence of LLMscited by 1
- 2025Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphscited by 1
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspectivecited by 0
- 2026Beyond Predefined Schemas: TRACE-KG for Context-Enriched Knowledge Graph Generationcited by 0
3 more
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQAcited by 0
- 2026From Queries to Narratives: Cultural Heritage Data Stories for Knowledge Graph Exploration and Quality Assessmentcited by 0
- 2026Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healingcited by 0
- 2026Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healing6 Oct 2026
- 2026From Queries to Narratives: Cultural Heritage Data Stories for Knowledge Graph Exploration and Quality Assessment10 Sep 2026
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA16 Jul 2026
- 2026Beyond Predefined Schemas: TRACE-KG for Context-Enriched Knowledge Graph Generation3 Apr 2026
- 2025Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphs23 Oct 2025
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspective26 Jul 2025
- 2025Trusted Knowledge Extraction for Operations and Maintenance Intelligence24 Jul 2025
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Study24 Jun 2025
- 2025Automated Archival Descriptions with Federated Intelligence of LLMs8 Apr 2025
- 2025Leveraging Knowledge Graphs and LLMs for Context-Aware Messaging12 Mar 2025
- 2025LLM-Powered Knowledge Graphs for Enterprise Intelligence and Analytics11 Mar 2025
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches6 Jan 2025
3 more
- 2024FastRAG: Retrieval Augmented Generation for Semi-structured Data21 Nov 2024
- 2024LLM+KG@VLDB'24 Workshop Summary2 Oct 2024
- 2024Combining Knowledge Graphs and Large Language Models9 Jul 2024
- 2024Combining Knowledge Graphs and Large Language Modelscited by 16
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Studycited by 6
- 2024LLM+KG@VLDB'24 Workshop Summarycited by 3
- 2025LLM-Powered Knowledge Graphs for Enterprise Intelligence and Analyticscited by 2
- 2025Leveraging Knowledge Graphs and LLMs for Context-Aware Messagingcited by 2
- 2025Trusted Knowledge Extraction for Operations and Maintenance Intelligencecited by 2
- 2025Automated Archival Descriptions with Federated Intelligence of LLMscited by 1
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspectivecited by 0
- 2026Beyond Predefined Schemas: TRACE-KG for Context-Enriched Knowledge Graph Generationcited by 0
- 2026From Queries to Narratives: Cultural Heritage Data Stories for Knowledge Graph Exploration and Quality Assessmentcited by 0
- 2026Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healingcited by 0
- 2026Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healing6 Oct 2026
- 2026From Queries to Narratives: Cultural Heritage Data Stories for Knowledge Graph Exploration and Quality Assessment10 Sep 2026
- 2026Beyond Predefined Schemas: TRACE-KG for Context-Enriched Knowledge Graph Generation3 Apr 2026
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspective26 Jul 2025
- 2025Trusted Knowledge Extraction for Operations and Maintenance Intelligence24 Jul 2025
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Study24 Jun 2025
- 2025Automated Archival Descriptions with Federated Intelligence of LLMs8 Apr 2025
- 2025Leveraging Knowledge Graphs and LLMs for Context-Aware Messaging12 Mar 2025
- 2025LLM-Powered Knowledge Graphs for Enterprise Intelligence and Analytics11 Mar 2025
- 2024LLM+KG@VLDB'24 Workshop Summary2 Oct 2024
- 2024Combining Knowledge Graphs and Large Language Models9 Jul 2024