mlsanityData to 14 Oct 2026

Combining Knowledge Graphs and Large Language Models

arXiv 2407.06564 ↗First posted 9 Jul 2024cs.CL cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

In recent years, Natural Language Processing (NLP) has played a significant role in various Artificial Intelligence (AI) applications such as chatbots, text generation, and language translation. The emergence of large language models (LLMs) has greatly improved the performance of these applications, showing astonishing results in language understanding and generation. However, they still show some disadvantages, such as hallucinations and lack of domain-specific knowledge, that affect their performance in real-world tasks. These issues can be effectively mitigated by incorporating knowledge graphs (KGs), which organise information in structured formats that capture relationships between entities in a versatile and interpretable fashion. Likewise, the construction and validation of KGs present challenges that LLMs can help resolve. The complementary relationship between LLMs and KGs has led to a trend that combines these technologies to achieve trustworthy results. This work collected 28 papers outlining methods for KG-powered LLMs, LLM-based KGs, and LLM-KG hybrid approaches. We systematically analysed and compared these approaches to provide a comprehensive overview highlighting key trends, innovative techniques, and common challenges. This synthesis will benefit researchers new to the field and those seeking to deepen their understanding of how KGs and LLMs can be effectively combined to enhance AI applications capabilities.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 9 Jul 2024.

Builds on

29 of 40 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  5. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  6. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  7. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  8. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
  9. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  10. 2020KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQAcited by 125
  11. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  12. 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
17 more
  1. 2023A Comprehensive Survey on Automatic Knowledge Graph Constructioncited by 63
  2. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  3. 2024From human experts to machines: An LLM supported approach to ontology and knowledge graph constructioncited by 40
  4. 2023Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learningcited by 37
  5. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  6. 2023Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphscited by 35
  7. 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
  8. 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 33
  9. 2022BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Modelscited by 20
  10. 2024Automated Construction of Theme-specific Knowledge Graphscited by 16
  11. 2023To Transformers and Beyond: Large Language Models for the Genomecited by 15
  12. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 15
  13. 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answeringcited by 11
  14. 2022A Survey on Knowledge-Enhanced Pre-trained Language Modelscited by 3
  15. 2024AutoRD: An Automatic and End-to-End System for Rare Disease Knowledge Graph Construction Based on Ontologies-enhanced Large Language Modelscited by 3
  16. 2024DRAK: Unlocking Molecular Insights with Domain-Specific Retrieval-Augmented Knowledge in LLMscited by 3
  17. 2022What Has Been Enhanced in my Knowledge-Enhanced Language Model?cited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 11; 2026: 2.

16 papers.

Sort:

By area:

  1. 2025AssertionForge: Enhancing Formal Verification Assertion Generation with Structured Representation of Specifications and RTLcited by 13
  2. 2025Contextualizing biological perturbation experiments through languagecited by 10
  3. 2025Graph-Augmented Reasoning: Evolving Step-by-Step Knowledge Graph Retrieval for LLM Reasoningcited by 8
  4. 2024AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomycited by 6
  5. 2025KG-LLM-Bench: A Scalable Benchmark for Evaluating LLM Reasoning on Textualized Knowledge Graphscited by 6
  6. 2025Temporal Reasoning with Large Language Models Augmented by Evolving Knowledge Graphscited by 4
  7. 2025MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM Hallucinationscited by 2
  8. 2025Rethinking Hybrid Retrieval: When Small Embeddings and LLM Re-ranking Beat Bigger Modelscited by 1
  9. 2025Focused Chain-of-Thought: Efficient LLM Reasoning via Structured Input Informationcited by 1
  10. 2026Grounding Large Language Models in Reaction Knowledge Graphs for Synthesis Retrievalcited by 1
  11. 2024FiSTECH: Financial Style Transfer to Enhance Creativity without Hallucinations in LLMscited by 0
  12. 2024Generating Knowledge Graphs from Large Language Models: A Comparative Study of GPT-4, LLaMA 2, and BERTcited by 0
4 more
  1. 2025Leveraging Knowledge Graphs and LLMs for Structured Generation of Misinformationcited by 0
  2. 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspectivecited by 0
  3. 2025Linking heterogeneous microstructure informatics with expert characterization knowledge through customized and hybrid vision-language representations for industrial qualificationcited by 0
  4. 2026Nested Episodic State Topology (NEST): A Graph-Theoretic Architecture of Cognitive Statescited by 0