mlsanityData to 14 Oct 2026

Large Language Models for Knowledge Graph Embedding: A Survey

arXiv 2501.07766 ↗First posted 14 Jan 2025cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large amounts of text data, enabling them to understand and generate naturallanguage effectively. As the superior performance of LLMs becomes apparent,they are increasingly being applied to knowledge graph embedding (KGE) related tasks to improve the processing results. Traditional KGE representation learning methods map entities and relations into a low-dimensional vector space, enablingthe triples in the knowledge graph to satisfy a specific scoring function in thevector space. However, based on the powerful language understanding and seman-tic modeling capabilities of LLMs, that have recently been invoked to varying degrees in different types of KGE related scenarios such as multi-modal KGE andopen KGE according to their task characteristics. In this paper, we investigate awide range of approaches for performing LLMs-related tasks in different types of KGE scenarios. To better compare the various approaches, we summarize each KGE scenario in a classification. Finally, we discuss the applications in which the methods are mainly used and suggest several forward-looking directions for the development of this new research area.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 50 of its 128 references that are in the map. First posted on arXiv 14 Jan 2025.

Builds on

50 of 128 references.

References · 50

  1. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  2. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  3. 2022Dense Text Retrieval based on Pretrained Language Models: A Surveycited by 136
  4. 2019Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Predictioncited by 133
  5. 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
  6. 2024FineSurE: Fine-grained Summarization Evaluation using LLMscited by 83
  7. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  8. 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generationcited by 54
  9. 2022Knowledge Graph Embedding: A Survey from the Perspective of Representation Spacescited by 41
  10. 2024Knowledge Graph Enhanced Large Language Model Editingcited by 40
  11. 2023Attention-based Point Cloud Edge Samplingcited by 37
  12. 2024KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking Techniquescited by 37
38 more
  1. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  2. 2024Knowledge Graph Large Language Model (KG-LLM) for Link Predictioncited by 36
  3. 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 33
  4. 2023GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Modelscited by 30
  5. 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMscited by 24
  6. 2024Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphscited by 24
  7. 2024Efficiently Exploring Large Language Models for Document-Level Machine Translation with In-context Learningcited by 23
  8. 2023Large Language Models for Biomedical Knowledge Graph Construction: Information extraction from EMR notescited by 18
  9. 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
  10. 2024Chain-of-History Reasoning for Temporal Knowledge Graph Forecastingcited by 17
  11. 2024Breaking the Barrier: Utilizing Large Language Models for Industrial Recommendation Systems through an Inferential Knowledge Graphcited by 16
  12. 2023Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Modelscited by 15
  13. 2024UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Constructioncited by 15
  14. 2021RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Modelscited by 14
  15. 2023FoodGPT: A Large Language Model in Food Testing Domain with Incremental Pre-training and Knowledge Graph Promptcited by 14
  16. 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancementcited by 14
  17. 2024Large Language Model Meets Graph Neural Network in Knowledge Distillationcited by 14
  18. 2023zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Modelscited by 13
  19. 2024LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphscited by 13
  20. 2024Efficient Knowledge Infusion via KG-LLM Alignmentcited by 13
  21. 2023Large Language Models Meet Knowledge Graphs to Answer Factoid Questionscited by 11
  22. 2024GLaM: Fine-Tuning Large Language Models for Domain Knowledge Graph Alignment via Neighborhood Partitioning and Generative Subgraph Encodingcited by 11
  23. 2024Enhancing Supply Chain Visibility with Knowledge Graphs and Large Language Modelscited by 11
  24. 2024Docs2KG: Unified Knowledge Graph Construction from Heterogeneous Documents Assisted by Large Language Modelscited by 9
  25. 2024ODA: Observation-Driven Agent for integrating LLMs and Knowledge Graphscited by 8
  26. 2023Completeness, Recall, and Negation in Open-World Knowledge Bases: A Surveycited by 7
  27. 2023nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory predictioncited by 7
  28. 2023CoRTEx: Contrastive Learning for Representing Terms via Explanations with Applications on Constructing Biomedical Knowledge Graphscited by 5
  29. 2024KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphscited by 5
  30. 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completioncited by 5
  31. 2023Inductive Meta-path Learning for Schema-complex Heterogeneous Information Networkscited by 4
  32. 2023From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancercited by 4
  33. 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Modelcited by 3
  34. 2024KGPA: Robustness Evaluation for Large Language Models via Cross-Domain Knowledge Graphscited by 3
  35. 2023COMBO: A Complete Benchmark for Open KG Canonicalizationcited by 2
  36. 2024Construction of Hyper-Relational Knowledge Graphs Using Pre-Trained Large Language Modelscited by 2
  37. 2023A Multimodal Ecological Civilization Pattern Recommendation Method Based on Large Language Models and Knowledge Graphcited by 1
  38. 2024Relations Prediction for Knowledge Graph Completion using Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2025Floorplan2Guide: LLM-Guided Floorplan Parsing for BLV Indoor Navigationcited by 2
  2. 2025Decoding Student Minds: Leveraging Conversational Agents for Psychological and Learning Analysiscited by 0
  3. 2026Performance Evaluation of LLMs in Automated RDF Knowledge Graph Generationcited by 0