mlsanityData to 14 Oct 2026

MKGL: Mastery of a Three-Word Language

arXiv 2410.07526 ↗First posted 10 Oct 2024cs.CL cs.AIcited by 17

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow minimal hallucinations, remains an underexplored frontier. In this paper, we investigate the integration of LLMs with KGs by introducing a specialized KG Language (KGL), where a sentence precisely consists of an entity noun, a relation verb, and ends with another entity noun. Despite KGL's unfamiliar vocabulary to the LLM, we facilitate its learning through a tailored dictionary and illustrative sentences, and enhance context understanding via real-time KG context retrieval and KGL token embedding augmentation. Our results reveal that LLMs can achieve fluency in KGL, drastically reducing errors compared to conventional KG embedding methods on KG completion. Furthermore, our enhanced LLM shows exceptional competence in generating accurate three-word sentences from an initial entity and interpreting new unseen terms out of KGs.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 47 of its 62 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

47 of 62 references.

References · 47

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2017Graph Attention Networkscited by 8,923
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  9. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  10. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  11. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  12. 2016Complex Embeddings for Simple Link Predictioncited by 902
35 more
  1. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  2. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  3. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  4. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  5. 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
  6. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 396
  7. 2023A Survey of Hallucination in Large Foundation Modelscited by 368
  8. 2020Autoregressive Entity Retrievalcited by 334
  9. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  10. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 239
  11. 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
  12. 2023The Learnability of In-Context Learningcited by 127
  13. 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
  14. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  15. 2021Knowledge Graph Reasoning with Relational Digraphcited by 92
  16. 2019Learning to Exploit Long-term Relational Dependencies in Knowledge Graphscited by 83
  17. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  18. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  19. 2023Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofittingcited by 70
  20. 2020HittER: Hierarchical Transformers for Knowledge Graph Embeddingscited by 54
  21. 2021Multilingual Autoregressive Entity Linkingcited by 50
  22. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  23. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
  24. 2020TransEdge: Translating Relation-contextualized Embeddings for Knowledge Graphscited by 41
  25. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  26. 2019CoKE: Contextualized Knowledge Graph Embeddingcited by 30
  27. 2022MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybridcited by 30
  28. 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
  29. 2022Modeling Multi-hop Question Answering as Single Sequence Predictioncited by 21
  30. 2022KGLM: Integrating Knowledge Graph Structure in Language Models for Link Predictioncited by 15
  31. 2023Generative Multimodal Entity Linkingcited by 12
  32. 2024SambaLingo: Teaching Large Language Models New Languagescited by 11
  33. 2022Unleashing the Power of Transformer for Graphscited by 6
  34. 2020Distributed Representations of Entities in Open-World Knowledge Graphscited by 5
  35. 2023Semantic Role Labeling Guided Out-of-distribution Detectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 6.

17 papers.

Sort:

By area:

  1. 2025Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Modelscited by 11
  2. 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuningcited by 4
  3. 2025Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completioncited by 2
  4. 2025GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completioncited by 2
  5. 2025Knowledge-Augmented Long-CoT Generation for Complex Biomolecular Reasoningcited by 2
  6. 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Modelscited by 1
  7. 2025ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Modelscited by 1
  8. 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
  9. 2025ELMM: Efficient Lightweight Multimodal Large Language Models for Multimodal Knowledge Graph Completioncited by 1
  10. 2025Beyond Prefixes: Graph-as-Memory Cross-Attention for Knowledge Graph Completion with Large Language Modelscited by 0
  11. 2025LLMAtKGE: Large Language Models as Explainable Attackers against Knowledge Graph Embeddingscited by 0
  12. 2026Tokenization, Fusion and Decoupling: Bridging the Granularity Mismatch Between Large Language Models and Knowledge Graphscited by 0
5 more
  1. 2026GS-Quant: Granular Semantic and Generative Structural Quantization for Knowledge Graph Completioncited by 0
  2. 2026RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completioncited by 0
  3. 2026Generative Representation Learning on Hyper-relational Knowledge Graphs via Masked Discrete Diffusioncited by 0
  4. 2026Conditional Diffusion Guided Knowledge Transfer for Multi-Domain Knowledge Graph Completioncited by 0
  5. 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoningcited by 0