mlsanityData to 14 Oct 2026

Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling

arXiv 2306.11489 ↗First posted 20 Jun 2023cs.CL cs.AIcited by 56

Not on the map. Why?

Abstract (arXiv)

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge graphs (KGs) and function as parameterized knowledge bases. However, while LLMs are proficient at learning probabilistic language patterns based on large corpus and engaging in conversations with humans, they, like previous smaller pre-trained language models (PLMs), still have difficulty in recalling facts while generating knowledge-grounded contents. To overcome these limitations, researchers have proposed enhancing data-driven PLMs with knowledge-based KGs to incorporate explicit factual knowledge into PLMs, thus improving their performance to generate texts requiring factual knowledge and providing more informed responses to user queries. This paper reviews the studies on enhancing PLMs with KGs, detailing existing knowledge graph enhanced pre-trained language models (KGPLMs) as well as their applications. Inspired by existing studies on KGPLM, this paper proposes to enhance LLMs with KGs by developing knowledge graph-enhanced large language models (KGLLMs). KGLLM provides a solution to enhance LLMs' factual reasoning ability, opening up new avenues for LLM research.

Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). Builds on 103 of its 150 references that are in the map. First posted on arXiv 20 Jun 2023.

Builds on

103 of 150 references.

References · 103

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2017Proximal Policy Optimization Algorithmscited by 15,215
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  9. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  10. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  11. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  12. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
38 more
  1. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  2. 2017Deep reinforcement learning from human preferencescited by 3,912
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  4. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  9. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  10. 2023A Survey of Large Language Modelscited by 2,576
  11. 2022Emergent Abilities of Large Language Modelscited by 2,512
  12. 2018Deep contextualized word representationscited by 2,290
  13. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  14. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  15. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  16. 2019Language Models as Knowledge Bases?cited by 1,936
  17. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  18. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  19. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
  20. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  21. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  22. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  23. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  24. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  25. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  26. 2019How multilingual is Multilingual BERT?cited by 645
  27. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  28. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
  29. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  30. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  31. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  32. 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 337
  33. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  34. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
  35. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
  36. 2023Tool Learning with Foundation Modelscited by 302
  37. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  38. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260

50 most cited of 103 All 103 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 10; 2024: 25; 2025: 13; 2026: 8.

56 papers.

Sort:

By area:

  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  2. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
  3. 2024ReFT: Representation Finetuning for Language Modelscited by 197
  4. 2023ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Searchcited by 105
  5. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  6. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  7. 2024Recent Advances of Multimodal Continual Learning: A Comprehensive Surveycited by 39
  8. 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
  9. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
  10. 2023KnowGPT: Knowledge Graph based Prompting for Large Language Modelscited by 31
  11. 2024GraphEval: A Knowledge-Graph Based LLM Hallucination Evaluation Frameworkcited by 30
  12. 2024WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Modelscited by 30
38 more
  1. 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?cited by 24
  2. 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
  3. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
  4. 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applicationscited by 17
  5. 2024Combining Knowledge Graphs and Large Language Modelscited by 16
  6. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 15
  7. 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
  8. 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 14
  9. 2023Generative AI vs. AGI: The Cognitive Strengths and Weaknesses of Modern LLMscited by 11
  10. 2024Retrieval-Enhanced Machine Learning: Synthesis and Opportunitiescited by 11
  11. 2024When Context Leads but Parametric Memory Follows in Large Language Modelscited by 11
  12. 20241+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators?cited by 9
  13. 2024An Automatic Graph Construction Framework based on Large Language Models for Recommendationcited by 9
  14. 2025Large Language Models, Knowledge Graphs and Search Engines: A Crossroads for Answering Users' Questionscited by 8
  15. 2025How to Mitigate Information Loss in Knowledge Graphs for GraphRAG: Leveraging Triple Context Restoration and Query-Driven Feedbackcited by 6
  16. 2025Dynamic Compressing Prompts for Efficient Inference of Large Language Modelscited by 6
  17. 2026Relink: Constructing Query-Driven Evidence Graph On-the-Fly for GraphRAGcited by 6
  18. 2024Enhancing Collaborative Semantics of Language Model-Driven Recommendations via Graph-Aware Learningcited by 5
  19. 2024Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspectivecited by 5
  20. 2023Automating construction contract review using knowledge graph-enhanced large language modelscited by 4
  21. 2026Interactive Narrative Analytics: Bridging Computational Narrative Extraction and Human Sensemakingcited by 4
  22. 2024Towards Ontology-Enhanced Representation Learning for Large Language Modelscited by 3
  23. 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
  24. 2025KnowPath: Knowledge-enhanced Reasoning via LLM-generated Inference Paths over Knowledge Graphscited by 3
  25. 2025Reimagining Urban Science: Scaling Causal Inference with Large Language Modelscited by 3
  26. 2025Personalizing Large Language Models using Retrieval Augmented Generation and Knowledge Graphcited by 3
  27. 2025EICopilot: Search and Explore Enterprise Information over Large-scale Knowledge Graphs with LLM-driven Agentscited by 2
  28. 2023Validating ChatGPT Facts through RDF Knowledge Graphs and Sentence Similaritycited by 1
  29. 2023Knowledge Graphs are not Created Equal: Exploring the Properties and Structure of Real KGscited by 1
  30. 2024Large Language Models as an Indirect Reasoner: Contrapositive and Contradiction for Automated Reasoningcited by 1
  31. 2024Domain-Specific Improvement on Psychotherapy Chatbot Using Assistantcited by 1
  32. 2024A Global-Local Attention Mechanism for Relation Classificationcited by 1
  33. 2025Knowledge Graph-Driven Retrieval-Augmented Generation: Integrating Deepseek-R1 with Weaviate for Advanced Chatbot Applicationscited by 1
  34. 2026RACER: Reinforced Agent Collaboration for Explainable Reasoning on Knowledge Graphscited by 1
  35. 2024Large Language Models and Knowledge Graphs for Astronomical Entity Disambiguationcited by 0
  36. 2024Fast-and-Frugal Text-Graph Transformers are Effective Link Predictorscited by 0
  37. 2024Knowledge Management for Automobile Failure Analysis Using Graph RAGcited by 0
  38. 2025The Other Side of the Coin: Exploring Fairness in Retrieval-Augmented Generationcited by 0

50 most cited of 56 All 56 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap
  2. 2025Enhancing Large Language Models with Reliable Knowledge Graphs
  3. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
  4. 2024Large Language Models Can Better Understand Knowledge Graphs Than We Thought
  5. 2023Enhancing Knowledge Graph Construction Using Large Language Models
  6. 2024Synergizing Knowledge Graphs with Large Language Models: A Comprehensive Review and Future Prospects ↗
  7. 2023KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models
  8. 2025KG-LLM-Bench: A Scalable Benchmark for Evaluating LLM Reasoning on Textualized Knowledge Graphs