mlsanityData to 7 Oct 2026

Large Language Models and Knowledge Graphs: Opportunities and Challenges

arXiv 2308.06374 ↗First posted 11 Aug 2023cs.AI cs.CLcited by 71

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have taken Knowledge Representation -- and the world -- by storm. This inflection point marks a shift from explicit knowledge representation to a renewed focus on the hybrid representation of both explicit knowledge and parametric knowledge. In this position paper, we will discuss some of the common debate points within the community on LLMs (parametric knowledge) and Knowledge Graphs (explicit knowledge) and speculate on opportunities and visions that the renewed focus brings, as well as related research topics and challenges.

Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). Builds on 138 of its 232 references that are in the map. First posted on arXiv 11 Aug 2023.

Builds on

138 of 232 references.

References · 138

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  8. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  9. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  11. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  12. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
38 more
  1. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  3. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  4. 2019Language Models as Knowledge Bases?cited by 1,922
  5. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  6. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  7. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  8. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  9. 2019How Can We Know What Language Models Know?cited by 953
  10. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  11. 2023BloombergGPT: A Large Language Model for Financecited by 923
  12. 2019Attention is not Explanationcited by 916
  13. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  14. 2023Large Language Modelscited by 774
  15. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  16. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  17. 2021Editing Factual Knowledge in Language Modelscited by 548
  18. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  19. 2022Memory-Based Model Editing at Scalecited by 443
  20. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  21. 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 361
  22. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  23. 2020Autoregressive Entity Retrievalcited by 333
  24. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  25. 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
  26. 2019Knowledge Enhanced Contextual Word Representationscited by 294
  27. 2021Factual Probing Is [MASK]: Learning vs. Learning to Recallcited by 291
  28. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  29. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  30. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  31. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  32. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  33. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  34. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240
  35. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  36. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
  37. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
  38. 2020How Context Affects Language Models' Factual Predictionscited by 181

50 most cited of 138 All 138 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 32; 2025: 18; 2026: 14.

71 papers.

Sort:

By area:

  1. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  2. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
  3. 2024Large Multimodal Agents: A Surveycited by 99
  4. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
  5. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
  6. 2024From human experts to machines: An LLM supported approach to ontology and knowledge graph constructioncited by 40
  7. 2024On the Challenges and Opportunities in Generative AIcited by 31
  8. 2023Biomedical knowledge graph-optimized prompt generation for large language modelscited by 30
  9. 2024Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspectivecited by 29
  10. 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Tokencited by 26
  11. 2023Indoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologiescited by 25
  12. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
38 more
  1. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  2. 2024MKGL: Mastery of a Three-Word Languagecited by 17
  3. 2023Zero-shot Causal Graph Extrapolation from Text via LLMscited by 15
  4. 2024Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Factscited by 14
  5. 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
  6. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
  7. 2024Ontology Embedding: A Survey of Methods, Applications and Resourcescited by 12
  8. 2024OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing Systemcited by 12
  9. 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMscited by 12
  10. 2025Taxonomy-Aware Evaluation of Vision-Language Modelscited by 11
  11. 2023Graph Agent: Explicit Reasoning Agent for Graphscited by 8
  12. 2024Can Large Language Models Act as Symbolic Reasoners?cited by 8
  13. 2024Large language models as oracles for instantiating ontologies with domain-specific knowledgecited by 6
  14. 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 6
  15. 2024Uncertainty Management in the Construction of Knowledge Graphs: a Surveycited by 5
  16. 2023Clinical Trial Recommendations Using Semantics-Based Inductive Inference and Knowledge Graph Embeddingscited by 4
  17. 2024Evaluating and Safeguarding the Adversarial Robustness of Retrieval-Based In-Context Learningcited by 4
  18. 2024Harnessing the Power of Semi-Structured Knowledge and LLMs with Triplet-Based Prefiltering for Question Answeringcited by 4
  19. 2024Ontology Population using LLMscited by 4
  20. 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
  21. 2023PSYCHIC: A Neuro-Symbolic Framework for Knowledge Graph Question-Answering Groundingcited by 3
  22. 2025CLAUSE: Agentic Neuro-Symbolic Knowledge Graph Reasoning via Dynamic Learnable Context Engineeringcited by 3
  23. 2025Right Answer at the Right Time - Temporal Retrieval-Augmented Generation via Graph Summarizationcited by 3
  24. 2024Building A Knowledge Graph to Enrich ChatGPT Responses in Manufacturing Service Discoverycited by 2
  25. 2024Numerical Literals in Link Prediction: A Critical Examination of Models and Datasetscited by 2
  26. 2025K-ON: Stacking Knowledge On the Head Layer of Large Language Modelcited by 2
  27. 2025Autofocus Retrieval: An Effective Pipeline for Multi-Hop Question Answering With Semi-Structured Knowledgecited by 2
  28. 2025MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM Hallucinationscited by 2
  29. 2025Decomposing and Revising What Language Models Generatecited by 2
  30. 2025Benchmarking Fairness-aware Graph Neural Networks in Knowledge Graphscited by 2
  31. 2026EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrievalcited by 2
  32. 2024Prompt-Time Symbolic Knowledge Capture with Large Language Modelscited by 1
  33. 2024A Survey on Extractive Knowledge Graph Summarization: Applications, Approaches, Evaluation, and Future Directionscited by 1
  34. 2024ASGM-KG: Unveiling Alluvial Gold Mining Through Knowledge Graphscited by 1
  35. 2024Resilience in Knowledge Graph Embeddingscited by 1
  36. 2025Pretrained LLMs Learn Multiple Types of Uncertaintycited by 1
  37. 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Modelscited by 1
  38. 2025Leveraging Knowledge Graphs and LLM Reasoning to Identify Operational Bottlenecks for Warehouse Planning Assistancecited by 1

50 most cited of 71 All 71 (JSON)