mlsanityData to 7 Oct 2026

Language Models sounds the Death Knell of Knowledge Graphs

arXiv 2301.03980 ↗First posted 10 Jan 2023cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Healthcare domain generates a lot of unstructured and semi-structured text. Natural Language processing (NLP) has been used extensively to process this data. Deep Learning based NLP especially Large Language Models (LLMs) such as BERT have found broad acceptance and are used extensively for many applications. A Language Model is a probability distribution over a word sequence. Self-supervised Learning on a large corpus of data automatically generates deep learning-based language models. BioBERT and Med-BERT are language models pre-trained for the healthcare domain. Healthcare uses typical NLP tasks such as question answering, information extraction, named entity recognition, and search to simplify and improve processes. However, to ensure robust application of the results, NLP practitioners need to normalize and standardize them. One of the main ways of achieving normalization and standardization is the use of Knowledge Graphs. A Knowledge Graph captures concepts and their relationships for a specific domain, but their creation is time-consuming and requires manual intervention from domain experts, which can prove expensive. SNOMED CT (Systematized Nomenclature of Medicine -- Clinical Terms), Unified Medical Language System (UMLS), and Gene Ontology (GO) are popular ontologies from the healthcare domain. SNOMED CT and UMLS capture concepts such as disease, symptoms and diagnosis and GO is the world's largest source of information on the functions of genes. Healthcare has been dealing with an explosion in information about different types of drugs, diseases, and procedures. This paper argues that using Knowledge Graphs is not the best solution for solving problems in this domain. We present experiments using LLMs for the healthcare domain to demonstrate that language models provide the same functionality as knowledge graphs, thereby making knowledge graphs redundant.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 5 of its 13 references that are in the map. First posted on arXiv 10 Jan 2023.

Builds on

5 of 13 references.

References · 5

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020Language Models are Open Knowledge Graphscited by 95
  4. 2020COMETA: A Corpus for Medical Entity Linking in the Social Mediacited by 49
  5. 2022Language Models as Knowledge Embeddingscited by 14

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.