mlsanityData to 7 Oct 2026

From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancer

arXiv 2310.08365 ↗First posted 12 Oct 2023cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Domain experts often rely on most recent knowledge for apprehending and disseminating specific biological processes that help them design strategies for developing prevention and therapeutic decision-making in various disease scenarios. A challenging scenarios for artificial intelligence (AI) is using biomedical data (e.g., texts, imaging, omics, and clinical) to provide diagnosis and treatment recommendations for cancerous conditions.~Data and knowledge about biomedical entities like cancer, drugs, genes, proteins, and their mechanism is spread across structured (knowledge bases (KBs)) and unstructured (e.g., scientific articles) sources. A large-scale knowledge graph (KG) can be constructed by integrating and extracting facts about semantically interrelated entities and relations. Such a KG not only allows exploration and question answering (QA) but also enables domain experts to deduce new knowledge. However, exploring and querying large-scale KGs is tedious for non-domain users due to their lack of understanding of the data assets and semantic technologies. In this paper, we develop a domain KG to leverage cancer-specific biomarker discovery and interactive QA. For this, we constructed a domain ontology called OncoNet Ontology (ONO), which enables semantic reasoning for validating gene-disease (different types of cancer) relations. The KG is further enriched by harmonizing the ONO, metadata, controlled vocabularies, and biomedical concepts from scientific articles by employing BioBERT- and SciBERT-based information extractors. Further, since the biomedical domain is evolving, where new findings often replace old ones, without having access to up-to-date scientific findings, there is a high chance an AI system exhibits concept drift while providing diagnosis and treatment. Therefore, we fine-tune the KG using large language models (LLMs) based on more recent articles and KBs.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 12 Oct 2023.

Builds on

14 of 26 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  3. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  4. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  5. 2020Knowledge Graphscited by 619
  6. 2015Explicit Knowledge-based Reasoning for Visual Question Answeringcited by 85
  7. 2023ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluationcited by 85
  8. 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Textcited by 48
  9. 2020Building a PubMed knowledge graphcited by 38
  10. 2016Neuro-symbolic representation learning on biological knowledge graphscited by 25
  11. 2020Biomedical named entity recognition using BERT in the machine reading comprehension frameworkcited by 22
  12. 2019Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Textcited by 19
2 more
  1. 2022Explainable AI for Bioinformatics: Methods, Tools, and Applicationscited by 11
  2. 2020A Scalable Framework for Quality Assessment of RDF Datasetscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.