mlsanityData to 14 Oct 2026

Applying BioBERT to Extract Germline Gene-Disease Associations for Building a Knowledge Graph from the Biomedical Literature

arXiv 2309.13061 ↗First posted 11 Sep 2023cs.CL cs.CYcited by 1

Not on the map. Why?

Abstract (arXiv)

Published biomedical information has and continues to rapidly increase. The recent advancements in Natural Language Processing (NLP), have generated considerable interest in automating the extraction, normalization, and representation of biomedical knowledge about entities such as genes and diseases. Our study analyzes germline abstracts in the construction of knowledge graphs of the of the immense work that has been done in this area for genes and diseases. This paper presents SimpleGermKG, an automatic knowledge graph construction approach that connects germline genes and diseases. For the extraction of genes and diseases, we employ BioBERT, a pre-trained BERT model on biomedical corpora. We propose an ontology-based and rule-based algorithm to standardize and disambiguate medical terms. For semantic relationships between articles, genes, and diseases, we implemented a part-whole relation approach to connect each entity with its data source and visualize them in a graph-based knowledge representation. Lastly, we discuss the knowledge graph applications, limitations, and challenges to inspire the future research of germline corpora. Our knowledge graph contains 297 genes, 130 diseases, and 46,747 triples. Graph-based visualizations are used to show the results.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 44 references that are in the map. First posted on arXiv 11 Sep 2023.

Builds on

11 of 44 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  5. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
  6. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
  7. 2022BioRED: A Rich Biomedical Relation Extraction Datasetcited by 85
  8. 2017Relation Extraction : A Surveycited by 44
  9. 2021A Survey on Extraction of Causal Relations from Natural Language Textcited by 25
  10. 2022Ontology Development Kit: a toolkit for building, maintaining, and standardising biomedical ontologiescited by 9
  11. 2022Comparison of biomedical relationship extraction methods and models for knowledge graph creationcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.