Enhancing Biomedical Knowledge Discovery for Diseases: An Open-Source Framework Applied on Rett Syndrome and Alzheimer's Disease
Not on the map. Why?
Abstract (arXiv)
The ever-growing volume of biomedical publications creates a critical need for efficient knowledge discovery. In this context, we introduce an open-source end-to-end framework designed to construct knowledge around specific diseases directly from raw text. To facilitate research in disease-related knowledge discovery, we create two annotated datasets focused on Rett syndrome and Alzheimer's disease, enabling the identification of semantic relations between biomedical entities. Extensive benchmarking explores various ways to represent relations and entity representations, offering insights into optimal modeling strategies for semantic relation detection and highlighting language models' competence in knowledge discovery. We also conduct probing experiments using different layer representations and attention scores to explore transformers' ability to capture semantic relations.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 114 references that are in the map. First posted on arXiv 18 Jul 2024.
Builds on
22 of 114 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
- 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
- 2020Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Poolingcited by 115
- 2017Cross-Sentence N-ary Relation Extraction with Graph LSTMscited by 101
10 more
- 2022BioRED: A Rich Biomedical Relation Extraction Datasetcited by 84
- 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
- 2021Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processingcited by 57
- 2023Summarizing, Simplifying, and Synthesizing Medical Evidence Using GPT-3 (with Varying Success)cited by 40
- 2022A Survey on Neural Open Information Extraction: Current Status and Future Directionscited by 27
- 2021Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learningcited by 9
- 2021Abstractified Multi-instance Learning (AMIL) for Biomedical Relation Extractioncited by 7
- 2022Mining On Alzheimer's Diseases Related Knowledge Graph to Identity Potential AD-related Semantic Triples for Drug Repurposingcited by 7
- 2023An Information Extraction Study: Take In Mind the Tokenization!cited by 6
- 2023Representation Learning for Person or Entity-centric Knowledge Graphs: An Application in Healthcarecited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Reduction of Supervision for Biomedical Knowledge Discovery13 Apr 2025