mlsanityData to 14 Oct 2026

Integrating Heterogeneous Domain Information into Relation Extraction: A Case Study on Drug-Drug Interaction Extraction

arXiv 2212.10714 ↗First posted 21 Dec 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The development of deep neural networks has improved representation learning in various domains, including textual, graph structural, and relational triple representations. This development opened the door to new relation extraction beyond the traditional text-oriented relation extraction. However, research on the effectiveness of considering multiple heterogeneous domain information simultaneously is still under exploration, and if a model can take an advantage of integrating heterogeneous information, it is expected to exhibit a significant contribution to many problems in the world. This thesis works on Drug-Drug Interactions (DDIs) from the literature as a case study and realizes relation extraction utilizing heterogeneous domain information. First, a deep neural relation extraction model is prepared and its attention mechanism is analyzed. Next, a method to combine the drug molecular structure information and drug description information to the input sentence information is proposed, and the effectiveness of utilizing drug molecular structures and drug descriptions for the relation extraction task is shown. Then, in order to further exploit the heterogeneous information, drug-related items, such as protein entries, medical terms and pathways are collected from multiple existing databases and a new data set in the form of a knowledge graph (KG) is constructed. A link prediction task on the constructed data set is conducted to obtain embedding representations of drugs that contain the heterogeneous domain information. Finally, a method that integrates the input sentence information and the heterogeneous KG information is proposed. The proposed model is trained and evaluated on a widely used data set, and as a result, it is shown that utilizing heterogeneous domain information significantly improves the performance of relation extraction from the literature.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 111 references that are in the map. First posted on arXiv 21 Dec 2022.

Builds on

11 of 111 references.

References · 11

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  4. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  5. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  6. 2015Gated Graph Sequence Neural Networkscited by 796
  7. 2019Heterogeneous Graph Attention Networkcited by 734
  8. 2021SciFive: a text-to-text transformer model for biomedical literaturecited by 99
  9. 2017Relation Extraction : A Surveycited by 44
  10. 2015Classifying Relations by Ranking with Convolutional Neural Networkscited by 33
  11. 2016Joint Representation Learning of Text and Knowledge for Knowledge Graph Completioncited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.