mlsanityData to 7 Oct 2026

Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representation

arXiv 2108.12899 ↗First posted 29 Aug 2021cs.CL cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Automated knowledge discovery from trending chemical literature is essential for more efficient biomedical research. How to extract detailed knowledge about chemical reactions from the core chemistry literature is a new emerging challenge that has not been well studied. In this paper, we study the new problem of fine-grained chemical entity typing, which poses interesting new challenges especially because of the complex name mentions frequently occurring in chemistry literature and graphic representation of entities. We introduce a new benchmark data set (CHEMET) to facilitate the study of the new task and propose a novel multi-modal representation learning framework to solve the problem of fine-grained chemical entity typing by leveraging external resources with chemical structures and using cross-modal attention to learn effective representation of text in the chemistry domain. Experiment results show that the proposed framework outperforms multiple state-of-the-art methods.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 29 Aug 2021.

Builds on

20 of 35 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  7. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
  8. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  9. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  10. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  11. 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
  12. 2020Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Poolingcited by 115
8 more
  1. 2020ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learningcited by 72
  2. 2018Learning Named Entity Tagger using Domain-Specific Dictionarycited by 65
  3. 2020Cross-media Structured Common Space for Multimedia Event Extractioncited by 59
  4. 2019Leveraging Knowledge Bases in LSTMs for Improving Machine Readingcited by 37
  5. 2019Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typingcited by 22
  6. 2019Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Textcited by 19
  7. 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inferencecited by 19
  8. 2019Improving Fine-grained Entity Typing with Entity Linkingcited by 9

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1; 2024: 1.

3 papers.