# Transfer Learning for Scientific Data Chain Extraction in Small Chemical Corpus with BERT-CRF Model

arXiv: https://arxiv.org/abs/1905.05615 · HTML: https://mlsanity.com/paper/1905.05615/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 May 2019.

## Built on by (most cited first, 8 of 8)

- [Task-Agnostic Detector for Insertion-Based Backdoor Attacks](https://mlsanity.com/paper/2403.17155/) (2024)
- [Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph](https://mlsanity.com/paper/2209.15214/) (2022)
- [Provably Convergent Learned Inexact Descent Algorithm for Low-Dose CT Reconstruction](https://mlsanity.com/paper/2104.12939/) (2021)
- [ScholarChemQA: Unveiling the Power of Language Models in Chemical Research Question Answering](https://mlsanity.com/paper/2407.16931/) (2024)
- [BadCLM: Backdoor Attack in Clinical Language Models for Electronic Health Records](https://mlsanity.com/paper/2407.05213/) (2024)
- [A Brief Overview of Optimization-Based Algorithms for MRI Reconstruction Using Deep Learning](https://mlsanity.com/paper/2406.02626/) (2024)
- [Extracting Structured Seed-Mediated Gold Nanorod Growth Procedures from Literature with GPT-3](https://mlsanity.com/paper/2304.13846/) (2023)
- [Analyzing Multi-Head Attention on Trojan BERT Models](https://mlsanity.com/paper/2406.16925/) (2024)

## Abstract (arXiv)

Computational chemistry develops fast in recent years due to the rapid growth and breakthroughs in AI. Thanks for the progress in natural language processing, researchers can extract more fine-grained knowledge in publications to stimulate the development in computational chemistry. While the works and corpora in chemical entity extraction have been restricted in the biomedicine or life science field instead of the chemistry field, we build a new corpus in chemical bond field annotated for 7 types of entities: compound, solvent, method, bond, reaction, pKa and pKa value. This paper presents a novel BERT-CRF model to build scientific chemical data chains by extracting 7 chemical entities and relations from publications. And we propose a joint model to extract the entities and relations simultaneously. Experimental results on our Chemical Special Corpus demonstrate that we achieve state-of-art and competitive NER performance.