# Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Text

arXiv: https://arxiv.org/abs/1908.07721 · HTML: https://mlsanity.com/paper/1908.07721/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Aug 2019.

## Built on by (most cited first, 19 of 19)

- [Pre-trained Language Models in Biomedical Domain: A Systematic Survey](https://mlsanity.com/paper/2110.05006/) (2021)
- [Explainable AI for Bioinformatics: Methods, Tools, and Applications](https://mlsanity.com/paper/2212.13261/) (2022)
- ["Is depression related to cannabis?": A knowledge-infused model for Entity and Relation Extraction with Limited Supervision](https://mlsanity.com/paper/2102.01222/) (2021)
- [Transformer-based Multi-task Learning for Disaster Tweet Categorisation](https://mlsanity.com/paper/2110.08010/) (2021)
- [Question Answering Over Biological Knowledge Graph via Amazon Alexa](https://mlsanity.com/paper/2210.06040/) (2022)
- [From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancer](https://mlsanity.com/paper/2310.08365/) (2023)
- [Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representation](https://mlsanity.com/paper/2108.12899/) (2021)
- [A Biomedical Knowledge Graph for Biomarker Discovery in Cancer](https://mlsanity.com/paper/2302.04737/) (2023)
- [Guided Distant Supervision for Multilingual Relation Extraction Data: Adapting to a New Language](https://mlsanity.com/paper/2403.17143/) (2024)
- [From Metaphor to Mechanism: How LLMs Decode Traditional Chinese Medicine Symbolic Language for Modern Clinical Relevance](https://mlsanity.com/paper/2503.02760/) (2025)
- [InstructNet: A Novel Approach for Multi-Label Instruction Classification through Advanced Deep Learning](https://mlsanity.com/paper/2512.18301/) (2025)
- [TERMinator: A system for scientific texts processing](https://mlsanity.com/paper/2209.14854/) (2022)
- [CEntRE: A paragraph-level Chinese dataset for Relation Extraction among Enterprises](https://mlsanity.com/paper/2210.10581/) (2022)
- [Jointly Learning Clinical Entities and Relations with Contextual Language Models and Explicit Context](https://mlsanity.com/paper/2102.11031/) (2021)
- [Requirements Elicitation in Cognitive Service for Recommendation](https://mlsanity.com/paper/2203.14958/) (2022)
- [Understanding Emotion Valence is a Joint Deep Learning Task](https://mlsanity.com/paper/2305.17422/) (2023)
- [Relational Extraction on Wikipedia Tables using Convolutional and Memory Networks](https://mlsanity.com/paper/2307.05827/) (2023)
- [Controlled Randomness Improves the Performance of Transformer Models](https://mlsanity.com/paper/2310.13526/) (2023)
- [A Disease Labeler for Chinese Chest X-Ray Report Generation](https://mlsanity.com/paper/2404.16852/) (2024)

## Abstract (arXiv)

Entity and relation extraction is the necessary step in structuring medical text. However, the feature extraction ability of the bidirectional long short term memory network in the existing model does not achieve the best effect. At the same time, the language model has achieved excellent results in more and more natural language processing tasks. In this paper, we present a focused attention model for the joint entity and relation extraction task. Our model integrates well-known BERT language model into joint learning through dynamic range attention mechanism, thus improving the feature representation ability of shared parameter layer. Experimental results on coronary angiography texts collected from Shuguang Hospital show that the F1-score of named entity recognition and relation classification tasks reach 96.89% and 88.51%, which are better than state-of-the-art methods 1.65% and 1.22%, respectively.