Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference
Not on the map. Why?
Abstract (arXiv)
Compared to the general news domain, information extraction (IE) from biomedical text requires much broader domain knowledge. However, many previous IE methods do not utilize any external knowledge during inference. Due to the exponential growth of biomedical publications, models that do not go beyond their fixed set of parameters will likely fall behind. Inspired by how humans look up relevant information to comprehend a scientific text, we present a novel framework that utilizes external knowledge for joint entity and relation extraction named KECI (Knowledge-Enhanced Collective Inference). Given an input text, KECI first constructs an initial span graph representing its initial understanding of the text. It then uses an entity linker to form a knowledge graph containing relevant background knowledge for the the entity mentions in the text. To make the final predictions, KECI fuses the initial span graph and the knowledge graph into a more refined graph using an attention mechanism. KECI takes a collective approach to link mention spans to entities by integrating global relational information into local representations using graph convolutional networks. Our experimental results show that the framework is highly effective, achieving new state-of-the-art results in two different benchmark datasets: BioRelEx (binding interaction detection) and ADE (adverse drug event extraction). For example, KECI achieves absolute improvements of 4.59% and 4.91% in F1 scores over the state-of-the-art on the BioRelEx entity and relation extraction tasks.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 27 May 2021.
Builds on
27 of 69 references.
References · 27
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
- 2017End-to-end Neural Coreference Resolutioncited by 241
- 2017Encoding Sentences with Graph Convolutional Networks for Semantic Role Labelingcited by 137
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 133
- 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
- 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
15 more
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2018Jointly Multiple Events Extraction via Attention-based Graph Information Aggregationcited by 73
- 2018Joint entity recognition and relation extraction as a multi-head selection problemcited by 59
- 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
- 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
- 2019Leveraging Knowledge Bases in LSTMs for Improving Machine Readingcited by 37
- 2018Adversarial training for multi-context joint entity and relation extractioncited by 29
- 2018Extending Neural Generative Conversational Model using External Knowledge Sourcescited by 16
- 2019Improving Question Answering with External Knowledgecited by 16
- 2019Neural Metric Learning for Fast End-to-End Relation Extractioncited by 12
- 2021A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolutioncited by 11
- 2019Incorporating Domain Knowledge into Medical NLI using Knowledge Graphscited by 7
- 2017Biomedical Event Trigger Identification Using Bidirectional Recurrent Neural Network Based Modelscited by 3
- 2019A Search-based Neural Model for Biomedical Nested and Overlapping Event Detectioncited by 3
- 2020Benchmarking BioRelEx for Entity Tagging and Relation Extractioncited by 1
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 5; 2024: 3; 2025: 1; 2026: 1.
19 papers.
Sort:
By area:
- 2021BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networkscited by 14
- 2022Improving Candidate Retrieval with Entity Profile Generation for Wikidata Entity Linkingcited by 10
- 2022BIOS: An Algorithmically Generated Biomedical Knowledge Graphcited by 10
- 2023Enhancing Biomedical Lay Summarisation with External Knowledge Graphscited by 8
- 2023FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extractioncited by 7
- 2021A Unified Transformer-based Framework for Duplex Text Normalizationcited by 6
- 2022PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Textcited by 6
- 2023Interactive Molecular Discovery with Natural Languagecited by 5
- 2023A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extractioncited by 4
- 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approachcited by 4
- 2021Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representationcited by 3
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanismcited by 2
7 more
- 2022LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognitioncited by 1
- 2022Pair-Based Joint Encoding with Relational Graph Convolutional Networks for Emotion-Cause Pair Extractioncited by 1
- 2024Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstructioncited by 1
- 2024Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt Modelcited by 1
- 2023Dealing with negative samples with multi-task learning on span-based joint entity-relation extractioncited by 0
- 2024Generalized knowledge-enhanced framework for biomedical entity and relation extractioncited by 0
- 2026RexDrug: Reliable Multi-Drug Combination Extraction through Reasoning-Enhanced LLMscited by 0
- 2026RexDrug: Reliable Multi-Drug Combination Extraction through Reasoning-Enhanced LLMs9 Mar 2026
- 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approach23 Mar 2025
- 2024Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt Model18 Oct 2024
- 2024Generalized knowledge-enhanced framework for biomedical entity and relation extraction13 Aug 2024
- 2024Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstruction18 Jan 2024
- 2023Enhancing Biomedical Lay Summarisation with External Knowledge Graphs24 Oct 2023
- 2023Dealing with negative samples with multi-task learning on span-based joint entity-relation extraction18 Sep 2023
- 2023A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction30 Jul 2023
- 2023Interactive Molecular Discovery with Natural Language21 Jun 2023
- 2023FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction19 Jun 2023
- 2022Pair-Based Joint Encoding with Relational Graph Convolutional Networks for Emotion-Cause Pair Extraction4 Dec 2022
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanism23 Oct 2022
7 more
- 2022PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Text22 Oct 2022
- 2022BIOS: An Algorithmically Generated Biomedical Knowledge Graph18 Mar 2022
- 2022Improving Candidate Retrieval with Entity Profile Generation for Wikidata Entity Linking27 Feb 2022
- 2022LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition13 Feb 2022
- 2021BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks6 Sep 2021
- 2021Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representation29 Aug 2021
- 2021A Unified Transformer-based Framework for Duplex Text Normalization23 Aug 2021
- 2021BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networkscited by 14
- 2022Improving Candidate Retrieval with Entity Profile Generation for Wikidata Entity Linkingcited by 10
- 2022BIOS: An Algorithmically Generated Biomedical Knowledge Graphcited by 10
- 2023Enhancing Biomedical Lay Summarisation with External Knowledge Graphscited by 8
- 2023FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extractioncited by 7
- 2021A Unified Transformer-based Framework for Duplex Text Normalizationcited by 6
- 2022PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Textcited by 6
- 2023Interactive Molecular Discovery with Natural Languagecited by 5
- 2023A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extractioncited by 4
- 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approachcited by 4
- 2021Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representationcited by 3
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanismcited by 2
12 most cited of 18 All 18 (JSON)
- 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approach23 Mar 2025
- 2024Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt Model18 Oct 2024
- 2024Generalized knowledge-enhanced framework for biomedical entity and relation extraction13 Aug 2024
- 2024Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstruction18 Jan 2024
- 2023Enhancing Biomedical Lay Summarisation with External Knowledge Graphs24 Oct 2023
- 2023Dealing with negative samples with multi-task learning on span-based joint entity-relation extraction18 Sep 2023
- 2023A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction30 Jul 2023
- 2023Interactive Molecular Discovery with Natural Language21 Jun 2023
- 2023FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction19 Jun 2023
- 2022Pair-Based Joint Encoding with Relational Graph Convolutional Networks for Emotion-Cause Pair Extraction4 Dec 2022
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanism23 Oct 2022
- 2022PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Text22 Oct 2022
12 newest of 18 All 18 (JSON)