Entangled Relations: Leveraging NLI and Meta-analysis to Enhance Biomedical Relation Extraction
Not on the map. Why?
Abstract (arXiv)
Recent research efforts have explored the potential of leveraging natural language inference (NLI) techniques to enhance relation extraction (RE). In this vein, we introduce MetaEntailRE, a novel adaptation method that harnesses NLI principles to enhance RE performance. Our approach follows past works by verbalizing relation classes into class-indicative hypotheses, aligning a traditionally multi-class classification task to one of textual entailment. We introduce three key enhancements: (1) Meta-class analysis which, instead of labeling non-entailed premise-hypothesis pairs with the less informative "neutral" entailment label, provides additional context by analyzing overarching meta-relationships between classes; (2) Feasible hypothesis filtering, which removes unlikely hypotheses from consideration based on domain knowledge derived from data; and (3) Group-based prediction selection, which further improves performance by selecting highly confident predictions. MetaEntailRE is conceptually simple and empirically powerful, yielding significant improvements over conventional relation extraction techniques and other NLI formulations. We observe surprisingly large F1 gains of 17.6 points on BioRED and 13.4 points on ReTACRED compared to conventional methods, underscoring the versatility of MetaEntailRE across both biomedical and general domains.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 31 May 2024.
Builds on
25 of 52 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 565
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
13 more
- 2023Larger language models do in-context learning differentlycited by 394
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
- 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 211
- 2022BioRED: A Rich Biomedical Relation Extraction Datasetcited by 85
- 2020Learning from Context or Names? An Empirical Study on Neural Relation Extractioncited by 75
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 74
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2020Pre-Training Transformers as Energy-Based Cloze Modelscited by 52
- 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
- 2022Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggingcited by 14
- 2024MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Taskscited by 14
- 2022Can NLI Provide Proper Indirect Supervision for Low-resource Biomedical Relation Extraction?cited by 13
Built on by
Not cited yet.