mlsanityData to 14 Oct 2026

Entangled Relations: Leveraging NLI and Meta-analysis to Enhance Biomedical Relation Extraction

arXiv 2406.00226 ↗First posted 31 May 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent research efforts have explored the potential of leveraging natural language inference (NLI) techniques to enhance relation extraction (RE). In this vein, we introduce MetaEntailRE, a novel adaptation method that harnesses NLI principles to enhance RE performance. Our approach follows past works by verbalizing relation classes into class-indicative hypotheses, aligning a traditionally multi-class classification task to one of textual entailment. We introduce three key enhancements: (1) Meta-class analysis which, instead of labeling non-entailed premise-hypothesis pairs with the less informative "neutral" entailment label, provides additional context by analyzing overarching meta-relationships between classes; (2) Feasible hypothesis filtering, which removes unlikely hypotheses from consideration based on domain knowledge derived from data; and (3) Group-based prediction selection, which further improves performance by selecting highly confident predictions. MetaEntailRE is conceptually simple and empirically powerful, yielding significant improvements over conventional relation extraction techniques and other NLI formulations. We observe surprisingly large F1 gains of 17.6 points on BioRED and 13.4 points on ReTACRED compared to conventional methods, underscoring the versatility of MetaEntailRE across both biomedical and general domains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 31 May 2024.

Builds on

25 of 52 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  5. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  7. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  8. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  10. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  11. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 565
  12. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
13 more
  1. 2023Larger language models do in-context learning differentlycited by 394
  2. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
  3. 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
  4. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 211
  5. 2022BioRED: A Rich Biomedical Relation Extraction Datasetcited by 85
  6. 2020Learning from Context or Names? An Empirical Study on Neural Relation Extractioncited by 75
  7. 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 74
  8. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  9. 2020Pre-Training Transformers as Energy-Based Cloze Modelscited by 52
  10. 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
  11. 2022Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggingcited by 14
  12. 2024MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Taskscited by 14
  13. 2022Can NLI Provide Proper Indirect Supervision for Low-resource Biomedical Relation Extraction?cited by 13

Built on by

Not cited yet.