Sentence-Level Relation Extraction via Contrastive Learning with Descriptive Relation Prompts
Not on the map. Why?
Abstract (arXiv)
Sentence-level relation extraction aims to identify the relation between two entities for a given sentence. The existing works mostly focus on obtaining a better entity representation and adopting a multi-label classifier for relation extraction. A major limitation of these works is that they ignore background relational knowledge and the interrelation between entity types and candidate relations. In this work, we propose a new paradigm, Contrastive Learning with Descriptive Relation Prompts(CTL-DRP), to jointly consider entity information, relational knowledge and entity type restrictions. In particular, we introduce an improved entity marker and descriptive relation prompts when generating contextual embedding, and utilize contrastive learning to rank the restricted candidate relations. The CTL-DRP obtains a competitive F1-score of 76.7% on TACRED. Furthermore, the new presented paradigm achieves F1-scores of 85.8% and 91.6% on TACREV and Re-TACRED respectively, which are both the state-of-the-art performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 30 references that are in the map. First posted on arXiv 11 Apr 2023.
Builds on
23 of 30 references.
References · 23
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
11 more
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 229
- 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
- 2021An Improved Baseline for Sentence-level Relation Extractioncited by 81
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 74
- 2017On Sampling Strategies for Neural Network-based Collaborative Filteringcited by 71
- 2019Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networkscited by 61
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2020A Frustratingly Easy Approach for Entity and Relation Extractioncited by 37
- 2021TaCL: Improving BERT Pre-training with Token-aware Contrastive Learningcited by 32
- 2021Relation Classification with Entity Type Restrictioncited by 31
- 2021Improving Sentence-Level Relation Extraction through Curriculum Learningcited by 8
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668