Advancing Relation Extraction through Language Probing with Exemplars from Set Co-Expansion
Not on the map. Why?
Abstract (arXiv)
Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion. The primary goal of our method is to enhance relation classification accuracy and mitigating confusion between contrastive classes. Our approach begins by seeding each relationship class with representative examples. Subsequently, our co-set expansion algorithm enriches training objectives by incorporating similarity measures between target pairs and representative pairs from the target class. Moreover, the co-set expansion process involves a class ranking procedure that takes into account exemplars from contrastive classes. Contextual details encompassing relation mentions are harnessed via context-free Hearst patterns to ascertain contextual similarity. Empirical evaluation demonstrates the efficacy of our co-set expansion approach, resulting in a significant enhancement of relation classification performance. Our method achieves an observed margin of at least 1 percent improvement in accuracy in most settings, on top of existing fine-tuning approaches. To further refine our approach, we conduct an in-depth analysis that focuses on tuning contrastive examples. This strategic selection and tuning effectively reduce confusion between classes sharing similarities, leading to a more precise classification process. Experimental results underscore the effectiveness of our proposed framework for relation extraction. The synergy between co-set expansion and context-aware prompt tuning substantially contributes to improved classification accuracy. Furthermore, the reduction in confusion between contrastive classes through contrastive examples tuning validates the robustness and reliability of our method.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 37 references that are in the map. First posted on arXiv 18 Aug 2023.
Builds on
29 of 37 references.
References · 29
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021WARP: Word-level Adversarial ReProgrammingcited by 221
- 2021How Many Data Points is a Prompt Worth?cited by 198
17 more
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2020Knowledge-Grounded Dialogue Generation with Pre-trained Language Modelscited by 107
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 74
- 2021Prompt-Learning for Fine-Grained Entity Typingcited by 62
- 2021PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen Domainscited by 61
- 2016Question Answering on Freebase via Relation Extraction and Textual Evidencecited by 39
- 2020TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural Networkcited by 37
- 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
- 2022TaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic Clusterscited by 30
- 2019SetExpan: Corpus-Based Set Expansion via Context Feature Selection and Rank Ensemblecited by 25
- 2020Empower Entity Set Expansion via Language Model Probingcited by 25
- 2018Incorporating Structured Commonsense Knowledge in Story Completioncited by 23
- 2022Generative Prompt Tuning for Relation Classificationcited by 13
- 2018Term Set Expansion based NLP Architect by Intel AI Labcited by 11
Built on by
Not cited yet.