Pre-training to Match for Unified Low-shot Relation Extraction
Not on the map. Why?
Abstract (arXiv)
Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, which seem to be with similar target but require totally different underlying abilities. In this paper, we propose Multi-Choice Matching Networks to unify low-shot relation extraction. To fill in the gap between zero-shot and few-shot RE, we propose the triplet-paraphrase meta-training, which leverages triplet paraphrase to pre-train zero-shot label matching ability and uses meta-learning paradigm to learn few-shot instance summarizing ability. Experimental results on three different low-shot RE tasks show that the proposed method outperforms strong baselines by a large margin, and achieve the best performance on few-shot RE leaderboard.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 23 Mar 2022.
Builds on
22 of 32 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
- 2017Few-Shot Learning with Graph Neural Networkscited by 324
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2017Meta Networkscited by 268
10 more
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2019FewRel 2.0: Towards More Challenging Few-Shot Relation Classificationcited by 94
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
- 2018Neural Open Information Extractioncited by 50
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2019Multi-Level Matching and Aggregation Network for Few-Shot Relation Classificationcited by 32
- 2021MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extractioncited by 16
- 2021Element Intervention for Open Relation Extractioncited by 11
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2.
8 papers.
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2023Universal Information Extraction as Unified Semantic Matchingcited by 47
- 2022Better Few-Shot Relation Extraction with Label Prompt Dropoutcited by 8
- 2023ProtoEM: A Prototype-Enhanced Matching Framework for Event Relation Extractioncited by 5
- 2023Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extractioncited by 5
- 2024Learning from Semi-Factuals: A Debiased and Semantic-Aware Framework for Generalized Relation Discoverycited by 2
- 2022Many-Class Text Classification with Matchingcited by 0
- 2024Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margincited by 0
- 2024Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margin27 Oct 2024
- 2024Learning from Semi-Factuals: A Debiased and Semantic-Aware Framework for Generalized Relation Discovery12 Jan 2024
- 2023Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extraction19 Dec 2023
- 2023ProtoEM: A Prototype-Enhanced Matching Framework for Event Relation Extraction22 Sep 2023
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Models3 May 2023
- 2023Universal Information Extraction as Unified Semantic Matching9 Jan 2023
- 2022Better Few-Shot Relation Extraction with Label Prompt Dropout25 Oct 2022
- 2022Many-Class Text Classification with Matching23 May 2022