mlsanityData to 7 Oct 2026

Pre-training to Match for Unified Low-shot Relation Extraction

arXiv 2203.12274 ↗First posted 23 Mar 2022cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, which seem to be with similar target but require totally different underlying abilities. In this paper, we propose Multi-Choice Matching Networks to unify low-shot relation extraction. To fill in the gap between zero-shot and few-shot RE, we propose the triplet-paraphrase meta-training, which leverages triplet paraphrase to pre-train zero-shot label matching ability and uses meta-learning paradigm to learn few-shot instance summarizing ability. Experimental results on three different low-shot RE tasks show that the proposed method outperforms strong baselines by a large margin, and achieve the best performance on few-shot RE leaderboard.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 23 Mar 2022.

Builds on

22 of 32 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  7. 2016Matching Networks for One Shot Learningcited by 2,246
  8. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  9. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  10. 2017Few-Shot Learning with Graph Neural Networkscited by 324
  11. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
  12. 2017Meta Networkscited by 268
10 more
  1. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  2. 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
  3. 2019FewRel 2.0: Towards More Challenging Few-Shot Relation Classificationcited by 94
  4. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  5. 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
  6. 2018Neural Open Information Extractioncited by 50
  7. 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
  8. 2019Multi-Level Matching and Aggregation Network for Few-Shot Relation Classificationcited by 32
  9. 2021MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extractioncited by 16
  10. 2021Element Intervention for Open Relation Extractioncited by 11

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 4; 2024: 2.

8 papers.