Inconsistent Few-Shot Relation Classification via Cross-Attentional Prototype Networks with Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Standard few-shot relation classification (RC) is designed to learn a robust classifier with only few labeled data for each class. However, previous works rarely investigate the effects of a different number of classes (i.e., N-way) and number of labeled data per class (i.e., K-shot) during training vs. testing. In this work, we define a new task, textitinconsistent few-shot RC, where the model needs to handle the inconsistency of N and K between training and testing. To address this new task, we propose Prototype Network-based cross-attention contrastive learning (ProtoCACL) to capture the rich mutual interactions between the support set and query set. Experimental results demonstrate that our ProtoCACL can outperform the state-of-the-art baseline model under both inconsistent K and inconsistent N settings, owing to its more robust and discriminate representations. Moreover, we identify that in the inconsistent few-shot learning setting, models can achieve better performance with textitless data than the standard few-shot setting with carefully-selected N and K. In the end of the paper, we provide further analyses and suggestions to systematically guide the selection of N and K under different scenarios.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 13 Oct 2021.
Builds on
19 of 29 references.
References · 19
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
- 2019FewRel 2.0: Towards More Challenging Few-Shot Relation Classificationcited by 94
- 2020Few-shot Natural Language Generation for Task-Oriented Dialogcited by 89
- 2020Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Networkcited by 83
- 2019A Theoretical Analysis of the Number of Shots in Few-Shot Learningcited by 39
- 2020Few-shot Relation Extraction via Bayesian Meta-learning on Relation Graphscited by 39
7 more
- 2020Coach: A Coarse-to-Fine Approach for Cross-domain Slot Fillingcited by 38
- 2021Prototypical Representation Learning for Relation Extractioncited by 33
- 2019Multi-Level Matching and Aggregation Network for Few-Shot Relation Classificationcited by 32
- 2019Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systemscited by 25
- 2018Zero-Shot Adaptive Transfer for Conversational Language Understandingcited by 20
- 2015Improved Relation Extraction with Feature-Rich Compositional Embedding Modelscited by 12
- 2021MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Taggingcited by 4
Built on by
Citing papers per year: 2023: 1.
1 paper.