mlsanityData to 14 Oct 2026

Inconsistent Few-Shot Relation Classification via Cross-Attentional Prototype Networks with Contrastive Learning

arXiv 2110.08254 ↗First posted 13 Oct 2021cs.LG cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Standard few-shot relation classification (RC) is designed to learn a robust classifier with only few labeled data for each class. However, previous works rarely investigate the effects of a different number of classes (i.e., N-way) and number of labeled data per class (i.e., K-shot) during training vs. testing. In this work, we define a new task, textitinconsistent few-shot RC, where the model needs to handle the inconsistency of N and K between training and testing. To address this new task, we propose Prototype Network-based cross-attention contrastive learning (ProtoCACL) to capture the rich mutual interactions between the support set and query set. Experimental results demonstrate that our ProtoCACL can outperform the state-of-the-art baseline model under both inconsistent K and inconsistent N settings, owing to its more robust and discriminate representations. Moreover, we identify that in the inconsistent few-shot learning setting, models can achieve better performance with textitless data than the standard few-shot setting with carefully-selected N and K. In the end of the paper, we provide further analyses and suggestions to systematically guide the selection of N and K under different scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 13 Oct 2021.

Builds on

19 of 29 references.

References · 19

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  2. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  3. 2016Matching Networks for One Shot Learningcited by 2,255
  4. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  5. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
  6. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  7. 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
  8. 2019FewRel 2.0: Towards More Challenging Few-Shot Relation Classificationcited by 94
  9. 2020Few-shot Natural Language Generation for Task-Oriented Dialogcited by 89
  10. 2020Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Networkcited by 83
  11. 2019A Theoretical Analysis of the Number of Shots in Few-Shot Learningcited by 39
  12. 2020Few-shot Relation Extraction via Bayesian Meta-learning on Relation Graphscited by 39
7 more
  1. 2020Coach: A Coarse-to-Fine Approach for Cross-domain Slot Fillingcited by 38
  2. 2021Prototypical Representation Learning for Relation Extractioncited by 33
  3. 2019Multi-Level Matching and Aggregation Network for Few-Shot Relation Classificationcited by 32
  4. 2019Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systemscited by 25
  5. 2018Zero-Shot Adaptive Transfer for Conversational Language Understandingcited by 20
  6. 2015Improved Relation Extraction with Feature-Rich Compositional Embedding Modelscited by 12
  7. 2021MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Taggingcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.