mlsanityData to 14 Oct 2026

Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptation

arXiv 2212.02560 ↗First posted 5 Dec 2022cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-shot relation extraction aims to recognize novel relations with few labeled sentences in each relation. Previous metric-based few-shot relation extraction algorithms identify relationships by comparing the prototypes generated by the few labeled sentences embedding with the embeddings of the query sentences using a trained metric function. However, as these domains always have considerable differences from those in the training dataset, the generalization ability of these approaches on unseen relations in many domains is limited. Since the prototype is necessary for obtaining relationships between entities in the latent space, we suggest learning more interpretable and efficient prototypes from prior knowledge and the intrinsic semantics of relations to extract new relations in various domains more effectively. By exploring the relationships between relations using prior information, we effectively improve the prototype representation of relations. By using contrastive learning to make the classification margins between sentence embedding more distinct, the prototype's geometric interpretability is enhanced. Additionally, utilizing a transfer learning approach for the cross-domain problem allows the generation process of the prototype to account for the gap between other domains, making the prototype more robust and enabling the better extraction of associations across multiple domains. The experiment results on the benchmark FewRel dataset demonstrate the advantages of the suggested method over some state-of-the-art approaches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 5 Dec 2022.

Builds on

23 of 42 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2022Generative Adversarial Networkscited by 5,627
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  5. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  6. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  8. 2016Matching Networks for One Shot Learningcited by 2,255
  9. 2017Few-Shot Learning with Graph Neural Networkscited by 324
  10. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
  11. 2017Meta Networkscited by 269
  12. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
11 more
  1. 2018Low-Shot Learning from Imaginary Datacited by 181
  2. 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
  3. 2019FewRel 2.0: Towards More Challenging Few-Shot Relation Classificationcited by 94
  4. 2019GMNN: Graph Markov Neural Networkscited by 82
  5. 2019Multi-source Distilling Domain Adaptationcited by 73
  6. 2017Few-Shot Learning Through an Information Retrieval Lenscited by 51
  7. 2020Few-shot Relation Extraction via Bayesian Meta-learning on Relation Graphscited by 39
  8. 2018Low-shot Learning via Covariance-Preserving Adversarial Augmentation Networkscited by 35
  9. 2021Prototypical Representation Learning for Relation Extractioncited by 33
  10. 2020Inductive Unsupervised Domain Adaptation for Few-Shot Classification via Clusteringcited by 8
  11. 2017Efficient K-Shot Learning with Regularized Deep Networkscited by 7

Built on by

Not cited yet.