mlsanityData to 7 Oct 2026

Prompt-based Zero-shot Relation Extraction with Semantic Knowledge Augmentation

arXiv 2112.04539 ↗First posted 8 Dec 2021cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

In relation triplet extraction (RTE), recognizing unseen relations for which there are no training instances is a challenging task. Efforts have been made to recognize unseen relations based on question-answering models or relation descriptions. However, these approaches miss the semantic information about connections between seen and unseen relations. In this paper, We propose a prompt-based model with semantic knowledge augmentation (ZS-SKA) to recognize unseen relations under the zero-shot setting. We present a new word-level analogy-based sentence translation rule and generate augmented instances with unseen relations from instances with seen relations using that new rule. We design prompts with weighted virtual label construction based on an external knowledge graph to integrate semantic knowledge information learned from seen relations. Instead of using the actual label sets in the prompt template, we construct weighted virtual label words. We learn the representations of both seen and unseen relations with augmented instances and prompts. We then calculate the distance between the generated representations using prototypical networks to predict unseen relations. Extensive experiments conducted on three public datasets FewRel, Wiki-ZSL, and NYT, show that ZS-SKA outperforms other methods under zero-shot setting. Results also demonstrate the effectiveness and robustness of ZS-SKA.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 32 of its 64 references that are in the map. First posted on arXiv 8 Dec 2021.

Builds on

32 of 64 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  4. 2019Language Models as Knowledge Bases?cited by 1,922
  5. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  6. 2019How Can We Know What Language Models Know?cited by 953
  7. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  8. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
  9. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  10. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
  11. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  12. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
20 more
  1. 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
  2. 2018A Simple Method for Commonsense Reasoningcited by 223
  3. 2016Enhanced LSTM for Natural Language Inferencecited by 199
  4. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  5. 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
  6. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  7. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
  8. 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
  9. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  10. 2021Template-free Prompt Tuning for Few-shot NERcited by 73
  11. 2015Reasoning about Entailment with Neural Attentioncited by 68
  12. 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
  13. 2020Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphscited by 30
  14. 2019Integrating Semantic Knowledge to Tackle Zero-shot Text Classificationcited by 28
  15. 2019Graph Neural Networks with Generated Parameters for Relation Extractioncited by 27
  16. 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
  17. 2020Logic-guided Semantic Representation Learning for Zero-Shot Relation Classificationcited by 18
  18. 2021A Novel Global Feature-Oriented Relational Triple Extraction Model based on Table Fillingcited by 16
  19. 2020Zero-shot Relation Classification from Side Informationcited by 8
  20. 2020Downstream Model Design of Pre-trained Language Model for Relation Extraction Taskcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 1; 2025: 2; 2026: 3.

8 papers.