Prompt-based Zero-shot Relation Extraction with Semantic Knowledge Augmentation
Not on the map. Why?
Abstract (arXiv)
In relation triplet extraction (RTE), recognizing unseen relations for which there are no training instances is a challenging task. Efforts have been made to recognize unseen relations based on question-answering models or relation descriptions. However, these approaches miss the semantic information about connections between seen and unseen relations. In this paper, We propose a prompt-based model with semantic knowledge augmentation (ZS-SKA) to recognize unseen relations under the zero-shot setting. We present a new word-level analogy-based sentence translation rule and generate augmented instances with unseen relations from instances with seen relations using that new rule. We design prompts with weighted virtual label construction based on an external knowledge graph to integrate semantic knowledge information learned from seen relations. Instead of using the actual label sets in the prompt template, we construct weighted virtual label words. We learn the representations of both seen and unseen relations with augmented instances and prompts. We then calculate the distance between the generated representations using prototypical networks to predict unseen relations. Extensive experiments conducted on three public datasets FewRel, Wiki-ZSL, and NYT, show that ZS-SKA outperforms other methods under zero-shot setting. Results also demonstrate the effectiveness and robustness of ZS-SKA.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 32 of its 64 references that are in the map. First posted on arXiv 8 Dec 2021.
Builds on
32 of 64 references.
References · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2019How Can We Know What Language Models Know?cited by 953
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
20 more
- 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
- 2018A Simple Method for Commonsense Reasoningcited by 223
- 2016Enhanced LSTM for Natural Language Inferencecited by 199
- 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2021Template-free Prompt Tuning for Few-shot NERcited by 73
- 2015Reasoning about Entailment with Neural Attentioncited by 68
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2020Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphscited by 30
- 2019Integrating Semantic Knowledge to Tackle Zero-shot Text Classificationcited by 28
- 2019Graph Neural Networks with Generated Parameters for Relation Extractioncited by 27
- 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
- 2020Logic-guided Semantic Representation Learning for Zero-Shot Relation Classificationcited by 18
- 2021A Novel Global Feature-Oriented Relational Triple Extraction Model based on Table Fillingcited by 16
- 2020Zero-shot Relation Classification from Side Informationcited by 8
- 2020Downstream Model Design of Pre-trained Language Model for Relation Extraction Taskcited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 1; 2025: 2; 2026: 3.
8 papers.
- 2021Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Surveycited by 23
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extractioncited by 11
- 2023Generative Meta-Learning for Zero-Shot Relation Triplet Extractioncited by 1
- 2026GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extractioncited by 1
- 2024Few-Shot Relation Extraction with Hybrid Visual Evidencecited by 0
- 2025LLM-based Zero-shot Triple Extraction for Automated Ontology Generation from Software Engineering Standardscited by 0
- 2026Document-Level Zero-Shot Relation Extraction with Entity Side Informationcited by 0
- 2026Panning for Gold: Expanding Domain-Specific Knowledge Graphs with General Knowledgecited by 0
- 2026GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extraction11 May 2026
- 2026Panning for Gold: Expanding Domain-Specific Knowledge Graphs with General Knowledge15 Jan 2026
- 2026Document-Level Zero-Shot Relation Extraction with Entity Side Information12 Jan 2026
- 2025LLM-based Zero-shot Triple Extraction for Automated Ontology Generation from Software Engineering Standards29 Aug 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024Few-Shot Relation Extraction with Hybrid Visual Evidence1 Mar 2024
- 2023Generative Meta-Learning for Zero-Shot Relation Triplet Extraction3 May 2023
- 2021Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey18 Dec 2021