mlsanityData to 7 Oct 2026

Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting

arXiv 2410.01154 ↗First posted 2 Oct 2024cs.IR cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed, context-specific prompts needed for understanding various sentences and relations. To address this, we introduce the Self-Prompting framework, a novel method designed to fully harness the embedded RE knowledge within LLMs. Specifically, our framework employs a three-stage diversity approach to prompt LLMs, generating multiple synthetic samples that encapsulate specific relations from scratch. These generated samples act as in-context learning samples, offering explicit and context-specific guidance to efficiently prompt LLMs for RE. Experimental evaluations on benchmark datasets show our approach outperforms existing LLM-based zero-shot RE methods. Additionally, our experiments confirm the effectiveness of our generation pipeline in producing high-quality synthetic data that enhances performance.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

27 of 36 references.

References · 27

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  3. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  4. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  5. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  6. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  7. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  8. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  9. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  10. 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
  11. 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 209
  12. 2016Enhanced LSTM for Natural Language Inferencecited by 199
15 more
  1. 2022Diverse Demonstrations Improve In-context Compositional Generalizationcited by 136
  2. 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventionscited by 121
  3. 2023Finding Support Examples for In-Context Learningcited by 104
  4. 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
  5. 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
  6. 2015Reasoning about Entailment with Neural Attentioncited by 68
  7. 2022RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extractioncited by 60
  8. 2023Better Zero-Shot Reasoning with Self-Adaptive Promptingcited by 52
  9. 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
  10. 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 44
  11. 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
  12. 2023Contrastive Learning of Sentence Embeddings from Scratchcited by 24
  13. 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
  14. 2023RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extractioncited by 13
  15. 2022Elaboration-Generating Commonsense Question Answering at Scalecited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 3.

10 papers.