mlsanityData to 14 Oct 2026

Empowering Few-Shot Relation Extraction with The Integration of Traditional RE Methods and Large Language Models

arXiv 2407.08967 ↗First posted 12 Jul 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-Shot Relation Extraction (FSRE), a subtask of Relation Extraction (RE) that utilizes limited training instances, appeals to more researchers in Natural Language Processing (NLP) due to its capability to extract textual information in extremely low-resource scenarios. The primary methodologies employed for FSRE have been fine-tuning or prompt tuning techniques based on Pre-trained Language Models (PLMs). Recently, the emergence of Large Language Models (LLMs) has prompted numerous researchers to explore FSRE through In-Context Learning (ICL). However, there are substantial limitations associated with methods based on either traditional RE models or LLMs. Traditional RE models are hampered by a lack of necessary prior knowledge, while LLMs fall short in their task-specific capabilities for RE. To address these shortcomings, we propose a Dual-System Augmented Relation Extractor (DSARE), which synergistically combines traditional RE models with LLMs. Specifically, DSARE innovatively injects the prior knowledge of LLMs into traditional RE models, and conversely enhances LLMs' task-specific aptitude for RE through relation extraction augmentation. Moreover, an Integrated Prediction module is employed to jointly consider these two respective predictions and derive the final results. Extensive experiments demonstrate the efficacy of our proposed method.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 22 references that are in the map. First posted on arXiv 12 Jul 2024.

Builds on

18 of 22 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  6. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  7. 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
  8. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  9. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  10. 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
  11. 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
  12. 2021An Improved Baseline for Sentence-level Relation Extractioncited by 81
6 more
  1. 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 74
  2. 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
  3. 2021Relation Classification with Entity Type Restrictioncited by 31
  4. 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
  5. 2022Generative Prompt Tuning for Relation Classificationcited by 13
  6. 2022Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysiscited by 10

Built on by

Not cited yet.