Few-Shot, No Problem: Descriptive Continual Relation Extraction
Not on the map. Why?
Abstract (arXiv)
Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples, failing to reinforce old knowledge, with the scarcity of data in few-shot scenarios further exacerbating these issues by hindering effective data augmentation in the latent space. In this paper, we propose a novel retrieval-based solution, starting with a large language model to generate descriptions for each relation. From these descriptions, we introduce a bi-encoder retrieval training paradigm to enrich both sample and class representation learning. Leveraging these enhanced representations, we design a retrieval-based prediction method where each sample "retrieves" the best fitting relation via a reciprocal rank fusion score that integrates both relation description vectors and class prototypes. Extensive experiments on multiple datasets demonstrate that our method significantly advances the state-of-the-art by maintaining robust performance across sequential tasks, effectively addressing catastrophic forgetting.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 27 Feb 2025.
Builds on
12 of 24 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2024Preserving Generalization of Language models in Few-shot Continual Relation Extractioncited by 7
- 2023KOPPA: Improving Prompt-based Continual Learning with Key-Query Orthogonal Projection and Prototype-based One-Versus-Allcited by 6
- 2024Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance Perspectivecited by 6
- 2023Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extractioncited by 5
- 2024Making Pre-trained Language Models Better Continual Few-Shot Relation Extractorscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.