mlsanityData to 7 Oct 2026

Few-Shot, No Problem: Descriptive Continual Relation Extraction

arXiv 2502.20596 ↗First posted 27 Feb 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples, failing to reinforce old knowledge, with the scarcity of data in few-shot scenarios further exacerbating these issues by hindering effective data augmentation in the latent space. In this paper, we propose a novel retrieval-based solution, starting with a large language model to generate descriptions for each relation. From these descriptions, we introduce a bi-encoder retrieval training paradigm to enrich both sample and class representation learning. Leveraging these enhanced representations, we design a retrieval-based prediction method where each sample "retrieves" the best fitting relation via a reciprocal rank fusion score that integrates both relation description vectors and class prototypes. Extensive experiments on multiple datasets demonstrate that our method significantly advances the state-of-the-art by maintaining robust performance across sequential tasks, effectively addressing catastrophic forgetting.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 27 Feb 2025.

Builds on

12 of 24 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  4. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  6. 2017Continual Learning with Deep Generative Replaycited by 1,152
  7. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  8. 2024Preserving Generalization of Language models in Few-shot Continual Relation Extractioncited by 7
  9. 2023KOPPA: Improving Prompt-based Continual Learning with Key-Query Orthogonal Projection and Prototype-based One-Versus-Allcited by 6
  10. 2024Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance Perspectivecited by 6
  11. 2023Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extractioncited by 5
  12. 2024Making Pre-trained Language Models Better Continual Few-Shot Relation Extractorscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.