DP-CRE: Continual Relation Extraction via Decoupled Contrastive Learning and Memory Structure Preservation
Not on the map. Why?
Abstract (arXiv)
Continuous Relation Extraction (CRE) aims to incrementally learn relation knowledge from a non-stationary stream of data. Since the introduction of new relational tasks can overshadow previously learned information, catastrophic forgetting becomes a significant challenge in this domain. Current replay-based training paradigms prioritize all data uniformly and train memory samples through multiple rounds, which would result in overfitting old tasks and pronounced bias towards new tasks because of the imbalances of the replay set. To handle the problem, we introduce the DecouPled CRE (DP-CRE) framework that decouples the process of prior information preservation and new knowledge acquisition. This framework examines alterations in the embedding space as new relation classes emerge, distinctly managing the preservation and acquisition of knowledge. Extensive experiments show that DP-CRE significantly outperforms other CRE baselines across two datasets.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
19 of 27 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 362
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2021Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learningcited by 140
- 2019Sentence Embedding Alignment for Lifelong Relation Extractioncited by 70
- 2021Curriculum-Meta Learning for Order-Robust Continual Relation Extractioncited by 34
7 more
- 2022Consistent Representation Learning for Continual Relation Extractioncited by 28
- 2020Learning Adaptive Embedding Considering Incremental Classcited by 21
- 2022Improving Continual Relation Extraction through Prototypical Contrastive Learningcited by 14
- 2022Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentationcited by 13
- 2023Improving Continual Relation Extraction by Distinguishing Analogous Semanticscited by 9
- 2022Less is More: Rethinking State-of-the-art Continual Relation Extraction Models with a Frustratingly Easy but Effective Approachcited by 8
- 2023Enhancing Continual Relation Extraction via Classifier Decompositioncited by 8
Built on by
Citing papers per year: 2025: 2.
2 papers.