Learning to Prompt Knowledge Transfer for Open-World Continual Learning
Not on the map. Why?
Abstract (arXiv)
This paper studies the problem of continual learning in an open-world scenario, referred to as Open-world Continual Learning (OwCL). OwCL is increasingly rising while it is highly challenging in two-fold: i) learning a sequence of tasks without forgetting knowns in the past, and ii) identifying unknowns (novel objects/classes) in the future. Existing OwCL methods suffer from the adaptability of task-aware boundaries between knowns and unknowns, and do not consider the mechanism of knowledge transfer. In this work, we propose Pro-KT, a novel prompt-enhanced knowledge transfer model for OwCL. Pro-KT includes two key components: (1) a prompt bank to encode and transfer both task-generic and task-specific knowledge, and (2) a task-aware open-set boundary to identify unknowns in the new tasks. Experimental results using two real-world datasets demonstrate that the proposed Pro-KT outperforms the state-of-the-art counterparts in both the detection of unknowns and the classification of knowns markedly.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 22 Dec 2023.
Builds on
19 of 32 references.
References · 19
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2016Learning without Forgettingcited by 2,496
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
- 2021Towards Open World Object Detectioncited by 297
7 more
- 2014Towards Open World Recognitioncited by 226
- 2020Adversarial Continual Learningcited by 142
- 2020Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentationcited by 133
- 2019Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancycited by 112
- 2021Continual Learning of a Mixed Sequence of Similar and Dissimilar Taskscited by 81
- 2023Open-World Continual Learning: Unifying Novelty Detection and Continual Learningcited by 22
- 2019Forward and Backward Knowledge Transfer for Sentiment Classificationcited by 9
Built on by
Citing papers per year: 2024: 5; 2025: 8; 2026: 2.
15 papers.
Sort:
By area:
- 2024Personalized Federated Continual Learning via Multi-granularity Promptcited by 20
- 2024DAM: Dynamic Adapter Merging for Continual Video QA Learningcited by 19
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2024Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchorcited by 9
- 2025Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Groupingcited by 7
- 2024Multi-granularity Knowledge Transfer for Continual Reinforcement Learningcited by 6
- 2025ErrorEraser: Unlearning Data Bias for Improved Continual Learningcited by 3
- 2025ProtoConNet: Prototypical Augmentation and Alignment for Open-Set Few-Shot Image Classificationcited by 3
- 2025Exploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfercited by 2
- 2025Improving Open-world Continual Learning under the Constraints of Scarce Labeled Datacited by 2
- 2025The Lie of the Average: How Class Incremental Learning Evaluation Deceives You?cited by 2
- 2025An Attention-based Feature Memory Design for Energy-Efficient Continual Learningcited by 2
- 2026ProTPS: Prototype-Guided Text Prompt Selection for Continual Learning1 Apr 2026
- 2026MAND: Modality-Aware Novelty Detection for Open-World Egocentric Activity Recognition17 Mar 2026
- 2025An Attention-based Feature Memory Design for Energy-Efficient Continual Learning6 Oct 2025
- 2025The Lie of the Average: How Class Incremental Learning Evaluation Deceives You?26 Sep 2025
- 2025ProtoConNet: Prototypical Augmentation and Alignment for Open-Set Few-Shot Image Classification16 Jul 2025
- 2025ErrorEraser: Unlearning Data Bias for Improved Continual Learning11 Jun 2025
- 2025Action-Adaptive Continual Learning: Enabling Policy Generalization under Dynamic Action Spaces6 Jun 2025
- 2025Improving Open-world Continual Learning under the Constraints of Scarce Labeled Data28 Feb 2025
- 2025Exploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfer27 Feb 2025
- 2025Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping27 Feb 2025
- 2024Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchor24 Dec 2024
- 2024Personalized Federated Continual Learning via Multi-granularity Prompt27 Jun 2024
3 more
- 2024Continual Learning for Smart City: A Survey1 Apr 2024
- 2024DAM: Dynamic Adapter Merging for Continual Video QA Learning13 Mar 2024
- 2024Multi-granularity Knowledge Transfer for Continual Reinforcement Learning25 Jan 2024
- 2024Personalized Federated Continual Learning via Multi-granularity Promptcited by 20
- 2024DAM: Dynamic Adapter Merging for Continual Video QA Learningcited by 19
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2024Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchorcited by 9
- 2025Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Groupingcited by 7
- 2025ProtoConNet: Prototypical Augmentation and Alignment for Open-Set Few-Shot Image Classificationcited by 3
- 2025Exploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfercited by 2
- 2025Improving Open-world Continual Learning under the Constraints of Scarce Labeled Datacited by 2
- 2025The Lie of the Average: How Class Incremental Learning Evaluation Deceives You?cited by 2
- 2025An Attention-based Feature Memory Design for Energy-Efficient Continual Learningcited by 2
- 2025Action-Adaptive Continual Learning: Enabling Policy Generalization under Dynamic Action Spacescited by 1
- 2026MAND: Modality-Aware Novelty Detection for Open-World Egocentric Activity Recognitioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026ProTPS: Prototype-Guided Text Prompt Selection for Continual Learning1 Apr 2026
- 2026MAND: Modality-Aware Novelty Detection for Open-World Egocentric Activity Recognition17 Mar 2026
- 2025An Attention-based Feature Memory Design for Energy-Efficient Continual Learning6 Oct 2025
- 2025The Lie of the Average: How Class Incremental Learning Evaluation Deceives You?26 Sep 2025
- 2025ProtoConNet: Prototypical Augmentation and Alignment for Open-Set Few-Shot Image Classification16 Jul 2025
- 2025Action-Adaptive Continual Learning: Enabling Policy Generalization under Dynamic Action Spaces6 Jun 2025
- 2025Improving Open-world Continual Learning under the Constraints of Scarce Labeled Data28 Feb 2025
- 2025Exploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfer27 Feb 2025
- 2025Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping27 Feb 2025
- 2024Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchor24 Dec 2024
- 2024Personalized Federated Continual Learning via Multi-granularity Prompt27 Jun 2024
- 2024Continual Learning for Smart City: A Survey1 Apr 2024
12 newest of 13 All 13 (JSON)