HEDP: A Hybrid Energy-Distance Prompt-based Framework for Domain Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Domain Incremental Learning is a critical scenario that requires models to continuously adapt to new data domains without retraining. However, domain shifts often cause severe performance degradation. To address this, we propose Hybrid Energy-Distance Prompt, a domain-incremental framework inspired by Helmholtz free energy. HEDP introduces an energy regularization loss to enhance the separability of domain representations and a hybrid energy-distance weighted mechanism that fuses energy-based and distance-based cues to improve domain selection and generalization. Experiments on multiple benchmarks, including CORe50, show that HEDP achieves superior performance on unseen domains with a 2.57% accuracy gain, effectively mitigating catastrophic forgetting and enhancing open-world adaptability. Our code is hrefhttps://github.com/dannis97500/HEDP/available here.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
27 of 42 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016Learning without Forgettingcited by 2,496
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2021Learning to Prompt for Continual Learningcited by 944
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2019Large Scale Incremental Learningcited by 732
- 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 289
15 more
- 2022S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learningcited by 246
- 2021Co2L: Contrastive Continual Learningcited by 244
- 2023Continual Pre-training of Language Modelscited by 198
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 184
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 154
- 2021Self-Supervised Models are Continual Learnerscited by 149
- 2019Latent Replay for Real-Time Continual Learningcited by 97
- 2024Continual Learning and Catastrophic Forgettingcited by 77
- 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45
- 2022Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interferencecited by 44
- 2022Energy-based Latent Aligner for Incremental Learningcited by 37
- 2023A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithmcited by 33
- 2021Continual Learning at the Edge: Real-Time Training on Smartphone Devicescited by 20
- 2024CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learningcited by 11
- 2023MoP-CLIP: A Mixture of Prompt-Tuned CLIP Models for Domain Incremental Learningcited by 6
Built on by
Not cited yet.