Dual-Mode Low-Rank Learner with Bridge-Prototype Ensemble for Vision-Language Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Benefiting from transferable visual-textual alignment, CLIP has been widely adopted for class-incremental learning (CIL). However, existing learners either repeatedly update components shared across tasks, leading to knowledge overwriting, or overly isolate new-task updates, hindering the reuse of CLIP's transferable knowledge and limiting plasticity. Moreover, the text-based or bimodal classifier designs still fail to effectively integrate complementary information from the visual and textual modalities. To address these challenges, we introduce DuLBE, which couples dual-mode low-rank learning with a bridge-prototype ensemble classifier for exemplar-free CIL. DuLBE allocates two visual low-rank update modes according to the gradient demand and uses gradient routing to coordinate them: a compact and rewritable shared mode is selected from historically occupied visual directions to reuse transferable knowledge, while residual modes provide low-interference channels for task-specific variations. Building on the resulting stable inter-modal structure, we further construct geodesic bridges between visual prototypes and text embeddings on the unit hypersphere, and ensemble reliable bridge prototypes to compensate for the modality-gap limitations of textual decision boundaries. Extensive experiments under multiple settings show that DuLBE achieves state-of-the-art CIL performance while retaining the high parameter efficiency of low-rank tuning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 45 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
23 of 45 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Learning without Forgettingcited by 2,496
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 642
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 450
- 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 312
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 198
- 2022CLIP model is an Efficient Continual Learnercited by 65
- 2024Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusioncited by 47
11 more
- 2025Language Guided Concept Bottleneck Models for Interpretable Continual Learningcited by 28
- 2023Overcoming Generic Knowledge Loss with Selective Parameter Updatecited by 23
- 2026KeepLoRA: Continual Learning with Residual Gradient Adaptationcited by 21
- 2025MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Mergingcited by 14
- 2025Harnessing Textual Semantic Priors for Knowledge Transfer and Refinement in CLIP-Driven Continual Learningcited by 10
- 2025Null-Space Filtering for Data-Free Continual Model Merging: Preserving Stability, Promoting Plasticitycited by 8
- 2024Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learningcited by 6
- 2025Stabilizing the Modality Gap: Null-Space Projected Continual Learning for Vision-Language Modelscited by 6
- 2024Adapter-Enhanced Semantic Prompting for Continual Learningcited by 2
- 2025DesCLIP: Robust Continual Learning via General Attribute Descriptions for VLM-Based Visual Recognitioncited by 2
- 2026Continual Learning with Vision-Language Models via Semantic-Geometry Preservationcited by 1
Built on by
Not cited yet.