Advancing Analytic Class-Incremental Learning through Vision-Language Calibration
Not on the map. Why?
Abstract (arXiv)
Class-incremental learning (CIL) with pre-trained models (PTMs) faces a critical trade-off between efficient adaptation and long-term stability. While analytic learning enables rapid, recursive closed-form updates, its efficacy is often compromised by accumulated errors and feature incompatibility. In this paper, we first conduct a systematic study to dissect the failure modes of PTM-based analytic CIL, identifying representation rigidity as the primary bottleneck. Motivated by this insight, we propose VILA, a novel dual-branch framework that advances analytic CIL via a two-level vision-language calibration strategy. Specifically, we coherently fuse plastic, task-adapted features with a frozen, universal visual anchor at the feature level through geometric calibration, and leverage cross-modal semantic priors at the decision level to rectify prediction bias. This confluence maintains analytic-learning's extreme efficiency while overcoming its inherent brittleness. Extensive experiments across eight benchmarks demonstrate that VILA consistently yields superior performance, particularly in fine-grained and long-sequence scenarios. Our framework harmonizes high-fidelity prediction with the simplicity of analytic learning. Our code is available at https://github.com/byzhaoAI/VILA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
31 of 48 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
- 2021Learning to Prompt for Continual Learningcited by 938
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
19 more
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2022Last Layer Re-Training is Sufficient for Robustness to Spurious Correlationscited by 379
- 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 362
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 189
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 115
- 2025SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learningcited by 60
- 2022ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protectioncited by 56
- 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
- 2024Convolutional Prompting meets Language Models for Continual Learningcited by 32
- 2025Language Guided Concept Bottleneck Models for Interpretable Continual Learningcited by 28
- 2025CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learningcited by 26
- 2025Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learningcited by 19
- 2025External Knowledge Injection for CLIP-Based Class-Incremental Learningcited by 10
- 2024LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learningcited by 8
Built on by
Not cited yet.