mlsanityData to 7 Oct 2026

Advancing Analytic Class-Incremental Learning through Vision-Language Calibration

arXiv 2602.13670 ↗First posted 14 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Class-incremental learning (CIL) with pre-trained models (PTMs) faces a critical trade-off between efficient adaptation and long-term stability. While analytic learning enables rapid, recursive closed-form updates, its efficacy is often compromised by accumulated errors and feature incompatibility. In this paper, we first conduct a systematic study to dissect the failure modes of PTM-based analytic CIL, identifying representation rigidity as the primary bottleneck. Motivated by this insight, we propose VILA, a novel dual-branch framework that advances analytic CIL via a two-level vision-language calibration strategy. Specifically, we coherently fuse plastic, task-adapted features with a frozen, universal visual anchor at the feature level through geometric calibration, and leverage cross-modal semantic priors at the decision level to rectify prediction bias. This confluence maintains analytic-learning's extreme efficiency while overcoming its inherent brittleness. Extensive experiments across eight benchmarks demonstrate that VILA consistently yields superior performance, particularly in fine-grained and long-sequence scenarios. Our framework harmonizes high-fidelity prediction with the simplicity of analytic learning. Our code is available at https://github.com/byzhaoAI/VILA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

31 of 48 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2016Learning without Forgettingcited by 2,465
  6. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  7. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  8. 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
  9. 2021Learning to Prompt for Continual Learningcited by 938
  10. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  11. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  12. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
19 more
  1. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  2. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
  3. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  4. 2022Last Layer Re-Training is Sufficient for Robustness to Spurious Correlationscited by 379
  5. 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 362
  6. 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
  7. 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 189
  8. 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
  9. 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
  10. 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 115
  11. 2025SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learningcited by 60
  12. 2022ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protectioncited by 56
  13. 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
  14. 2024Convolutional Prompting meets Language Models for Continual Learningcited by 32
  15. 2025Language Guided Concept Bottleneck Models for Interpretable Continual Learningcited by 28
  16. 2025CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learningcited by 26
  17. 2025Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learningcited by 19
  18. 2025External Knowledge Injection for CLIP-Based Class-Incremental Learningcited by 10
  19. 2024LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learningcited by 8

Built on by

Not cited yet.